Compare

The pagoda test

One fixed prompt, run against every model we test: "create an atmospheric SVG of a pagoda and cherry blossom trees." Pure SVG code, no raster generation, no post-processing, no cherry-picked frames.

01

Fable 5.1

Run from the Claude interface with max reasoning effort.

Signed with C2PA content credentials confirming Claude authorship, the only entry here with built-in provenance.

Five-tier pagoda on a hilltop at sunset with mountain ridges, birds, and cherry blossom branches framing the scene, generated as SVG by Fable 5.1
690×472 viewBox · 68 KB · open full size ↗
02

Qwen3.8-Flash-Next

Run through Marshall, served locally via llama.cpp on our own quant, agentionai/Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix-GGUF.

Complete · ↑607k ↓44.6k tokens · 46m 40s total

This model has no vision input, so it couldn't just look at a render and eyeball it. Instead it wrote its own generator script, rendered the SVG to a PNG with resvg-js, and sampled pixel colors at chosen coordinates with ImageMagick to numerically check the composition before calling it done.

Moonlit five-storey pagoda on a misty island beside cherry blossom trees, reflected in a still lake, generated as SVG by Qwen3.8-Flash-Next
1600×1000 viewBox · 311 KB · open full size ↗
03

hy4-preview

Run through Marshall, routed via OpenRouter.

Moonlit pagoda beside cherry blossom trees, reflected in still water, generated as SVG by hy4-preview
1200×800 viewBox · 155 KB · open full size ↗
04

GLM 5.3

Run through Marshall, routed via OpenRouter.

Complete · ↑10.3k ↓5,094 tokens (47 thinking) · ~162 tok/s · 48.6s total · 3.2s to first token · $0.0335

Moonlit pagoda beside cherry blossom trees with a reflecting pool, generated as SVG by GLM 5.3
960×640 viewBox · 13 KB · open full size ↗