An AI SVG experiment

The Generic "Pelican Riding a Bicycle Benchmark"

100 AI models chose a bird, a method of transportation, and draw the result as an SVG. Inspired by Simon Willison's pelican benchmark.

100 models 300 results

The prompt

Generate an SVG of a visually recognizable bird species using a method of transportation.

The wording is intentionally sparse. It does not name a bird or a vehicle, and it does not add formatting instructions. Only complete SVG content is extracted and displayed below; surrounding prose and Markdown fences are omitted.

Most common bird species

Penguin

40.9% of 264 classified results.

Most common transportation method

Bicycle

45% of 282 classified results.

Bird species distribution

38 categories
Penguin 108 · 40.9%
Toucan 24 · 9.1%
Flamingo 18 · 6.8%
Emperor Penguin 17 · 6.4%
Pigeon 13 · 4.9%
Robin 7 · 2.7%
Pelican 7 · 2.7%
Cardinal 6 · 2.3%
Mallard 5 · 1.9%
Eagle 5 · 1.9%

Showing the 10 most common categories.

Transportation method distribution

30 categories
Bicycle 127 · 45%
Skateboard 44 · 15.6%
Scooter 38 · 13.5%
Airplane 18 · 6.4%
Unicycle 8 · 2.8%
Car 7 · 2.5%
Hot Air Balloon 4 · 1.4%
Kick Scooter 4 · 1.4%
Sled 4 · 1.4%
Hang Glider 2 · 0.7%

Showing the 10 most common categories.

Every model, every attempt

Each row contains three separate requests with no shared conversation context.

Dataset last updated July 21, 2026.

Claude Fable 5

anthropic/claude-fable-5 Released by provider: June 9, 2026
Attempt 1
SVG generated by Claude Fable 5, attempt 1
Bird: penguin
Transport: skateboard
Attempt 2
SVG generated by Claude Fable 5, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by Claude Fable 5, attempt 3
Bird: penguin
Transport: skateboard

DeepSeek V4 Pro

deepseek/deepseek-v4-pro Released by provider: April 24, 2026
Attempt 1
SVG generated by DeepSeek V4 Pro, attempt 1
Bird: mallard
Transport: bicycle
Attempt 2
SVG generated by DeepSeek V4 Pro, attempt 2
Bird: toucan
Transport: hot air balloon
Attempt 3
SVG generated by DeepSeek V4 Pro, attempt 3
Bird: pigeon
Transport: scooter

Gemini 3.1 Pro Preview

google/gemini-3.1-pro-preview Released by provider: February 19, 2026
Attempt 1
SVG generated by Gemini 3.1 Pro Preview, attempt 1
Bird: flamingo
Transport: scooter
Attempt 2
SVG generated by Gemini 3.1 Pro Preview, attempt 2
Bird: toucan
Transport: scooter
Attempt 3
SVG generated by Gemini 3.1 Pro Preview, attempt 3
Bird: toucan
Transport: scooter

GLM 5.2

z-ai/glm-5.2 Released by provider: June 13, 2026
Attempt 1
SVG generated by GLM 5.2, attempt 1
Bird: cardinal
Transport: skateboard
Attempt 2
SVG generated by GLM 5.2, attempt 2
Bird: toucan
Transport: bicycle
Attempt 3
SVG generated by GLM 5.2, attempt 3
Bird: toucan
Transport: bicycle

GPT-5.6 Sol Pro

openai/gpt-5.6-sol-pro Released by provider: July 9, 2026
Attempt 1
SVG generated by GPT-5.6 Sol Pro, attempt 1
Bird: toucan
Transport: scooter
Attempt 2
SVG generated by GPT-5.6 Sol Pro, attempt 2
Bird: emperor penguin
Transport: kick scooter
Attempt 3
SVG generated by GPT-5.6 Sol Pro, attempt 3
Bird: emperor penguin
Transport: bicycle

Grok 4.5

x-ai/grok-4.5 Released by provider: July 8, 2026
Attempt 1
SVG generated by Grok 4.5, attempt 1
Bird: penguin
Transport: car
Attempt 2
SVG generated by Grok 4.5, attempt 2
Bird: mallard
Transport: bicycle
Attempt 3
SVG generated by Grok 4.5, attempt 3
Bird: penguin
Transport: bicycle

Hy3

tencent/hy3 Released by provider: July 6, 2026
Attempt 1
SVG generated by Hy3, attempt 1
Bird: flamingo
Transport: bicycle
Attempt 2
SVG generated by Hy3, attempt 2
Bird: owl
Transport: bicycle
Attempt 3
SVG generated by Hy3, attempt 3
Bird: macaroni penguin
Transport: unicycle

Kimi K3

moonshotai/kimi-k3 Released by provider: July 16, 2026
Attempt 1
SVG generated by Kimi K3, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by Kimi K3, attempt 2
Bird: emperor penguin
Transport: bicycle
Attempt 3
SVG generated by Kimi K3, attempt 3
Bird: emperor penguin
Transport: bicycle

Laguna XS 2.1

poolside/laguna-xs-2.1 Released by provider: April 28, 2026
Attempt 1
SVG generated by Laguna XS 2.1, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by Laguna XS 2.1, attempt 2
Bird: pigeon
Transport: Unknown
Attempt 3
SVG generated by Laguna XS 2.1, attempt 3
Bird: Unknown
Transport: bicycle

Ling-2.6-flash

inclusionai/ling-2.6-flash Released by provider: April 23, 2026
Attempt 1
SVG generated by Ling-2.6-flash, attempt 1
Bird: common swift
Transport: flight
Attempt 2
SVG generated by Ling-2.6-flash, attempt 2
Bird: Unknown
Transport: Unknown
Attempt 3
SVG generated by Ling-2.6-flash, attempt 3
Bird: swan
Transport: Unknown

Llama 4 Maverick

meta-llama/llama-4-maverick Released by provider: April 5, 2025
Attempt 1

No complete, valid SVG

Could not classify this result
Attempt 2
SVG generated by Llama 4 Maverick, attempt 2
Bird: bald eagle
Transport: bicycle
Attempt 3
SVG generated by Llama 4 Maverick, attempt 3
Bird: bald eagle
Transport: hang glider

MiMo-V2.5-Pro

xiaomi/mimo-v2.5-pro Released by provider: April 23, 2026
Attempt 1
SVG generated by MiMo-V2.5-Pro, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by MiMo-V2.5-Pro, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by MiMo-V2.5-Pro, attempt 3
Bird: penguin
Transport: skateboard

MiniMax M3

minimax/minimax-m3 Released by provider: June 1, 2026
Attempt 1
SVG generated by MiniMax M3, attempt 1
Bird: swan
Transport: boat
Attempt 2
SVG generated by MiniMax M3, attempt 2
Bird: penguin
Transport: skateboard
Attempt 3
SVG generated by MiniMax M3, attempt 3
Bird: eagle
Transport: airplane

Mistral Small 4

mistralai/mistral-small-2603 Released by provider: March 16, 2026
Attempt 1
SVG generated by Mistral Small 4, attempt 1
Bird: robin
Transport: airplane
Attempt 2
SVG generated by Mistral Small 4, attempt 2
Bird: penguin
Transport: airplane
Attempt 3
SVG generated by Mistral Small 4, attempt 3
Bird: penguin
Transport: airplane

Nemotron 3 Ultra

nvidia/nemotron-3-ultra-550b-a55b Released by provider: June 4, 2026
Attempt 1
SVG generated by Nemotron 3 Ultra, attempt 1
Bird: penguin
Transport: skateboard
Attempt 2
SVG generated by Nemotron 3 Ultra, attempt 2
Bird: pigeon
Transport: skateboard
Attempt 3
SVG generated by Nemotron 3 Ultra, attempt 3
Bird: pigeon
Transport: scooter

Qwen3.7 Max

qwen/qwen3.7-max Released by provider: May 20, 2026
Attempt 1
SVG generated by Qwen3.7 Max, attempt 1
Bird: penguin
Transport: scooter
Attempt 2
SVG generated by Qwen3.7 Max, attempt 2
Bird: penguin
Transport: skateboard
Attempt 3
SVG generated by Qwen3.7 Max, attempt 3
Bird: penguin
Transport: skateboard

Step 3.7 Flash

stepfun/step-3.7-flash Released by provider: May 28, 2026
Attempt 1
SVG generated by Step 3.7 Flash, attempt 1
Bird: penguin
Transport: subway
Attempt 2
SVG generated by Step 3.7 Flash, attempt 2
Bird: pelican
Transport: bicycle
Attempt 3
SVG generated by Step 3.7 Flash, attempt 3
Bird: cardinal
Transport: car

Claude Haiku 4.5

anthropic/claude-haiku-4.5 Released by provider: October 15, 2025
Attempt 1
SVG generated by Claude Haiku 4.5, attempt 1
Bird: eagle
Transport: car
Attempt 2
SVG generated by Claude Haiku 4.5, attempt 2
Bird: eagle
Transport: airplane
Attempt 3
SVG generated by Claude Haiku 4.5, attempt 3
Bird: eagle
Transport: bus

Claude Opus 4.5

anthropic/claude-opus-4.5 Released by provider: November 24, 2025
Attempt 1
SVG generated by Claude Opus 4.5, attempt 1
Bird: penguin
Transport: skateboard
Attempt 2
SVG generated by Claude Opus 4.5, attempt 2
Bird: penguin
Transport: skateboard
Attempt 3
SVG generated by Claude Opus 4.5, attempt 3
Bird: penguin
Transport: skateboard

Claude Opus 4.6

anthropic/claude-opus-4.6 Released by provider: February 5, 2026
Attempt 1
SVG generated by Claude Opus 4.6, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by Claude Opus 4.6, attempt 2
Bird: toucan
Transport: bicycle
Attempt 3
SVG generated by Claude Opus 4.6, attempt 3
Bird: toucan
Transport: bicycle

Claude Opus 4.7

anthropic/claude-opus-4.7 Released by provider: April 16, 2026
Attempt 1
SVG generated by Claude Opus 4.7, attempt 1
Bird: penguin
Transport: skateboard
Attempt 2
SVG generated by Claude Opus 4.7, attempt 2
Bird: penguin
Transport: skateboard
Attempt 3
SVG generated by Claude Opus 4.7, attempt 3
Bird: toucan
Transport: bicycle

Claude Opus 4.8

anthropic/claude-opus-4.8 Released by provider: May 28, 2026
Attempt 1
SVG generated by Claude Opus 4.8, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by Claude Opus 4.8, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by Claude Opus 4.8, attempt 3
Bird: robin
Transport: bicycle

Claude Opus 4.8 (Fast)

anthropic/claude-opus-4.8-fast Released by provider: May 28, 2026
Attempt 1
SVG generated by Claude Opus 4.8 (Fast), attempt 1
Bird: robin
Transport: bicycle
Attempt 2
SVG generated by Claude Opus 4.8 (Fast), attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by Claude Opus 4.8 (Fast), attempt 3
Bird: penguin
Transport: bicycle

Claude Sonnet 4

anthropic/claude-sonnet-4 Released by provider: May 14, 2025
Attempt 1
SVG generated by Claude Sonnet 4, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by Claude Sonnet 4, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by Claude Sonnet 4, attempt 3
Bird: penguin
Transport: bicycle

Claude Sonnet 4.5

anthropic/claude-sonnet-4.5 Released by provider: September 29, 2025
Attempt 1
SVG generated by Claude Sonnet 4.5, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by Claude Sonnet 4.5, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by Claude Sonnet 4.5, attempt 3
Bird: emperor penguin
Transport: bicycle

Claude Sonnet 4.6

anthropic/claude-sonnet-4.6 Released by provider: February 17, 2026
Attempt 1
SVG generated by Claude Sonnet 4.6, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by Claude Sonnet 4.6, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by Claude Sonnet 4.6, attempt 3
Bird: pelican
Transport: bicycle

Claude Sonnet 5

anthropic/claude-sonnet-5 Released by provider: June 30, 2026
Attempt 1
SVG generated by Claude Sonnet 5, attempt 1
Bird: mallard
Transport: car
Attempt 2
SVG generated by Claude Sonnet 5, attempt 2
Bird: penguin
Transport: skateboard
Attempt 3
SVG generated by Claude Sonnet 5, attempt 3
Bird: penguin
Transport: skateboard

DeepSeek V3

deepseek/deepseek-chat Released by provider: December 26, 2024
Attempt 1
SVG generated by DeepSeek V3, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by DeepSeek V3, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by DeepSeek V3, attempt 3
Bird: penguin
Transport: bicycle

DeepSeek V3 0324

deepseek/deepseek-chat-v3-0324 Released by provider: March 24, 2025
Attempt 1
SVG generated by DeepSeek V3 0324, attempt 1
Bird: toucan
Transport: bicycle
Attempt 2
SVG generated by DeepSeek V3 0324, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by DeepSeek V3 0324, attempt 3
Bird: penguin
Transport: bicycle

DeepSeek V3.1

deepseek/deepseek-chat-v3.1 Released by provider: August 21, 2025
Attempt 1
SVG generated by DeepSeek V3.1, attempt 1
Bird: Unknown
Transport: scooter
Attempt 2
SVG generated by DeepSeek V3.1, attempt 2
Bird: Unknown
Transport: scooter
Attempt 3
SVG generated by DeepSeek V3.1, attempt 3
Bird: penguin
Transport: bicycle

DeepSeek V3.1 Terminus

deepseek/deepseek-v3.1-terminus Released by provider: September 22, 2025
Attempt 1
SVG generated by DeepSeek V3.1 Terminus, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by DeepSeek V3.1 Terminus, attempt 2
Bird: penguin
Transport: submarine
Attempt 3
SVG generated by DeepSeek V3.1 Terminus, attempt 3
Bird: penguin
Transport: bicycle

DeepSeek V3.2

deepseek/deepseek-v3.2 Released by provider: September 29, 2025
Attempt 1
SVG generated by DeepSeek V3.2, attempt 1
Bird: penguin
Transport: skateboard
Attempt 2

The response was truncated

Could not classify this result
Attempt 3
SVG generated by DeepSeek V3.2, attempt 3
Bird: penguin
Transport: skateboard

DeepSeek V3.2 Exp

deepseek/deepseek-v3.2-exp Released by provider: September 29, 2025
Attempt 1
SVG generated by DeepSeek V3.2 Exp, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by DeepSeek V3.2 Exp, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by DeepSeek V3.2 Exp, attempt 3
Bird: penguin
Transport: bicycle

DeepSeek V4 Flash

deepseek/deepseek-v4-flash Released by provider: April 24, 2026
Attempt 1
SVG generated by DeepSeek V4 Flash, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by DeepSeek V4 Flash, attempt 2
Bird: toucan
Transport: bicycle
Attempt 3
SVG generated by DeepSeek V4 Flash, attempt 3
Bird: flamingo
Transport: pedal boat

Gemini 2.5 Flash

google/gemini-2.5-flash Released by provider: August 26, 2025
Attempt 1
SVG generated by Gemini 2.5 Flash, attempt 1
Bird: robin
Transport: hot air balloon
Attempt 2
SVG generated by Gemini 2.5 Flash, attempt 2
Bird: flamingo
Transport: bicycle
Attempt 3
SVG generated by Gemini 2.5 Flash, attempt 3
Bird: blue jay
Transport: hot air balloon

Gemini 2.5 Flash Lite

google/gemini-2.5-flash-lite Released by provider: July 22, 2025
Attempt 1

No complete, valid SVG

Could not classify this result
Attempt 2
SVG generated by Gemini 2.5 Flash Lite, attempt 2
Bird: Unknown
Transport: Unknown
Attempt 3

No complete, valid SVG

Could not classify this result

Gemini 2.5 Pro

google/gemini-2.5-pro Released by provider: March 25, 2025
Attempt 1
SVG generated by Gemini 2.5 Pro, attempt 1
Bird: toucan
Transport: scooter
Attempt 2
SVG generated by Gemini 2.5 Pro, attempt 2
Bird: penguin
Transport: skateboard
Attempt 3
SVG generated by Gemini 2.5 Pro, attempt 3
Bird: toucan
Transport: scooter

Gemini 3 Flash Preview

google/gemini-3-flash-preview Released by provider: December 17, 2025
Attempt 1
SVG generated by Gemini 3 Flash Preview, attempt 1
Bird: puffin
Transport: scooter
Attempt 2
SVG generated by Gemini 3 Flash Preview, attempt 2
Bird: flamingo
Transport: bicycle
Attempt 3
SVG generated by Gemini 3 Flash Preview, attempt 3
Bird: puffin
Transport: scooter

Gemini 3.1 Flash Lite

google/gemini-3.1-flash-lite Released by provider: May 8, 2026
Attempt 1
SVG generated by Gemini 3.1 Flash Lite, attempt 1
Bird: toucan
Transport: unicycle
Attempt 2
SVG generated by Gemini 3.1 Flash Lite, attempt 2
Bird: toucan
Transport: bicycle
Attempt 3
SVG generated by Gemini 3.1 Flash Lite, attempt 3
Bird: penguin
Transport: skateboard

Gemini 3.1 Flash Lite Preview

google/gemini-3.1-flash-lite-preview Released by provider: March 3, 2026
Attempt 1
SVG generated by Gemini 3.1 Flash Lite Preview, attempt 1
Bird: penguin
Transport: skateboard
Attempt 2
SVG generated by Gemini 3.1 Flash Lite Preview, attempt 2
Bird: penguin
Transport: rocket
Attempt 3
SVG generated by Gemini 3.1 Flash Lite Preview, attempt 3
Bird: toucan
Transport: unicycle

Gemini 3.5 Flash

google/gemini-3.5-flash Released by provider: May 19, 2026
Attempt 1
SVG generated by Gemini 3.5 Flash, attempt 1
Bird: penguin
Transport: scooter
Attempt 2
SVG generated by Gemini 3.5 Flash, attempt 2
Bird: toucan
Transport: scooter
Attempt 3
SVG generated by Gemini 3.5 Flash, attempt 3
Bird: flamingo
Transport: bicycle

Gemma 3 27B

google/gemma-3-27b-it Released by provider: March 12, 2025
Attempt 1
SVG generated by Gemma 3 27B, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by Gemma 3 27B, attempt 2
Bird: penguin
Transport: scooter
Attempt 3
SVG generated by Gemma 3 27B, attempt 3
Bird: puffin
Transport: scooter

Gemma 4 26B A4B

google/gemma-4-26b-a4b-it Released by provider: April 2, 2026
Attempt 1
SVG generated by Gemma 4 26B A4B , attempt 1
Bird: Unknown
Transport: train
Attempt 2
SVG generated by Gemma 4 26B A4B , attempt 2
Bird: penguin
Transport: skateboard
Attempt 3
SVG generated by Gemma 4 26B A4B , attempt 3
Bird: penguin
Transport: skateboard

Gemma 4 31B

google/gemma-4-31b-it Released by provider: April 2, 2026
Attempt 1
SVG generated by Gemma 4 31B, attempt 1
Bird: penguin
Transport: sled
Attempt 2
SVG generated by Gemma 4 31B, attempt 2
Bird: penguin
Transport: scooter
Attempt 3
SVG generated by Gemma 4 31B, attempt 3
Bird: penguin
Transport: bicycle

GLM 4.7

z-ai/glm-4.7 Released by provider: December 22, 2025
Attempt 1
SVG generated by GLM 4.7, attempt 1
Bird: puffin
Transport: bicycle
Attempt 2
SVG generated by GLM 4.7, attempt 2
Bird: penguin
Transport: scooter
Attempt 3
SVG generated by GLM 4.7, attempt 3
Bird: stork
Transport: scooter

GLM 4.7 Flash

z-ai/glm-4.7-flash Released by provider: December 22, 2025
Attempt 1
SVG generated by GLM 4.7 Flash, attempt 1
Bird: kingfisher
Transport: hydrofoil board
Attempt 2
SVG generated by GLM 4.7 Flash, attempt 2
Bird: hummingbird
Transport: scooter
Attempt 3
SVG generated by GLM 4.7 Flash, attempt 3
Bird: penguin
Transport: skateboard

GLM 5

z-ai/glm-5 Released by provider: February 15, 2026
Attempt 1
SVG generated by GLM 5, attempt 1
Bird: toco toucan
Transport: bicycle
Attempt 2
SVG generated by GLM 5, attempt 2
Bird: flamingo
Transport: skateboard
Attempt 3
SVG generated by GLM 5, attempt 3
Bird: penguin
Transport: skateboard

GLM 5.1

z-ai/glm-5.1 Released by provider: April 7, 2026
Attempt 1
SVG generated by GLM 5.1, attempt 1
Bird: pigeon
Transport: bicycle
Attempt 2
SVG generated by GLM 5.1, attempt 2
Bird: pigeon
Transport: bicycle
Attempt 3
SVG generated by GLM 5.1, attempt 3
Bird: emperor penguin
Transport: skateboard

GPT-4.1

openai/gpt-4.1 Released by provider: April 14, 2025
Attempt 1
SVG generated by GPT-4.1, attempt 1
Bird: penguin
Transport: skateboard
Attempt 2
SVG generated by GPT-4.1, attempt 2
Bird: penguin
Transport: skateboard
Attempt 3
SVG generated by GPT-4.1, attempt 3
Bird: penguin
Transport: bicycle

GPT-4.1 Mini

openai/gpt-4.1-mini Released by provider: April 14, 2025
Attempt 1
SVG generated by GPT-4.1 Mini, attempt 1
Bird: Unknown
Transport: airplane
Attempt 2
SVG generated by GPT-4.1 Mini, attempt 2
Bird: duck
Transport: sailboat
Attempt 3
SVG generated by GPT-4.1 Mini, attempt 3
Bird: Unknown
Transport: bicycle

GPT-4.1 Nano

openai/gpt-4.1-nano Released by provider: April 14, 2025
Attempt 1
SVG generated by GPT-4.1 Nano, attempt 1
Bird: swallow
Transport: bicycle
Attempt 2
SVG generated by GPT-4.1 Nano, attempt 2
Bird: sparrow
Transport: sailboat
Attempt 3
SVG generated by GPT-4.1 Nano, attempt 3
Bird: Unknown
Transport: car

GPT-4o-mini

openai/gpt-4o-mini Released by provider: July 18, 2024
Attempt 1
SVG generated by GPT-4o-mini, attempt 1
Bird: Unknown
Transport: bicycle
Attempt 2

No complete, valid SVG

Could not classify this result
Attempt 3
SVG generated by GPT-4o-mini, attempt 3
Bird: sparrow
Transport: bicycle

GPT-5

openai/gpt-5 Released by provider: August 1, 2025
Attempt 1
SVG generated by GPT-5, attempt 1
Bird: flamingo
Transport: scooter
Attempt 2
SVG generated by GPT-5, attempt 2
Bird: penguin
Transport: scooter
Attempt 3
SVG generated by GPT-5, attempt 3
Bird: toucan
Transport: bicycle

GPT-5 Mini

openai/gpt-5-mini Released by provider: August 1, 2025
Attempt 1
SVG generated by GPT-5 Mini, attempt 1
Bird: penguin
Transport: kick scooter
Attempt 2
SVG generated by GPT-5 Mini, attempt 2
Bird: northern cardinal
Transport: bicycle
Attempt 3
SVG generated by GPT-5 Mini, attempt 3
Bird: penguin
Transport: scooter

GPT-5 Nano

openai/gpt-5-nano Released by provider: August 1, 2025
Attempt 1
SVG generated by GPT-5 Nano, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by GPT-5 Nano, attempt 2
Bird: robin
Transport: bicycle
Attempt 3
SVG generated by GPT-5 Nano, attempt 3
Bird: cardinal
Transport: bicycle

GPT-5.1

openai/gpt-5.1 Released by provider: November 1, 2025
Attempt 1
SVG generated by GPT-5.1, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by GPT-5.1, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by GPT-5.1, attempt 3
Bird: bald eagle
Transport: bicycle

GPT-5.2

openai/gpt-5.2 Released by provider: December 11, 2025
Attempt 1
SVG generated by GPT-5.2, attempt 1
Bird: penguin
Transport: skateboard
Attempt 2
SVG generated by GPT-5.2, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by GPT-5.2, attempt 3
Bird: penguin
Transport: skateboard

GPT-5.3-Codex

openai/gpt-5.3-codex Released by provider: February 24, 2026
Attempt 1
SVG generated by GPT-5.3-Codex, attempt 1
Bird: mallard
Transport: scooter
Attempt 2
SVG generated by GPT-5.3-Codex, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by GPT-5.3-Codex, attempt 3
Bird: penguin
Transport: bicycle

GPT-5.4

openai/gpt-5.4 Released by provider: March 6, 2026
Attempt 1
SVG generated by GPT-5.4, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by GPT-5.4, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by GPT-5.4, attempt 3
Bird: penguin
Transport: bicycle

GPT-5.4 Mini

openai/gpt-5.4-mini Released by provider: March 17, 2026
Attempt 1
SVG generated by GPT-5.4 Mini, attempt 1
Bird: blue jay
Transport: bicycle
Attempt 2
SVG generated by GPT-5.4 Mini, attempt 2
Bird: pelican
Transport: bicycle
Attempt 3
SVG generated by GPT-5.4 Mini, attempt 3
Bird: penguin
Transport: bicycle

GPT-5.4 Nano

openai/gpt-5.4-nano Released by provider: March 17, 2026
Attempt 1
SVG generated by GPT-5.4 Nano, attempt 1
Bird: red-tailed hawk
Transport: airplane
Attempt 2
SVG generated by GPT-5.4 Nano, attempt 2
Bird: peregrine falcon
Transport: jet boat
Attempt 3
SVG generated by GPT-5.4 Nano, attempt 3
Bird: penguin
Transport: bicycle

GPT-5.5

openai/gpt-5.5 Released by provider: April 23, 2026
Attempt 1
SVG generated by GPT-5.5, attempt 1
Bird: emperor penguin
Transport: bicycle
Attempt 2
SVG generated by GPT-5.5, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by GPT-5.5, attempt 3
Bird: toucan
Transport: bicycle

GPT-5.6 Luna

openai/gpt-5.6-luna Released by provider: July 9, 2026
Attempt 1
SVG generated by GPT-5.6 Luna, attempt 1
Bird: northern cardinal
Transport: bicycle
Attempt 2
SVG generated by GPT-5.6 Luna, attempt 2
Bird: emperor penguin
Transport: bicycle
Attempt 3
SVG generated by GPT-5.6 Luna, attempt 3
Bird: emperor penguin
Transport: skateboard

GPT-5.6 Luna Pro

openai/gpt-5.6-luna-pro Released by provider: July 9, 2026
Attempt 1
SVG generated by GPT-5.6 Luna Pro, attempt 1
Bird: northern cardinal
Transport: bicycle
Attempt 2
SVG generated by GPT-5.6 Luna Pro, attempt 2
Bird: emperor penguin
Transport: scooter
Attempt 3
SVG generated by GPT-5.6 Luna Pro, attempt 3
Bird: cardinal
Transport: bicycle

GPT-5.6 Sol

openai/gpt-5.6-sol Released by provider: July 9, 2026
Attempt 1
SVG generated by GPT-5.6 Sol, attempt 1
Bird: toucan
Transport: scooter
Attempt 2
SVG generated by GPT-5.6 Sol, attempt 2
Bird: flamingo
Transport: bicycle
Attempt 3
SVG generated by GPT-5.6 Sol, attempt 3
Bird: emperor penguin
Transport: bicycle

GPT-5.6 Terra

openai/gpt-5.6-terra Released by provider: July 9, 2026
Attempt 1
SVG generated by GPT-5.6 Terra, attempt 1
Bird: emperor penguin
Transport: scooter
Attempt 2
SVG generated by GPT-5.6 Terra, attempt 2
Bird: emperor penguin
Transport: bicycle
Attempt 3
SVG generated by GPT-5.6 Terra, attempt 3
Bird: emperor penguin
Transport: bicycle

GPT-5.6 Terra Pro

openai/gpt-5.6-terra-pro Released by provider: July 9, 2026
Attempt 1
SVG generated by GPT-5.6 Terra Pro, attempt 1
Bird: emperor penguin
Transport: scooter
Attempt 2
SVG generated by GPT-5.6 Terra Pro, attempt 2
Bird: emperor penguin
Transport: scooter
Attempt 3
SVG generated by GPT-5.6 Terra Pro, attempt 3
Bird: mallard
Transport: scooter

gpt-oss-120b

openai/gpt-oss-120b Released by provider: August 5, 2025
Attempt 1
SVG generated by gpt-oss-120b, attempt 1
Bird: Unknown
Transport: bicycle
Attempt 2

No complete, valid SVG

Could not classify this result
Attempt 3

No complete, valid SVG

Could not classify this result

gpt-oss-20b

openai/gpt-oss-20b Released by provider: August 5, 2025
Attempt 1
SVG generated by gpt-oss-20b, attempt 1
Bird: robin
Transport: bicycle
Attempt 2
SVG generated by gpt-oss-20b, attempt 2
Bird: sparrow
Transport: bicycle
Attempt 3
SVG generated by gpt-oss-20b, attempt 3
Bird: penguin
Transport: skateboard

Grok 4.20

x-ai/grok-4.20 Released by provider: March 9, 2026
Attempt 1
SVG generated by Grok 4.20, attempt 1
Bird: American robin
Transport: motorcycle
Attempt 2
SVG generated by Grok 4.20, attempt 2
Bird: flamingo
Transport: bicycle
Attempt 3
SVG generated by Grok 4.20, attempt 3
Bird: bald eagle
Transport: bicycle

Grok 4.3

x-ai/grok-4.3 Released by provider: April 30, 2026
Attempt 1
SVG generated by Grok 4.3, attempt 1
Bird: penguin
Transport: skateboard
Attempt 2
SVG generated by Grok 4.3, attempt 2
Bird: penguin
Transport: bicycle
Attempt 3
SVG generated by Grok 4.3, attempt 3
Bird: penguin
Transport: car

Hy3 preview

tencent/hy3-preview Released by provider: April 24, 2026
Attempt 1
SVG generated by Hy3 preview, attempt 1
Bird: penguin
Transport: sled
Attempt 2
SVG generated by Hy3 preview, attempt 2
Bird: penguin
Transport: skateboard
Attempt 3
SVG generated by Hy3 preview, attempt 3
Bird: scarlet macaw
Transport: bicycle

Kimi K2.5

moonshotai/kimi-k2.5 Released by provider: January 26, 2026
Attempt 1
SVG generated by Kimi K2.5, attempt 1
Bird: flamingo
Transport: scooter
Attempt 2
SVG generated by Kimi K2.5, attempt 2
Bird: flamingo
Transport: bicycle
Attempt 3
SVG generated by Kimi K2.5, attempt 3
Bird: toucan
Transport: airplane

Kimi K2.6

moonshotai/kimi-k2.6 Released by provider: April 20, 2026
Attempt 1
SVG generated by Kimi K2.6, attempt 1
Bird: swallow
Transport: bicycle
Attempt 2
SVG generated by Kimi K2.6, attempt 2
Bird: pelican
Transport: airship
Attempt 3
SVG generated by Kimi K2.6, attempt 3
Bird: macaw
Transport: hang glider

Kimi K2.7 Code

moonshotai/kimi-k2.7-code Released by provider: June 12, 2026
Attempt 1
SVG generated by Kimi K2.7 Code, attempt 1
Bird: flamingo
Transport: kick scooter
Attempt 2
SVG generated by Kimi K2.7 Code, attempt 2
Bird: Atlantic puffin
Transport: kick scooter
Attempt 3
SVG generated by Kimi K2.7 Code, attempt 3
Bird: emperor penguin
Transport: skateboard

Llama 3.1 8B Instruct

meta-llama/llama-3.1-8b-instruct Released by provider: July 23, 2024
Attempt 1

No complete, valid SVG

Could not classify this result
Attempt 2
SVG generated by Llama 3.1 8B Instruct, attempt 2
Bird: Unknown
Transport: motorcycle
Attempt 3
SVG generated by Llama 3.1 8B Instruct, attempt 3
Bird: Unknown
Transport: Unknown

Llama 3.3 70B Instruct

meta-llama/llama-3.3-70b-instruct Released by provider: December 6, 2024
Attempt 1
SVG generated by Llama 3.3 70B Instruct, attempt 1
Bird: pelican
Transport: skateboard
Attempt 2
SVG generated by Llama 3.3 70B Instruct, attempt 2
Bird: penguin
Transport: scooter
Attempt 3
SVG generated by Llama 3.3 70B Instruct, attempt 3
Bird: pelican
Transport: unicycle

MiMo-V2.5

xiaomi/mimo-v2.5 Released by provider: April 23, 2026
Attempt 1
SVG generated by MiMo-V2.5, attempt 1
Bird: penguin
Transport: skateboard
Attempt 2
SVG generated by MiMo-V2.5, attempt 2
Bird: cardinal
Transport: bicycle
Attempt 3

No complete, valid SVG

Could not classify this result

MiniMax M2.5

minimax/minimax-m2.5 Released by provider: February 15, 2026
Attempt 1
SVG generated by MiniMax M2.5, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2
SVG generated by MiniMax M2.5, attempt 2
Bird: crow
Transport: bicycle
Attempt 3
SVG generated by MiniMax M2.5, attempt 3
Bird: toucan
Transport: bicycle

MiniMax M2.7

minimax/minimax-m2.7 Released by provider: March 18, 2026
Attempt 1
SVG generated by MiniMax M2.7, attempt 1
Bird: cardinal
Transport: bicycle
Attempt 2
SVG generated by MiniMax M2.7, attempt 2
Bird: toucan
Transport: bicycle
Attempt 3
SVG generated by MiniMax M2.7, attempt 3
Bird: eagle
Transport: train

Mistral Nemo

mistralai/mistral-nemo Released by provider: July 18, 2024
Attempt 1
SVG generated by Mistral Nemo, attempt 1
Bird: Unknown
Transport: Unknown
Attempt 2

No complete, valid SVG

Could not classify this result
Attempt 3
SVG generated by Mistral Nemo, attempt 3
Bird: seagull
Transport: boat

Mistral Small 3.2 24B

mistralai/mistral-small-3.2-24b-instruct Released by provider: June 20, 2025
Attempt 1
SVG generated by Mistral Small 3.2 24B, attempt 1
Bird: penguin
Transport: skateboard
Attempt 2
SVG generated by Mistral Small 3.2 24B, attempt 2
Bird: penguin
Transport: skateboard
Attempt 3
SVG generated by Mistral Small 3.2 24B, attempt 3
Bird: penguin
Transport: skateboard

Nemotron 3 Nano 30B A3B

nvidia/nemotron-3-nano-30b-a3b Released by provider: December 23, 2025
Attempt 1
SVG generated by Nemotron 3 Nano 30B A3B, attempt 1
Bird: Unknown
Transport: hot-air balloon
Attempt 2
SVG generated by Nemotron 3 Nano 30B A3B, attempt 2
Bird: robin
Transport: bicycle
Attempt 3
SVG generated by Nemotron 3 Nano 30B A3B, attempt 3
Bird: Unknown
Transport: bus

Nemotron 3 Super

nvidia/nemotron-3-super-120b-a12b Released by provider: March 10, 2026
Attempt 1
SVG generated by Nemotron 3 Super, attempt 1
Bird: northern cardinal
Transport: skateboard
Attempt 2
SVG generated by Nemotron 3 Super, attempt 2
Bird: pigeon
Transport: bicycle
Attempt 3
SVG generated by Nemotron 3 Super, attempt 3
Bird: European robin
Transport: bicycle

o4 Mini

openai/o4-mini Released by provider: April 16, 2025
Attempt 1
SVG generated by o4 Mini, attempt 1
Bird: penguin
Transport: scooter
Attempt 2
SVG generated by o4 Mini, attempt 2
Bird: northern cardinal
Transport: bicycle
Attempt 3
SVG generated by o4 Mini, attempt 3
Bird: flamingo
Transport: bicycle

Qwen3 235B A22B Instruct 2507

qwen/qwen3-235b-a22b-2507 Released by provider: July 21, 2025
Attempt 1
SVG generated by Qwen3 235B A22B Instruct 2507, attempt 1
Bird: pigeon
Transport: scooter
Attempt 2
SVG generated by Qwen3 235B A22B Instruct 2507, attempt 2
Bird: pigeon
Transport: scooter
Attempt 3
SVG generated by Qwen3 235B A22B Instruct 2507, attempt 3
Bird: penguin
Transport: unicycle

Qwen3 30B A3B Instruct 2507

qwen/qwen3-30b-a3b-instruct-2507 Released by provider: July 30, 2025
Attempt 1
SVG generated by Qwen3 30B A3B Instruct 2507, attempt 1
Bird: pigeon
Transport: bicycle
Attempt 2
SVG generated by Qwen3 30B A3B Instruct 2507, attempt 2
Bird: woodpecker
Transport: bicycle
Attempt 3

No complete, valid SVG

Could not classify this result

Qwen3 Coder Next

qwen/qwen3-coder-next Released by provider: February 4, 2026
Attempt 1
SVG generated by Qwen3 Coder Next, attempt 1
Bird: blue jay
Transport: bicycle
Attempt 2
SVG generated by Qwen3 Coder Next, attempt 2
Bird: red-tailed hawk
Transport: bicycle
Attempt 3
SVG generated by Qwen3 Coder Next, attempt 3
Bird: red-tailed hawk
Transport: fighter jet

Qwen3 Next 80B A3B Instruct

qwen/qwen3-next-80b-a3b-instruct Released by provider: September 10, 2025
Attempt 1
SVG generated by Qwen3 Next 80B A3B Instruct, attempt 1
Bird: pheasant
Transport: bicycle
Attempt 2
SVG generated by Qwen3 Next 80B A3B Instruct, attempt 2
Bird: pigeon
Transport: bicycle
Attempt 3
SVG generated by Qwen3 Next 80B A3B Instruct, attempt 3
Bird: penguin
Transport: sled

Qwen3.5 397B A17B

qwen/qwen3.5-397b-a17b Released by provider: February 16, 2026
Attempt 1
SVG generated by Qwen3.5 397B A17B, attempt 1
Bird: Unknown
Transport: airplane
Attempt 2
SVG generated by Qwen3.5 397B A17B, attempt 2
Bird: penguin
Transport: scooter
Attempt 3
SVG generated by Qwen3.5 397B A17B, attempt 3
Bird: penguin
Transport: skateboard

Qwen3.5-122B-A10B

qwen/qwen3.5-122b-a10b Released by provider: February 23, 2026
Attempt 1
SVG generated by Qwen3.5-122B-A10B, attempt 1
Bird: penguin
Transport: sled
Attempt 2
SVG generated by Qwen3.5-122B-A10B, attempt 2
Bird: seagull
Transport: bicycle
Attempt 3
SVG generated by Qwen3.5-122B-A10B, attempt 3
Bird: seagull
Transport: scooter

Qwen3.5-27B

qwen/qwen3.5-27b Released by provider: February 23, 2026
Attempt 1
SVG generated by Qwen3.5-27B, attempt 1
Bird: Unknown
Transport: airplane
Attempt 2
SVG generated by Qwen3.5-27B, attempt 2
Bird: Unknown
Transport: bicycle
Attempt 3
SVG generated by Qwen3.5-27B, attempt 3
Bird: pigeon
Transport: bicycle

Qwen3.5-35B-A3B

qwen/qwen3.5-35b-a3b Released by provider: February 23, 2026
Attempt 1
SVG generated by Qwen3.5-35B-A3B, attempt 1
Bird: Unknown
Transport: airplane
Attempt 2
SVG generated by Qwen3.5-35B-A3B, attempt 2
Bird: macaw
Transport: bicycle
Attempt 3
SVG generated by Qwen3.5-35B-A3B, attempt 3
Bird: hummingbird
Transport: hoverboard

Qwen3.5-9B

qwen/qwen3.5-9b Released by provider: June 1, 2026
Attempt 1
SVG generated by Qwen3.5-9B, attempt 1
Bird: Unknown
Transport: airplane
Attempt 2
SVG generated by Qwen3.5-9B, attempt 2
Bird: penguin
Transport: skateboard
Attempt 3
SVG generated by Qwen3.5-9B, attempt 3
Bird: albatross
Transport: airplane

Qwen3.5-Flash

qwen/qwen3.5-flash-02-23 Released by provider: February 23, 2026
Attempt 1
SVG generated by Qwen3.5-Flash, attempt 1
Bird: flamingo
Transport: roller skate
Attempt 2
SVG generated by Qwen3.5-Flash, attempt 2
Bird: Unknown
Transport: airplane
Attempt 3
SVG generated by Qwen3.5-Flash, attempt 3
Bird: blue jay
Transport: helicopter

Qwen3.6 27B

qwen/qwen3.6-27b Released by provider: April 29, 2026
Attempt 1
SVG generated by Qwen3.6 27B, attempt 1
Bird: penguin
Transport: bicycle
Attempt 2

No complete, valid SVG

Could not classify this result
Attempt 3
SVG generated by Qwen3.6 27B, attempt 3
Bird: penguin
Transport: unicycle

Qwen3.6 35B A3B

qwen/qwen3.6-35b-a3b Released by provider: April 29, 2026
Attempt 1
SVG generated by Qwen3.6 35B A3B, attempt 1
Bird: Unknown
Transport: car
Attempt 2
SVG generated by Qwen3.6 35B A3B, attempt 2
Bird: owl
Transport: airplane
Attempt 3
SVG generated by Qwen3.6 35B A3B, attempt 3
Bird: swan
Transport: airplane

Qwen3.6 Flash

qwen/qwen3.6-flash Released by provider: April 29, 2026
Attempt 1
SVG generated by Qwen3.6 Flash, attempt 1
Bird: pigeon
Transport: hot air balloon
Attempt 2
SVG generated by Qwen3.6 Flash, attempt 2
Bird: Unknown
Transport: airplane
Attempt 3
SVG generated by Qwen3.6 Flash, attempt 3
Bird: kingfisher
Transport: bicycle

Qwen3.6 Plus

qwen/qwen3.6-plus Released by provider: April 29, 2026
Attempt 1
SVG generated by Qwen3.6 Plus, attempt 1
Bird: flamingo
Transport: unicycle
Attempt 2
SVG generated by Qwen3.6 Plus, attempt 2
Bird: flamingo
Transport: unicycle
Attempt 3
SVG generated by Qwen3.6 Plus, attempt 3
Bird: toucan
Transport: airplane

Qwen3.7 Plus

qwen/qwen3.7-plus Released by provider: May 20, 2026
Attempt 1
SVG generated by Qwen3.7 Plus, attempt 1
Bird: ruby-throated hummingbird
Transport: helicopter
Attempt 2
SVG generated by Qwen3.7 Plus, attempt 2
Bird: flamingo
Transport: fire truck
Attempt 3
SVG generated by Qwen3.7 Plus, attempt 3
Bird: pelican
Transport: seaplane

Inspired by a pelican

This experiment is inspired by Simon Willison's pelican benchmark, which asks language models to generate an SVG of a pelican riding a bicycle.

Our variation leaves both subjects open to see what defaults emerge. A pelican and bicycle result may suggest familiarity with the published prompt, but it cannot establish what appeared in a model’s training data or whether a model developer optimized for the test.

Methodology

Every attempt was sent independently through the OpenRouter API to the same 100 models used for the original ModelBias.ai experiment. No conversation history was shared between attempts.

No temperature, reasoning level, provider routing, or other generation parameter was specified, so OpenRouter and the underlying providers used their applicable defaults.

Raw model output is preserved in the downloadable dataset. For this page, the first complete SVG document is extracted from each response and safety-filtered before being served as an isolated image. Responses without a complete, valid SVG are reported but not repaired.

Valid rendered SVGs are classified independently by openai/gpt-5.6-luna using strict structured output. The classifier returns only a bird species and transportation method, or null when either cannot be determined.

Tech Stack

This project was built with Codex using GPT-5.6 Sol.

Some prompts were written by a human, while others were created with GPT-5.6 Sol.

The backend is built in PHP using the Laravel framework. Prompts were run with the Laravel queue system.

Download the data

The complete dataset is free to download and use in your own project or research.

View and download the dataset on GitHub