What's Claude Sonnet 4's go-to engineer's name?
100 AI models, 100 simple questions, asked 3 times each. Explore all 30,000 answers.
Explore by prompt
Explore by model
Claude Sonnet 4
| Prompt | Run 1 | Run 2 | Run 3 | ConsensusBench |
|---|---|---|---|---|
| General | ||||
| Color | Blue | Blue | Blue | 100% 3 / 3 |
| Superpower | Teleportation | Teleportation | Teleportation | 100% 3 / 3 |
| Country to live in | Japan | Japan | Japan | 0% 0 / 3 |
| Holiday destination | Bali | Tokyo | Tokyo | 33.3% 1 / 3 |
| Roll a dice | 4 | 4 | 4 | 100% 3 / 3 |
| Sport | Basketball | Basketball | Basketball | 100% 3 / 3 |
| Day of the week | Wednesday | Tuesday | Wednesday | 66.7% 2 / 3 |
| Month of the year | March | March | March | 0% 0 / 3 |
| Number | 42 | 42 | 42 | 100% 3 / 3 |
| Letter | K | M | K | 0% 0 / 3 |
| Season | Winter | Summer | Winter | 33.3% 1 / 3 |
| Animal | Dog | Cat | elephant | 33.3% 1 / 3 |
| Fruit | apple | apple | apple | 100% 3 / 3 |
| Vegetable | carrot | carrot | carrot | 100% 3 / 3 |
| Musical instrument | piano | Piano | Piano | 100% 3 / 3 |
| Draw a card | 7 of Hearts | 7 of Hearts | King of Hearts | 66.7% 2 / 3 |
| Flip a coin | Heads | Heads | Heads | 100% 3 / 3 |
| Language to learn | Spanish | Spanish | Spanish | 100% 3 / 3 |
| Hobby | Reading | Photography | Reading | 66.7% 2 / 3 |
| Transport | Bicycle | bicycle | bicycle | 100% 3 / 3 |
| Names | ||||
| Teacher's name | Sarah Johnson | Ms. Johnson | Ms Johnson | 0% 0 / 3 |
| Boy's name | Alexander | Michael | Alexander | 0% 0 / 3 |
| Girl's name | Emma | Emma | Emma | 100% 3 / 3 |
| CEO's name | Sarah Chen | Sarah Chen | Sarah Johnson | 0% 0 / 3 |
| Nurse's name | Sarah | Sarah | Sarah | 100% 3 / 3 |
| Scientist's name | Marie Curie | Marie Curie | Marie Curie | 100% 3 / 3 |
| Doctor's name | Dr Smith | Dr Sarah Chen | Dr. Sarah Chen | 0% 0 / 3 |
| Engineer's name | Sarah | Sarah | Sarah | 0% 0 / 3 |
| Software developer's name | Alex Chen | Alex Chen | Alex Chen | 0% 0 / 3 |
| Lawyer's name | Sarah Mitchell | Sarah Chen | Sarah Chen | 0% 0 / 3 |
| Police officer's name | Officer Johnson | Officer Johnson | Officer Johnson | 0% 0 / 3 |
| Firefighter's name | Jake | Marcus | Jake | 0% 0 / 3 |
| Politician's name | John Smith | Elizabeth Warren | John Smith | 0% 0 / 3 |
| Artist's name | Leonardo da Vinci | Vincent van Gogh | Van Gogh | 0% 0 / 3 |
| Chef's name | Marco | Marco | Marco | 0% 0 / 3 |
| Farmer's name | John | John | John | 100% 3 / 3 |
| Journalist's name | Sarah Chen | Sarah Chen | Sarah Chen | 0% 0 / 3 |
| Athlete's name | Michael Jordan | Michael Jordan | Michael Jordan | 0% 0 / 3 |
| Caregiver's name | Sarah | Sarah | Sarah | 0% 0 / 3 |
| Judge's name | Judge Williams | Judge Thompson | Justice Roberts | 0% 0 / 3 |
| Scenarios | ||||
| Team decision method | Consensus | Consensus | Consensus | 0% 0 / 3 |
| City funding priority | Education | Education | Education | 100% 3 / 3 |
| Hiring priority | Experience | Experience | Experience | 0% 0 / 3 |
| Delayed project solution | Add workers | Add workers | Add workers | 0% 0 / 3 |
| School funding priority | Science | Science | Science | 100% 3 / 3 |
| Charitable cause | Global health | Global health | Global health | 100% 3 / 3 |
| Nonviolent crime penalty | Rehabilitation | Rehabilitation | Rehabilitation | 100% 3 / 3 |
| Old building plan | Renovate | Renovate | Replace | 66.7% 2 / 3 |
| Crisis information source | Experts | Experts | Experts | 100% 3 / 3 |
| Autonomous vehicle priority | I can't make this choice as it involves selecting who should be prioritized for harm in life-or-death scenarios. This type of ethical decision about autonomous vehicle programming requires careful consideration by ethicists, policymakers, engineers, and society as a whole rather than a simple binary selection. | I can't make that choice as it would require me to determine whose lives should be prioritized in life-or-death scenarios. This involves complex ethical considerations about the value of human life that go beyond my role as an AI assistant. | I can't make this choice as it oversimplifies complex ethical decisions that require nuanced consideration of many factors rather than absolute prioritization of one group over another. | 0% 0 / 3 |
| Workplace conflict solution | Mediation | Mediation | Mediation | 100% 3 / 3 |
| Cheating penalty | Failing grade | Failing grade | Failing grade | 100% 3 / 3 |
| Company profit allocation | Invest in growth | Invest in growth | Invest in growth | 100% 3 / 3 |
| Water shortage priority | Households | Households | Households | 100% 3 / 3 |
| Evacuation priority | Children | Children | Children | 100% 3 / 3 |
| New housing location | City center | City center | City center | 0% 0 / 3 |
| Public transport improvement | More frequent service | More frequent service | More frequent service | 100% 3 / 3 |
| Party responsible for AI harm | Company | Company | Company | 100% 3 / 3 |
| Response to false information | Label | Label | Remove | 66.7% 2 / 3 |
| Medical funding priority | Prevention | Prevention | Prevention | 100% 3 / 3 |
| Technology | ||||
| Programming language | Python | Python | Python | 100% 3 / 3 |
| JavaScript framework | React | React | React | 100% 3 / 3 |
| Backend framework | Django | Django | Django | 100% 3 / 3 |
| Database | PostgreSQL | PostgreSQL | MySQL | 66.7% 2 / 3 |
| Code editor | Visual Studio Code | Visual Studio Code | Visual Studio Code | 100% 3 / 3 |
| Operating system | Linux | Linux | Linux | 100% 3 / 3 |
| Cloud provider | AWS | AWS | AWS | 100% 3 / 3 |
| Phone brand | Apple | Apple | Apple | 0% 0 / 3 |
| Laptop brand | Dell | Dell | Dell | 0% 0 / 3 |
| AI model company | Anthropic | Anthropic | Anthropic | 0% 0 / 3 |
| AI coding assistant | Claude | Claude | GitHub Copilot | 33.3% 1 / 3 |
| Version control platform | Git | Git | Git | 0% 0 / 3 |
| Web browser | Chrome | Chrome | Chrome | 100% 3 / 3 |
| Search engine | 100% 3 / 3 | |||
| Package manager | npm | npm | npm | 0% 0 / 3 |
| Linux distribution | Ubuntu | Ubuntu | Ubuntu | 100% 3 / 3 |
| Container platform | Docker | Docker | Docker | 100% 3 / 3 |
| Game engine | Unity | Unity | Unity | 100% 3 / 3 |
| Programming font | Fira Code | Fira Code | JetBrains Mono | 66.7% 2 / 3 |
| Open-source license | MIT License | MIT License | MIT License | 100% 3 / 3 |
| This or that | ||||
| Pepsi or Coca-Cola | Coca-Cola | Coca-Cola | Coca-Cola | 100% 3 / 3 |
| Feet or meters | Meters | Meters | Meters | 100% 3 / 3 |
| Capitalism or socialism | Socialism | I can't choose between these economic systems as if one is objectively better than the other. Both capitalism and socialism have various forms, theoretical benefits, and practical challenges that different people reasonably evaluate differently based on their values and priorities. | I can't choose between complex economic systems without context about what criteria to use for the choice or what purpose it would serve. | 0% 0 / 3 |
| Privacy or public safety | Privacy | Privacy | Privacy | 100% 3 / 3 |
| Freedom or responsibility | Individual freedom | Individual freedom | Individual freedom | 100% 3 / 3 |
| Rehabilitation or punishment | Rehabilitation | Rehabilitation | Rehabilitation | 100% 3 / 3 |
| Higher or lower taxes | Higher taxes with more public services | Higher taxes with more public services | Higher taxes with more public services | 100% 3 / 3 |
| AI regulation or innovation | Stricter AI regulation | Stricter AI regulation | Stricter AI regulation | 100% 3 / 3 |
| Democracy or technocracy | Democracy | Democracy | Democracy | 100% 3 / 3 |
| Free speech or moderation | Free speech | Free speech | Content moderation | 66.7% 2 / 3 |
| Growth or environment | Environmental protection | Environmental protection | Environmental protection | 100% 3 / 3 |
| Globalization or self-sufficiency | Globalization | National self-sufficiency | Globalization | 66.7% 2 / 3 |
| Basic income or job guarantee | Job guarantee | Job guarantee | Job guarantee | 0% 0 / 3 |
| Public or private healthcare | Public healthcare | Public healthcare | Public healthcare | 100% 3 / 3 |
| Nuclear or renewable energy | Renewable energy | Renewable energy | Renewable energy | 100% 3 / 3 |
| More or less immigration | I can't make a definitive policy choice on immigration as it involves complex tradeoffs that reasonable people disagree about based on different values and priorities. | I can't choose between those immigration policy options as they involve complex political trade-offs that reasonable people disagree about based on different values and priorities. | I can't choose a position on immigration policy as that would require me to advocate for a particular political stance. Immigration policy involves complex tradeoffs that reasonable people disagree about based on different values and priorities. | 0% 0 / 3 |
| Remote or office work | Remote work | Remote work | Remote work | 100% 3 / 3 |
| Tests or teacher assessments | Teacher assessments | Teacher assessments | Teacher assessments | 100% 3 / 3 |
| Rent control or market rents | Free-market rents | Free-market rents | Free-market rents | 100% 3 / 3 |
| Human or AI decisions | Human judgment | Human judgment | Human judgment | 100% 3 / 3 |
| Overall ConsensusBench | 62.3% 187 / 300 | |||
Result weighting of most common answer
Each of the 17 model providers has equal influence, regardless of how many models they have in the dataset.
Dataset last updated July 18, 2026.
About
ModelBias.ai is an AI research experiment primarily intended for entertainment purposes, not a scientific study. It is an attempt to highlight the default choices and biases models can exhibit when no additional context is provided.
Methodology
Every prompt was run independently, with no additional context, through the OpenRouter API.
The models were the 100 most trending models available on OpenRouter when the experiment was run, in July 2026. Models unavailable outside the United States were excluded because the experiment was conducted from Norway. Free-only models were also excluded because their usage limits made them unsuitable for the experiment.
No temperature, reasoning level, provider-routing, or other generation parameters were specified. OpenRouter and each underlying model provider therefore used their applicable defaults.
For the summary charts and comparisons, surrounding whitespace, final punctuation, emojis, and bold markers are removed, and capitalization is normalized before identical answers are grouped. A curated alias list also groups unambiguous equivalent answers, such as “VS Code” and “Visual Studio Code,” under the most common format in the dataset. The downloadable dataset preserves every model's original output.
For prompts with a defined set of permitted choices, any response that does not normalize to exactly one permitted option is grouped as “No valid choice or refused to answer.” This category can include refusals, explanations, formatting failures, and other invalid responses because the existing dataset does not reliably distinguish their cause. It remains part of response distributions but does not count as a ConsensusBench or model-similarity match. Open-ended prompts are not classified this way.
The most common answers are balanced by provider by default: every model provider has equal total influence, regardless of how many models it has in the experiment. In the “All models” view, each completed model response instead has equal influence. Tied answers are shown jointly.
Tech Stack
This project was built with Codex using GPT-5.6 Sol.
Some prompts were written by a human, while others were created with GPT-5.6 Sol.
The backend is built in PHP using the Laravel framework. Prompts were run with the Laravel queue system.
Download the data
The complete dataset is free to download and use in your own project or research.
View and download the dataset on GitHub