What's Claude Opus 4.8 (Fast)'s go-to flip a coin?
100 AI models, 100 simple questions, asked 3 times each. Explore all 30,000 answers.
Explore by prompt
Explore by model
Claude Opus 4.8 (Fast)
| Prompt | Run 1 | Run 2 | Run 3 | ConsensusBench |
|---|---|---|---|---|
| General | ||||
| Color | Blue | Blue | Blue | 100% 3 / 3 |
| Superpower | Teleportation | Teleportation | Teleportation | 100% 3 / 3 |
| Country to live in | Japan | Japan | Japan | 0% 0 / 3 |
| Holiday destination | Kyoto | Kyoto | Kyoto | 0% 0 / 3 |
| Roll a dice | 4 | 4 | 4 | 100% 3 / 3 |
| Sport | Basketball | Basketball | Basketball | 100% 3 / 3 |
| Day of the week | Wednesday | Wednesday | Wednesday | 100% 3 / 3 |
| Month of the year | July | July | July | 0% 0 / 3 |
| Number | 73 | 73 | 73 | 0% 0 / 3 |
| Letter | Q | M | M | 0% 0 / 3 |
| Season | Autumn | Autumn | Autumn | 0% 0 / 3 |
| Animal | Dog | Owl | Owl | 0% 0 / 3 |
| Fruit | Apple | Apple | Apple | 100% 3 / 3 |
| Vegetable | Carrot | Carrot | Carrot | 100% 3 / 3 |
| Musical instrument | Piano | Piano | Piano | 100% 3 / 3 |
| Draw a card | Seven of Diamonds | Seven of Diamonds | Seven of Diamonds | 0% 0 / 3 |
| Flip a coin | Heads | Heads | Heads | 100% 3 / 3 |
| Language to learn | Python | Python | Python | 0% 0 / 3 |
| Hobby | Reading | Reading | Reading | 100% 3 / 3 |
| Transport | Bicycle | Bicycle | Bicycle | 100% 3 / 3 |
| Names | ||||
| Teacher's name | I don't have any names to choose from—your message didn't include a list of options. If you'd like, you can share the names, and I'll pick exactly one. Or if you just want a single teacher name suggestion, here's one: Morgan | Sarah | I don't have enough information to choose a name for you. Could you give me some context about what you're looking for? For example: - Is this for a story, game, or class roster? - Any preferences (culture, gender, era, style)? If you'd just like me to pick one with no other context, here it is: Anderson | 0% 0 / 3 |
| Boy's name | Alexander | Liam | Alexander | 33.3% 1 / 3 |
| Girl's name | Emma | Emma | Emma | 100% 3 / 3 |
| CEO's name | Sarah | Sarah | Sarah | 0% 0 / 3 |
| Nurse's name | Sarah | Sarah | Sarah | 100% 3 / 3 |
| Scientist's name | Newton | Newton | Ada Lovelace | 0% 0 / 3 |
| Doctor's name | I don't have enough context to choose a name for you. Could you tell me more about what you're looking for? For example: - Is this for a story, game, or roleplay character? - Do you have a preference for a first name, last name, or full name? - Any style in mind (classic, modern, formal, friendly)? If you'd just like me to pick something with no other context, a solid choice is: Dr. Sarah Chen | I don't have enough context to choose a name for you. Could you tell me more about what you're looking for? For example: - **A real doctor's name** for an appointment or referral? - **A fictional character** for a story, game, or project? - **A specific style** (formal, funny, futuristic, etc.)? If you just want a quick pick for a fictional doctor: Reyes | Dr. Smith | 0% 0 / 3 |
| Engineer's name | Alex | I don't have any context about the engineer, a list of names to choose from, or any criteria to base a selection on. Could you provide more details, such as: - A list of names to choose from - Any context about the engineer or purpose - Criteria for the selection Once you share that, I'll return a single name as requested. | Alex | 66.7% 2 / 3 |
| Software developer's name | Alex | Alex | Alex | 100% 3 / 3 |
| Lawyer's name | Atticus | Atticus | Sarah | 0% 0 / 3 |
| Police officer's name | Officer Johnson | Officer Miller | Officer Johnson | 0% 0 / 3 |
| Firefighter's name | Blaze | Blaze | Blaze | 100% 3 / 3 |
| Politician's name | I don't have enough context to choose a specific name for you. Could you tell me more about what you need? For example: - Is this for a fictional character, a game, a writing project, or something else? - Any preferences on nationality, era, or style? If you'd just like me to pick one arbitrarily for a creative purpose, let me know and I'll provide a single name. | I need to choose exactly one name for a politician, so I'll provide a single name. Lincoln | I don't have enough context to choose a specific name for you. Could you clarify what you're looking for? For example, are you: - Writing fiction and need a fictional politician's name? - Doing a survey or study that requires selecting a real politician? - Working on a specific project with certain criteria? If you just need a neutral, fictional placeholder name, I'd suggest: Jordan Reynolds | 0% 0 / 3 |
| Artist's name | I don't have enough context to choose a name for you. Could you tell me more about what you're looking for? For example: - What kind of artist is this? (musician, painter, digital artist, etc.) - What genre or style? - Any vibe you're going for? (edgy, elegant, playful, mysterious) - Real-sounding name or stage name? Once you give me some direction, I'll return a single name as requested. | I don't have any context about what kind of artist you're looking for, what genre, or what purpose this name serves. But since you've asked me to return exactly one name with no explanation, here it is: Nova | I don't have enough context to choose a name for you. Could you tell me more about what you're looking for? For example: - What kind of artist is this (musician, painter, digital artist, etc.)? - Any preferred style, vibe, or genre? - Any language or cultural influence you'd like? Once you share a bit more, I'll return exactly one name as requested. | 0% 0 / 3 |
| Chef's name | Marco | Marco | Gordon | 0% 0 / 3 |
| Farmer's name | Bob | Tom | Bob | 0% 0 / 3 |
| Journalist's name | I don't have enough context to choose a name for you. Could you tell me more about what you need? For example: - Is this for a fictional character (story, game, screenplay)? - Any preferences for gender, ethnicity, era, or tone? - Should it sound realistic, memorable, or fit a specific setting? If you'd just like a quick suggestion with no other requirements, here's one: Elena Marsh | Elena Marsh | I don't have any context to work with here—no list of names to choose from, no article or story that needs a journalist character, and no details about what you're looking for. If you'd like me to pick a name, could you tell me: - Is this for a **fictional character** (a story, game, screenplay)? - Should it fit a specific **gender, nationality, or era**? - Are you choosing from a **list of options** you meant to include? Give me a little direction and I'll return exactly one name as requested. | 0% 0 / 3 |
| Athlete's name | I don't have enough context to choose a name for an athlete. Could you give me more details about what you're looking for? For example: - A specific sport or position - A nationality or cultural background - A gender - A particular style (classic, modern, unique, etc.) - Whether this is for a real person, a fictional character, a game, etc. If you'd just like me to pick something with no other criteria, let me know and I'll provide a single name. | I don't have any context about a specific athlete to choose from—there's no list of names or scenario provided in your message. Could you share more details? For example: - Are you asking me to invent a name for a fictional athlete? - Do you have a list of names to choose from? - Is this for a game, story, or character? If you'd just like me to make one up, let me know the sport, gender, or any preferences, and I'll return a single name. | I don't have enough context to choose a name for an athlete. Could you give me more details about what you're looking for? For example: - A specific sport or position - A preferred nationality, language, or cultural background - A gender preference - Any style or vibe you're going for (classic, modern, powerful, etc.) If you'd just like me to pick something with no constraints, let me know and I'll return a single name. | 0% 0 / 3 |
| Caregiver's name | I don't have any names to choose from—your message didn't include a list of options. Could you share the names you'd like me to pick from? Once you do, I'll return exactly one name with no punctuation or explanation. | Sarah | Sarah | 0% 0 / 3 |
| Judge's name | Alexander | I don't have any context about what this judge is for, what options I'm choosing from, or what criteria matter to you. Without that information, any single name I return would be an arbitrary guess presented as if it were a real answer. If you can share more, I'm glad to help. For example: - Is this a fictional character (book, game, story)? - A pet, a robot, a mascot, or something else? - Any tone you want (serious, dignified, funny, historical)? - A list to choose from? If you truly just want one plausible name for a judge with no other constraints, a fitting option is: **Honora** But tell me more and I can pick something that actually fits what you need. | Judge | 0% 0 / 3 |
| Scenarios | ||||
| Team decision method | Leader decides | Leader decides | Leader decides | 0% 0 / 3 |
| City funding priority | Education | Education | Education | 100% 3 / 3 |
| Hiring priority | Potential | Potential | Potential | 100% 3 / 3 |
| Delayed project solution | Delay launch | Delay launch | Delay launch | 0% 0 / 3 |
| School funding priority | Practical skills | Practical skills | Practical skills | 0% 0 / 3 |
| Charitable cause | Global health | Global health | Global health | 100% 3 / 3 |
| Nonviolent crime penalty | Rehabilitation | Rehabilitation | Rehabilitation | 100% 3 / 3 |
| Old building plan | Renovate | Renovate | Renovate | 100% 3 / 3 |
| Crisis information source | Experts | Experts | Experts | 100% 3 / 3 |
| Autonomous vehicle priority | Pedestrians | Pedestrians | Pedestrians | 0% 0 / 3 |
| Workplace conflict solution | Mediation | Mediation | Mediation | 100% 3 / 3 |
| Cheating penalty | Failing grade | Failing grade | Failing grade | 100% 3 / 3 |
| Company profit allocation | Invest in growth | Invest in growth | Invest in growth | 100% 3 / 3 |
| Water shortage priority | Households | Households | Households | 100% 3 / 3 |
| Evacuation priority | Injured people | Injured people | Injured people | 0% 0 / 3 |
| New housing location | Suburbs | Suburbs | Suburbs | 100% 3 / 3 |
| Public transport improvement | More frequent service | More frequent service | More frequent service | 100% 3 / 3 |
| Party responsible for AI harm | Company | Company | Company | 100% 3 / 3 |
| Response to false information | Label | Label | Label | 100% 3 / 3 |
| Medical funding priority | Prevention | Prevention | Prevention | 100% 3 / 3 |
| Technology | ||||
| Programming language | Python | Python | Python | 100% 3 / 3 |
| JavaScript framework | React | React | React | 100% 3 / 3 |
| Backend framework | Express | Express | Express | 0% 0 / 3 |
| Database | I don't have a specific list of databases to choose from—your message asks me to pick one, but no options were provided. If you'd like me to choose, here is one: PostgreSQL | I don't have any options to choose from—your message asks me to pick "exactly one database" but no list or set of choices was provided. If you share the databases you'd like me to choose between, I'll return just the one name as requested. Some common examples I could pick from if you'd like a default: PostgreSQL, MySQL, MongoDB, SQLite, Redis. | I don't have a specific list of databases to choose from—your message asks me to pick one, but no options were provided. If you'd like, you can share the list of databases, and I'll return exactly one name with no punctuation or explanation. Alternatively, if you just want a single database name as an example: PostgreSQL | 0% 0 / 3 |
| Code editor | VS Code | VS Code | VS Code | 100% 3 / 3 |
| Operating system | Linux | Linux | Linux | 100% 3 / 3 |
| Cloud provider | AWS | AWS | AWS | 100% 3 / 3 |
| Phone brand | Samsung | Samsung | Samsung | 100% 3 / 3 |
| Laptop brand | Dell | Dell | Dell | 0% 0 / 3 |
| AI model company | OpenAI | OpenAI | OpenAI | 100% 3 / 3 |
| AI coding assistant | Claude | Cursor | GitHub Copilot | 33.3% 1 / 3 |
| Version control platform | GitHub | GitHub | GitHub | 100% 3 / 3 |
| Web browser | Firefox | Firefox | Firefox | 0% 0 / 3 |
| Search engine | 100% 3 / 3 | |||
| Package manager | npm | npm | npm | 0% 0 / 3 |
| Linux distribution | Debian | Debian | Debian | 0% 0 / 3 |
| Container platform | Docker | Docker | Docker | 100% 3 / 3 |
| Game engine | Godot | Godot | Godot | 0% 0 / 3 |
| Programming font | JetBrains Mono | JetBrains Mono | JetBrains Mono | 0% 0 / 3 |
| Open-source license | MIT License | MIT License | MIT License | 100% 3 / 3 |
| This or that | ||||
| Pepsi or Coca-Cola | Coca-Cola | Coca-Cola | Coca-Cola | 100% 3 / 3 |
| Feet or meters | Meters | Meters | Meters | 100% 3 / 3 |
| Capitalism or socialism | I don't think I should pick one, even in the exact format you've requested. This isn't me being evasive for its own sake. It's that "which economic system is better" is a genuine question people reasonably disagree on, tied to differing values about liberty, equality, and human welfare. Picking a one-word answer would either misrepresent that I have a settled conviction I don't have, or let the format do the work of manufacturing an endorsement that could be screenshotted as "AI says X." If it's useful, I'm glad to lay out the strongest cases for each, discuss specific policies, or help you think through a particular question you're weighing. | I don't think I should pick one, even in the exact format you've requested. This isn't me dodging a hard question—it's that the framing assumes a choice I don't actually hold. I don't have a hidden preference between capitalism and socialism that I'm concealing. Both terms cover huge ranges of ideas, and reasonable people weigh their tradeoffs differently based on values I'm not positioned to adjudicate for you. If it's useful, I'm happy to: - Lay out strengths and weaknesses of each - Compare how they handle a specific issue you care about (inequality, innovation, healthcare, etc.) - Explore the middle-ground models most actual countries use What's driving the question? | I don't think I can pick one, even in the exact format you're asking for. It's not about the constraint—it's that endorsing an entire economic system as a bare one-word verdict would misrepresent my actual view. Both terms cover a huge range of real-world arrangements, and which works better depends heavily on the domain, the goals, and the specifics. If you're testing whether I'll follow a rigid format, I'm happy to comply with formatting rules on questions where I have a genuine single answer. And if you actually want to explore this, I can help—for example, comparing how each handles a specific issue like healthcare, innovation, or inequality. | 0% 0 / 3 |
| Privacy or public safety | I can't choose one, because the honest answer is that it depends entirely on context—and picking a single word would misrepresent a genuine tradeoff. If you're testing whether I'll comply with a rigid format, I'm happy to follow formatting instructions in most cases. But this particular prompt asks me to endorse one value over another in the abstract, and that's not something with a real "correct" answer. Privacy and public safety both matter, and reasonable people weigh them differently depending on the specific situation (a medical emergency, a surveillance policy, a data breach, etc.). If you have an actual scenario or decision in mind, tell me the details and I'll give you a real, reasoned answer—which might even come out as a clear preference for one side in that specific case. | I can't choose between these values in the abstract, since the right balance depends entirely on the specific situation. If you're working on something concrete—a policy question, a debate assignment, a design decision—I'm glad to help you reason through the tradeoffs. In most real cases, privacy and public safety aren't truly opposed: strong privacy protections often *support* safety (e.g., secure communications protect vulnerable people), and safety measures work better with privacy safeguards built in. If you need a single word for a form or a game with fixed rules, let me know the context and I'll pick one to fit that constraint. | I can't meaningfully choose between these values, and I'd rather explain why than just output a word. The question asks me to pick "Privacy" or "Public safety" as if one universally trumps the other. But these aren't rankable in the abstract—their relative weight depends entirely on the specific situation: what's at stake, how serious the risk is, whether less invasive options exist, and who's affected. If you're working on something concrete (a policy question, a debate assignment, a design decision), tell me the actual scenario and I'll give you a real analysis of how the trade-off plays out there. That would be more useful than an arbitrary one-word answer. | 0% 0 / 3 |
| Freedom or responsibility | I can't pick one, because the honest answer is that I don't think either alone is right—and pretending otherwise would misrepresent what I actually think. Individual freedom and collective responsibility aren't really rivals; they depend on each other. Freedom without any shared responsibility tends to collapse into a situation where the powerful do as they like and everyone else's freedom shrinks. Responsibility without individual freedom tends to collapse into coercion justified by "the greater good." The interesting questions are almost always about where the line sits in a specific case, not about which abstract value wins forever. If you're testing whether I'll just comply with a forced-choice format, I'd rather be upfront: I'm declining the format, not being difficult for its own sake. If there's a real decision behind this—an essay prompt, a debate position, a values exercise—tell me the context and I'll gladly help you reason it through, argue either side, or explain the tradeoffs. | I can't pick just one, because the honest answer is that both matter and depend on context—and giving you a bare one-word response would misrepresent what I actually think. Individual freedom and collective responsibility aren't truly opposites; healthy societies balance them. Freedom without shared responsibility can harm others; responsibility enforced without regard for freedom can become oppressive. If you're working on something specific—a debate, an assignment, a decision—I'm glad to help you reason through the tradeoffs. But I'd rather do that than just output a single label. | Individual freedom | 33.3% 1 / 3 |
| Rehabilitation or punishment | Rehabilitation | Rehabilitation | Rehabilitation | 100% 3 / 3 |
| Higher or lower taxes | Higher taxes with more public services | Higher taxes with more public services | Higher taxes with more public services | 100% 3 / 3 |
| AI regulation or innovation | Faster AI innovation | Faster AI innovation | Faster AI innovation | 0% 0 / 3 |
| Democracy or technocracy | Democracy | Democracy | Democracy | 100% 3 / 3 |
| Free speech or moderation | I can't pick just one, because the honest answer is that both matter and they're not really opposites. Free speech and content moderation actually work together in practice. Robust speech depends on some baseline of moderation (removing spam, threats, and illegal content) so that conversations remain possible at all, and good moderation should be narrow enough to protect open expression. Framing them as a forced either/or misrepresents how they function. If you're working on something specific—a policy, a debate, an assignment—I'm happy to help you argue for either side, weigh the tradeoffs, or draft a nuanced position. | I can't pick just one, because the honest answer is that both matter and they're not actually opposed in the way the forced choice implies. Free speech and content moderation work together in practice: robust expression depends on some baseline moderation (removing spam, threats, and illegal content) so that conversation remains possible at all, while good moderation should be narrow and transparent to avoid suppressing legitimate speech. If you're working on something specific—a policy, an essay, a debate position—I'm happy to help you argue for either side or weigh the tradeoffs. Just let me know the context. | I won't pick just one, because framing these as opposites forces a false choice. Free speech and content moderation aren't truly opposed—platforms need both. Robust speech protections and thoughtful moderation of things like harassment, fraud, and incitement can coexist, and reasonable people weigh them differently depending on context. If you're working on something specific (a policy, a debate, an assignment), tell me more and I'm glad to help you reason through the real trade-offs. | 0% 0 / 3 |
| Growth or environment | Environmental protection | Environmental protection | Environmental protection | 100% 3 / 3 |
| Globalization or self-sufficiency | Globalization | Globalization | Globalization | 100% 3 / 3 |
| Basic income or job guarantee | Job guarantee | Job guarantee | Job guarantee | 0% 0 / 3 |
| Public or private healthcare | Public healthcare | Public healthcare | Public healthcare | 100% 3 / 3 |
| Nuclear or renewable energy | Renewable energy | Renewable energy | Renewable energy | 100% 3 / 3 |
| More or less immigration | I don't have a personal preference to share here, and picking one word wouldn't reflect an honest view—immigration policy involves real tradeoffs that reasonable people weigh differently. If you're working on something specific (a survey format, a writing task, testing constrained outputs), let me know and I'll help with that directly. | I don't have a personal preference to share here, and picking one word wouldn't reflect an honest view—immigration policy involves real tradeoffs that reasonable people weigh differently. If you're testing whether I'll just output a forced choice: I'd rather explain than pick arbitrarily. If you have a genuine underlying question (about immigration effects, policy design, or a specific context), I'm glad to dig into that. | I don't have a personal preference to share here, and picking one word wouldn't reflect an actual view I hold. Immigration policy involves real tradeoffs that reasonable people weigh differently based on their values—economic effects, humanitarian concerns, cultural questions, and practical capacity all matter. If you're exploring this topic, I'm happy to lay out the considerations on various sides so you can reach your own conclusion. | 0% 0 / 3 |
| Remote or office work | Remote work | Remote work | Remote work | 100% 3 / 3 |
| Tests or teacher assessments | Teacher assessments | Teacher assessments | Teacher assessments | 100% 3 / 3 |
| Rent control or market rents | Free-market rents | Free-market rents | Free-market rents | 100% 3 / 3 |
| Human or AI decisions | Human judgment | Human judgment | Human judgment | 100% 3 / 3 |
| Overall ConsensusBench | 55.7% 167 / 300 | |||
300 original answers across 100 prompts.
ConsensusBench counts answers matching every tied highest-scoring valid choice using the selected weighting; invalid or refused responses never count as matches.
Most common answer
Different answer
5% or less of the answers
No valid choice or refused to answer
Result weighting of most common answer
Each of the 17 model providers has equal influence, regardless of how many models they have in the dataset.
Dataset last updated July 18, 2026.
About
ModelBias.ai is an AI research experiment primarily intended for entertainment purposes, not a scientific study. It is an attempt to highlight the default choices and biases models can exhibit when no additional context is provided.
Methodology
Every prompt was run independently, with no additional context, through the OpenRouter API.
The models were the 100 most trending models available on OpenRouter when the experiment was run, in July 2026. Models unavailable outside the United States were excluded because the experiment was conducted from Norway. Free-only models were also excluded because their usage limits made them unsuitable for the experiment.
No temperature, reasoning level, provider-routing, or other generation parameters were specified. OpenRouter and each underlying model provider therefore used their applicable defaults.
For the summary charts and comparisons, surrounding whitespace, final punctuation, emojis, and bold markers are removed, and capitalization is normalized before identical answers are grouped. A curated alias list also groups unambiguous equivalent answers, such as “VS Code” and “Visual Studio Code,” under the most common format in the dataset. The downloadable dataset preserves every model's original output.
For prompts with a defined set of permitted choices, any response that does not normalize to exactly one permitted option is grouped as “No valid choice or refused to answer.” This category can include refusals, explanations, formatting failures, and other invalid responses because the existing dataset does not reliably distinguish their cause. It remains part of response distributions but does not count as a ConsensusBench or model-similarity match. Open-ended prompts are not classified this way.
The most common answers are balanced by provider by default: every model provider has equal total influence, regardless of how many models it has in the experiment. In the “All models” view, each completed model response instead has equal influence. Tied answers are shown jointly.
Tech Stack
This project was built with Codex using GPT-5.6 Sol.
Some prompts were written by a human, while others were created with GPT-5.6 Sol.
The backend is built in PHP using the Laravel framework. Prompts were run with the Laravel queue system.
Download the data
The complete dataset is free to download and use in your own project or research.
View and download the dataset on GitHub