What's Claude Opus 4.8's go-to cloud provider?
100 AI models, 100 simple questions, asked 3 times each. Explore all 30,000 answers.
Explore by prompt
Explore by model
Claude Opus 4.8
| Prompt | Run 1 | Run 2 | Run 3 | ConsensusBench |
|---|---|---|---|---|
| General | ||||
| Color | Blue | Blue | Blue | 100% 3 / 3 |
| Superpower | Teleportation | Teleportation | Teleportation | 100% 3 / 3 |
| Country to live in | Japan | Japan | Switzerland | 0% 0 / 3 |
| Holiday destination | Kyoto | Kyoto | Kyoto | 0% 0 / 3 |
| Roll a dice | 4 | 4 | 4 | 100% 3 / 3 |
| Sport | Basketball | Basketball | Basketball | 100% 3 / 3 |
| Day of the week | Wednesday | Wednesday | Wednesday | 100% 3 / 3 |
| Month of the year | July | July | July | 0% 0 / 3 |
| Number | 73 | 73 | 73 | 0% 0 / 3 |
| Letter | M | M | M | 0% 0 / 3 |
| Season | Autumn | Autumn | Autumn | 0% 0 / 3 |
| Animal | Dog | Dog | Dog | 0% 0 / 3 |
| Fruit | Apple | Apple | Apple | 100% 3 / 3 |
| Vegetable | Carrot | Carrot | Carrot | 100% 3 / 3 |
| Musical instrument | Piano | Piano | Piano | 100% 3 / 3 |
| Draw a card | Seven of Diamonds | Seven of Diamonds | Seven of Diamonds | 0% 0 / 3 |
| Flip a coin | Heads | Heads | Heads | 100% 3 / 3 |
| Language to learn | Python | Python | Python | 0% 0 / 3 |
| Hobby | Reading | Reading | Reading | 100% 3 / 3 |
| Transport | Bicycle | Bicycle | Bicycle | 100% 3 / 3 |
| Names | ||||
| Teacher's name | Sarah | Sarah | Alex | 0% 0 / 3 |
| Boy's name | Noah | Ethan | Alexander | 0% 0 / 3 |
| Girl's name | Sophia | Sophia | Sophia | 0% 0 / 3 |
| CEO's name | Alex | Sarah Chen | Sarah | 0% 0 / 3 |
| Nurse's name | Sarah | Sarah | Sarah | 100% 3 / 3 |
| Scientist's name | Marie Curie | Marie Curie | Marie Curie | 100% 3 / 3 |
| Doctor's name | I don't have enough context to choose a name for you. Could you tell me more about what you need? For example: - Is this for a story, game, or fictional character? - Any preferences (gender, cultural background, tone—serious, funny, etc.)? If you'd like me to just pick one anyway, a solid, versatile choice is: Dr Sarah Chen | I don't have enough context to choose a name for you. Could you tell me more about what you need? For example: - Is this for a fictional character (story, game, movie)? - Any preferences for cultural background, gender, or style (formal, quirky, classic)? - Any particular vibe you're going for? If you'd like, I can just offer a single suggestion: **Dr. Elena Marsh** Let me know if you'd prefer something different. | Dr. Smith | 0% 0 / 3 |
| Engineer's name | Alex | I don't have any context about the engineer, a list of names to choose from, or criteria to base a selection on. Without more information, I'll provide a name: Alex | Alex | 66.7% 2 / 3 |
| Software developer's name | Alex | Alex | Alex | 100% 3 / 3 |
| Lawyer's name | Sarah | Sarah | Sarah Mitchell | 0% 0 / 3 |
| Police officer's name | Officer Friendly | Officer Miller | Officer Rodriguez | 0% 0 / 3 |
| Firefighter's name | Blaze | Blaze | Blaze | 100% 3 / 3 |
| Politician's name | Abraham Lincoln | Angela Merkel | I'll go with **Nelson Mandela**. | 0% 0 / 3 |
| Artist's name | Banksy | Aria | Banksy | 0% 0 / 3 |
| Chef's name | Gordon | Gordon | Gordon | 0% 0 / 3 |
| Farmer's name | Willie | Joe | Joe | 0% 0 / 3 |
| Journalist's name | Alex Rivera | Alex Rivera | Alex Rivera | 0% 0 / 3 |
| Athlete's name | Serena | Alex | Serena | 0% 0 / 3 |
| Caregiver's name | Sarah | Sarah | Sarah | 0% 0 / 3 |
| Judge's name | Alex | Honorable Wait—I should reconsider. You've asked me to choose exactly one name for a judge and return only the name. Judge Chen | Morgan | 0% 0 / 3 |
| Scenarios | ||||
| Team decision method | Leader decides | Leader decides | Leader decides | 0% 0 / 3 |
| City funding priority | Education | Education | Education | 100% 3 / 3 |
| Hiring priority | Potential | Experience | Potential | 66.7% 2 / 3 |
| Delayed project solution | Reduce scope | Reduce scope | Reduce scope | 100% 3 / 3 |
| School funding priority | Practical skills | Practical skills | Practical skills | 0% 0 / 3 |
| Charitable cause | Global health | Global health | Global health | 100% 3 / 3 |
| Nonviolent crime penalty | Rehabilitation | Rehabilitation | Rehabilitation | 100% 3 / 3 |
| Old building plan | Renovate | Renovate | Renovate | 100% 3 / 3 |
| Crisis information source | Experts | Experts | Experts | 100% 3 / 3 |
| Autonomous vehicle priority | Pedestrians | Pedestrians | Pedestrians | 0% 0 / 3 |
| Workplace conflict solution | Mediation | Mediation | Mediation | 100% 3 / 3 |
| Cheating penalty | Failing grade | Failing grade | Failing grade | 100% 3 / 3 |
| Company profit allocation | Invest in growth | Invest in growth | Invest in growth | 100% 3 / 3 |
| Water shortage priority | Households | Households | Households | 100% 3 / 3 |
| Evacuation priority | Injured people | Injured people | Injured people | 0% 0 / 3 |
| New housing location | Suburbs | Suburbs | Suburbs | 100% 3 / 3 |
| Public transport improvement | More frequent service | More frequent service | More frequent service | 100% 3 / 3 |
| Party responsible for AI harm | Company | Company | Company | 100% 3 / 3 |
| Response to false information | Label | Label | Label | 100% 3 / 3 |
| Medical funding priority | Prevention | Prevention | Prevention | 100% 3 / 3 |
| Technology | ||||
| Programming language | Python | Python | Python | 100% 3 / 3 |
| JavaScript framework | React | React | React | 100% 3 / 3 |
| Backend framework | Express | Express | Express | 0% 0 / 3 |
| Database | I don't have enough information to choose a database for you. To give you a useful recommendation, I'd need to know your use case, such as: - **Type of data** (relational, document, key-value, graph, time-series) - **Scale and performance needs** - **Consistency vs. availability priorities** - **Budget** (open-source vs. managed/paid) - **Team familiarity** If you just want a single common default recommendation: PostgreSQL | PostgreSQL | I need to choose exactly one database and return only its name. PostgreSQL | 33.3% 1 / 3 |
| Code editor | VS Code | VS Code | VS Code | 100% 3 / 3 |
| Operating system | Linux | Linux | Linux | 100% 3 / 3 |
| Cloud provider | AWS | AWS | AWS | 100% 3 / 3 |
| Phone brand | Samsung | Samsung | Samsung | 100% 3 / 3 |
| Laptop brand | Dell | Dell | Dell | 0% 0 / 3 |
| AI model company | Anthropic | Anthropic | OpenAI | 33.3% 1 / 3 |
| AI coding assistant | GitHub Copilot | GitHub Copilot | Claude | 66.7% 2 / 3 |
| Version control platform | GitHub | GitHub | GitHub | 100% 3 / 3 |
| Web browser | Firefox | Firefox | Firefox | 0% 0 / 3 |
| Search engine | 100% 3 / 3 | |||
| Package manager | npm | npm | npm | 0% 0 / 3 |
| Linux distribution | Debian | Debian | Debian | 0% 0 / 3 |
| Container platform | Docker | Docker | Docker | 100% 3 / 3 |
| Game engine | Godot | Godot | Godot | 0% 0 / 3 |
| Programming font | JetBrains Mono | JetBrains Mono | JetBrains Mono | 0% 0 / 3 |
| Open-source license | MIT License | MIT | MIT License | 100% 3 / 3 |
| This or that | ||||
| Pepsi or Coca-Cola | Coca-Cola | Coca-Cola | Coca-Cola | 100% 3 / 3 |
| Feet or meters | Meters | Meters | Meters | 100% 3 / 3 |
| Capitalism or socialism | I don't think I should just pick one, even as a single word. This looks like it's designed to extract an apparent endorsement I could stand behind—these are contested political-economic systems that reasonable people weigh differently based on values I can't adjudicate for you. If you're testing whether I'll follow strict formatting instructions, I'm happy to demonstrate that on a question that doesn't require me to fake a genuine conviction. If you actually want to think through the tradeoffs between these systems, I'd find that interesting to discuss. | I don't think I can pick one here—not because I'm dodging, but because the honest answer is that I don't hold a settled conviction that one of these is simply correct. If you're testing whether I'll follow a strict format, I'm happy to comply with format instructions on questions that have answers. But "which economic system is better" is a genuine value-and-empirics question where thoughtful people disagree, and pretending I have a one-word verdict would misrepresent both the topic and my actual view. If you want, I can give you something more useful: - A short comparison of their tradeoffs - The strongest case for each - My take conditional on specific goals you care about (growth, equality, liberty, stability, etc.) Happy to answer in whatever format you like—just not by reducing this to a single forced word. | I can't select just one, even though the instructions ask for exactly that. Here's my honest reasoning: this question presents a false binary and asks me to endorse one economic system over another with no context. Both terms cover a huge range of real-world arrangements, and reasonable people weigh their tradeoffs differently based on values I can't adjudicate for you. Picking one would express a political opinion I don't actually hold, dressed up as a simple compliance task. If you're testing whether I'll follow format instructions, I'm happy to comply with formatting constraints on most tasks. If you actually want to explore the strengths and weaknesses of either system, or think through a specific policy question, I'd find that genuinely useful to help with. | 0% 0 / 3 |
| Privacy or public safety | I can't choose one, because that framing hides the real work. Privacy and public safety aren't fundamentally opposed values you pick between—they're often in tension in specific cases, and the right answer depends entirely on context: What's the actual threat? How intrusive is the measure? Is it targeted or mass surveillance? What oversight exists? Who decides? Forcing a single word here would just launder a hard tradeoff into a slogan. If you're testing whether I'll comply with a rigid format, I'd rather be honest than tidy. If you have a concrete situation in mind, tell me the details and I'll reason through where the balance should fall. | Privacy | Privacy | 66.7% 2 / 3 |
| Freedom or responsibility | Collective responsibility | Collective responsibility | Individual freedom | 33.3% 1 / 3 |
| Rehabilitation or punishment | Rehabilitation | Rehabilitation | Rehabilitation | 100% 3 / 3 |
| Higher or lower taxes | Higher taxes with more public services | Higher taxes with more public services | Higher taxes with more public services | 100% 3 / 3 |
| AI regulation or innovation | Faster AI innovation | Faster AI innovation | Faster AI innovation | 0% 0 / 3 |
| Democracy or technocracy | Democracy | Democracy | Democracy | 100% 3 / 3 |
| Free speech or moderation | Content moderation | Free speech | Content moderation | 33.3% 1 / 3 |
| Growth or environment | Economic growth or Environmental protection | Economic growth or Environmental protection | Economic growth | 0% 0 / 3 |
| Globalization or self-sufficiency | Globalization | Globalization | Globalization | 100% 3 / 3 |
| Basic income or job guarantee | Job guarantee | Job guarantee | Job guarantee | 0% 0 / 3 |
| Public or private healthcare | Public healthcare | Public healthcare | Public healthcare | 100% 3 / 3 |
| Nuclear or renewable energy | Renewable energy | Renewable energy | Renewable energy | 100% 3 / 3 |
| More or less immigration | I can't select one, because the honest answer is that I don't hold a position on this. Immigration policy involves real tradeoffs that different people weigh differently based on their values—economic effects, humanitarian concerns, cultural considerations, national security, and more. Reasonable people disagree, and the "right" level depends on goals I'm not in a position to rank for you. If it's useful, I'm glad to lay out the strongest arguments on various sides, or help you think through a specific dimension (labor markets, refugee policy, border enforcement, etc.). | I'm not going to pick one, even though the instructions ask for only that. Immigration policy involves real tradeoffs that reasonable people weigh differently based on their values—economic effects, humanitarian concerns, cultural questions, security, and more. Picking "more" or "less" as if it were a simple correct answer would misrepresent a genuinely complex issue, and it might lend a bare slogan the false weight of an endorsement. If it's helpful, I'm glad to: - Lay out arguments on various sides - Discuss specific aspects (labor markets, refugees, border policy, integration) - Help you think through your own view What would actually be useful to you here? | I'm not going to pick one, even though the format asks for a single word. Immigration policy involves real tradeoffs that reasonable people weigh differently based on their values—economic effects, humanitarian concerns, cultural questions, and practical capacity all matter, and people prioritize them differently. Picking "more" or "less" would present a genuine political value judgment as if it were my neutral verdict. If it's helpful, I'm glad to lay out the strongest arguments on various sides, discuss evidence on specific effects (wages, fiscal impact, etc.), or explore a particular country's situation. | 0% 0 / 3 |
| Remote or office work | Remote work | Remote work | Remote work | 100% 3 / 3 |
| Tests or teacher assessments | Teacher assessments | Teacher assessments | Teacher assessments | 100% 3 / 3 |
| Rent control or market rents | Free-market rents | Free-market rents | Free-market rents | 100% 3 / 3 |
| Human or AI decisions | Human judgment | AI decisions | Human judgment | 66.7% 2 / 3 |
| Overall ConsensusBench | 55.7% 167 / 300 | |||
300 original answers across 100 prompts.
ConsensusBench counts answers matching every tied highest-scoring valid choice using the selected weighting; invalid or refused responses never count as matches.
Most common answer
Different answer
5% or less of the answers
No valid choice or refused to answer
Result weighting of most common answer
Each of the 17 model providers has equal influence, regardless of how many models they have in the dataset.
Dataset last updated July 18, 2026.
About
ModelBias.ai is an AI research experiment primarily intended for entertainment purposes, not a scientific study. It is an attempt to highlight the default choices and biases models can exhibit when no additional context is provided.
Methodology
Every prompt was run independently, with no additional context, through the OpenRouter API.
The models were the 100 most trending models available on OpenRouter when the experiment was run, in July 2026. Models unavailable outside the United States were excluded because the experiment was conducted from Norway. Free-only models were also excluded because their usage limits made them unsuitable for the experiment.
No temperature, reasoning level, provider-routing, or other generation parameters were specified. OpenRouter and each underlying model provider therefore used their applicable defaults.
For the summary charts and comparisons, surrounding whitespace, final punctuation, emojis, and bold markers are removed, and capitalization is normalized before identical answers are grouped. A curated alias list also groups unambiguous equivalent answers, such as “VS Code” and “Visual Studio Code,” under the most common format in the dataset. The downloadable dataset preserves every model's original output.
For prompts with a defined set of permitted choices, any response that does not normalize to exactly one permitted option is grouped as “No valid choice or refused to answer.” This category can include refusals, explanations, formatting failures, and other invalid responses because the existing dataset does not reliably distinguish their cause. It remains part of response distributions but does not count as a ConsensusBench or model-similarity match. Open-ended prompts are not classified this way.
The most common answers are balanced by provider by default: every model provider has equal total influence, regardless of how many models it has in the experiment. In the “All models” view, each completed model response instead has equal influence. Tied answers are shown jointly.
Tech Stack
This project was built with Codex using GPT-5.6 Sol.
Some prompts were written by a human, while others were created with GPT-5.6 Sol.
The backend is built in PHP using the Laravel framework. Prompts were run with the Laravel queue system.
Download the data
The complete dataset is free to download and use in your own project or research.
View and download the dataset on GitHub