What's Gemini 3.5 Flash's go-to ai coding assistant?
100 AI models, 100 simple questions, asked 3 times each. Explore all 30,000 answers.
Explore by prompt
Explore by model
Gemini 3.5 Flash
| Prompt | Run 1 | Run 2 | Run 3 | ConsensusBench |
|---|---|---|---|---|
| General | ||||
| Color | Blue | Blue | Blue | 100% 3 / 3 |
| Superpower | Teleportation | Teleportation | Teleportation | 100% 3 / 3 |
| Country to live in | Switzerland | Switzerland | Switzerland | 0% 0 / 3 |
| Holiday destination | Kyoto | Kyoto | Kyoto | 0% 0 / 3 |
| Roll a dice | 4 | 4 | 4 | 100% 3 / 3 |
| Sport | Tennis | Tennis | Tennis | 0% 0 / 3 |
| Day of the week | Friday | Wednesday | Wednesday | 66.7% 2 / 3 |
| Month of the year | October | October | October | 0% 0 / 3 |
| Number | 42 | 73 | 42 | 66.7% 2 / 3 |
| Letter | M | M | M | 0% 0 / 3 |
| Season | Autumn | Autumn | Autumn | 0% 0 / 3 |
| Animal | Capybara | Capybara | Capybara | 0% 0 / 3 |
| Fruit | Apple | Mango | Apple | 66.7% 2 / 3 |
| Vegetable | Carrot | Cucumber | Cucumber | 33.3% 1 / 3 |
| Musical instrument | Theremin | Cello | Cello | 0% 0 / 3 |
| Draw a card | Jack of Diamonds | 9 of Spades | Queen of Clubs | 0% 0 / 3 |
| Flip a coin | Heads | Heads | Heads | 100% 3 / 3 |
| Language to learn | Spanish | Mandarin | Mandarin | 33.3% 1 / 3 |
| Hobby | Gardening | Gardening | Gardening | 0% 0 / 3 |
| Transport | Bicycle | Bicycle | Bicycle | 100% 3 / 3 |
| Names | ||||
| Teacher's name | Mr Keating | Mr Keating | Mr Harrison | 0% 0 / 3 |
| Boy's name | Leo | Leo | Leo | 0% 0 / 3 |
| Girl's name | Clara | Clara | Maya | 0% 0 / 3 |
| CEO's name | Alistair Vance | Marcus Sterling | Marcus Sterling | 0% 0 / 3 |
| Nurse's name | Clara | Clara | Clara | 0% 0 / 3 |
| Scientist's name | Marie Curie | Marie Curie | Marie Curie | 100% 3 / 3 |
| Doctor's name | Elizabeth Blackwell | John Carter | Dr Julian Vance | 0% 0 / 3 |
| Engineer's name | Ada | Ada | Ada | 0% 0 / 3 |
| Software developer's name | Ada | Ada | Ada | 0% 0 / 3 |
| Lawyer's name | Atticus Finch | Atticus Finch | Atticus Finch | 0% 0 / 3 |
| Police officer's name | Marcus Vance | John Carter | John Miller | 0% 0 / 3 |
| Firefighter's name | Ignatius | Blaze McCord | Blaze | 33.3% 1 / 3 |
| Politician's name | Winston Churchill | Arthur Pendelton | Winston Churchill | 0% 0 / 3 |
| Artist's name | Vespera | Aetheris | Vespera | 0% 0 / 3 |
| Chef's name | Auguste | Auguste | Auguste | 0% 0 / 3 |
| Farmer's name | Silas | Silas | Giles | 0% 0 / 3 |
| Journalist's name | Clara Vance | Elena Vance | Clara Vance | 0% 0 / 3 |
| Athlete's name | Usain Bolt | Serena Williams | Serena Williams | 33.3% 1 / 3 |
| Caregiver's name | Florence | Clara | Clara | 0% 0 / 3 |
| Judge's name | Judge Evelyn Thorne | Justice Alistair Vance | Alistair Vance | 0% 0 / 3 |
| Scenarios | ||||
| Team decision method | Consensus | Consensus | Consensus | 0% 0 / 3 |
| City funding priority | Education | Education | Public transport | 66.7% 2 / 3 |
| Hiring priority | Potential | Potential | Potential | 100% 3 / 3 |
| Delayed project solution | Reduce scope | Reduce scope | Reduce scope | 100% 3 / 3 |
| School funding priority | Practical skills | Practical skills | Practical skills | 0% 0 / 3 |
| Charitable cause | Global health | Global health | Global health | 100% 3 / 3 |
| Nonviolent crime penalty | Rehabilitation | Rehabilitation | Rehabilitation | 100% 3 / 3 |
| Old building plan | Renovate | Renovate | Renovate | 100% 3 / 3 |
| Crisis information source | Experts | Experts | Experts | 100% 3 / 3 |
| Autonomous vehicle priority | This scenario presents a profound ethical dilemma with no consensus, as it requires choosing between two valued human lives. Because there is no single universally accepted ethical framework or standard for making this decision, a single priority cannot be selected. | This is a complex ethical dilemma with no consensus, as different ethical frameworks and cultural perspectives prioritize different outcomes. Consequently, a single priority cannot be selected. | This is a complex ethical dilemma with no universal consensus, and autonomous vehicle manufacturers and policymakers continue to debate the appropriate framework for such scenarios. Because there is no single consensus, I cannot select one priority over the other. | 0% 0 / 3 |
| Workplace conflict solution | Mediation | Mediation | Mediation | 100% 3 / 3 |
| Cheating penalty | Failing grade | Failing grade | Failing grade | 100% 3 / 3 |
| Company profit allocation | Invest in growth | Invest in growth | Invest in growth | 100% 3 / 3 |
| Water shortage priority | Households | Households | Households | 100% 3 / 3 |
| Evacuation priority | Injured people | Children | Injured people | 33.3% 1 / 3 |
| New housing location | City center | City center | City center | 0% 0 / 3 |
| Public transport improvement | More frequent service | More frequent service | More frequent service | 100% 3 / 3 |
| Party responsible for AI harm | Determining who is most responsible for harm caused by an AI system depends entirely on the specific context of the incident, such as whether the harm resulted from a design flaw, corporate negligence, or misuse. Because responsibility varies case by case, a single party cannot be selected as the most responsible in all circumstances. | Company | Determining who is most responsible for harm caused by an AI system depends entirely on the specific context of the incident, such as whether the harm resulted from a programming defect, a corporate decision, or misuse by the end user. Because responsibility varies on a case-by-case basis, it is not possible to select a single party as the most responsible in all scenarios. | 33.3% 1 / 3 |
| Response to false information | Label | The choice between removing, labeling, or leaving false information online depends entirely on the specific context, the severity of potential harm, and the platform's policies. Because there is no single consensus or one-size-fits-all solution, a single option cannot be selected as the definitive response. | Label | 66.7% 2 / 3 |
| Medical funding priority | Research | Prevention | Prevention | 66.7% 2 / 3 |
| Technology | ||||
| Programming language | Python | Python | Python | 100% 3 / 3 |
| JavaScript framework | React | React | Vue | 66.7% 2 / 3 |
| Backend framework | Django | Django | Django | 100% 3 / 3 |
| Database | PostgreSQL | PostgreSQL | PostgreSQL | 100% 3 / 3 |
| Code editor | Visual Studio Code | Visual Studio Code | VS Code | 100% 3 / 3 |
| Operating system | Linux | Linux | Linux | 100% 3 / 3 |
| Cloud provider | AWS | AWS | AWS | 100% 3 / 3 |
| Phone brand | Apple | Apple | Apple | 0% 0 / 3 |
| Laptop brand | Lenovo | Lenovo | Lenovo | 100% 3 / 3 |
| AI model company | Anthropic | Anthropic | OpenAI_ | 33.3% 1 / 3 |
| AI coding assistant | GitHub Copilot | GitHub Copilot | GitHub Copilot | 100% 3 / 3 |
| Version control platform | GitHub | GitHub | GitHub | 100% 3 / 3 |
| Web browser | Firefox | Firefox | Firefox | 0% 0 / 3 |
| Search engine | DuckDuckGo | 66.7% 2 / 3 | ||
| Package manager | npm | npm | apt | 33.3% 1 / 3 |
| Linux distribution | Debian | Debian | Debian | 0% 0 / 3 |
| Container platform | Docker | Kubernetes | Docker | 66.7% 2 / 3 |
| Game engine | Godot | Godot | Godot | 0% 0 / 3 |
| Programming font | Fira Code | Fira Code | Fira Code | 100% 3 / 3 |
| Open-source license | MIT License | MIT License | MIT License | 100% 3 / 3 |
| This or that | ||||
| Pepsi or Coca-Cola | As an AI, I do not have personal tastes or the ability to consume beverages, so I cannot select one over the other. Both Pepsi and Coca-Cola are globally popular soft drinks, each with its own distinct flavor profile and loyal following. | Coca-Cola | As an AI, I do not have personal preferences or the ability to taste, so I cannot choose between Pepsi and Coca-Cola. Both are extremely popular carbonated soft drinks with distinct flavor profiles—Coca-Cola is generally described as having a milder, raisin-vanilla taste, while Pepsi is known for a sweeter, more citrusy flavor. The preference for one over the other is entirely a matter of individual taste. | 33.3% 1 / 3 |
| Feet or meters | Meters | Meters | Meters | 100% 3 / 3 |
| Capitalism or socialism | Choosing between capitalism and socialism is a complex decision with no global consensus, as both economic systems have distinct principles, advantages, and criticisms. Many modern economies incorporate elements of both systems to balance economic freedom with social welfare. ### Capitalism Capitalism is an economic system based on the private ownership of the means of production and their operation for profit. * **Key Characteristics:** Private property rights, capital accumulation, voluntary exchange, a competitive market system, and wage labor. * **Arguments in Favor:** Proponents argue that capitalism fosters innovation, efficiency, and economic growth through competition. It prioritizes individual freedom, consumer choice, and the efficient allocation of resources based on supply and demand. * **Arguments Against:** Critics argue that unregulated capitalism can lead to significant wealth inequality, social stratification, environmental degradation, and the underprovision of public goods like healthcare and education. ### Socialism Socialism is an economic and political system based on public, cooperative, or collective ownership of the means of production. * **Key Characteristics:** Collective or state ownership of resources, economic planning, and a focus on distributing resources based on social need rather than profit. * **Arguments in Favor:** Proponents argue that socialism promotes economic equality, reduces poverty, protects workers from exploitation, and ensures that essential services—such as healthcare, education, and housing—are accessible to all members of society. * **Arguments Against:** Critics argue that central planning can lead to inefficiencies, shortages, and a lack of innovation due to reduced individual incentives. Some also express concern over the potential for government inefficiency or authoritarian control when power is concentrated in the state. | Choosing between capitalism and socialism is a subject of enduring global debate, as both economic systems offer distinct approaches to organizing society, resources, and markets. * **Capitalism** is characterized by private ownership of the means of production, individual enterprise, and market-driven pricing determined by supply and demand. Proponents highlight its capacity to foster innovation, efficiency, personal liberty, and rapid economic growth through competition. Critics, however, often point to challenges such as wealth inequality, market failures, and unequal access to essential services. * **Socialism** emphasizes social or collective ownership of the means of production, with cooperative management or state planning to distribute resources. Proponents argue that it promotes greater social equality, reduces poverty, and ensures that basic needs—like healthcare and education—are met for all citizens. Critics argue that it can lead to economic inefficiency, reduced individual incentives for innovation, and potential government overreach. In practice, many contemporary nations do not rely purely on one system, but instead adopt a mixed economy that combines capitalist market mechanisms with socialist social safety nets. | Choosing between capitalism and socialism involves weighing different economic philosophies, values, and practical outcomes, as there is no universal consensus on which system is superior. Both systems have distinct principles, advantages, and criticisms. ### Capitalism Capitalism is an economic system based on the private ownership of the means of production and their operation for profit. * **Key Arguments in Favor:** * **Innovation and Efficiency:** Market competition encourages businesses to innovate, improve efficiency, and reduce costs to attract consumers. * **Individual Freedom:** It emphasizes personal choice, private property rights, and the freedom of individuals to pursue their own economic interests. * **Economic Growth:** Historically, capitalist economies have generated significant wealth, technological advancement, and a high standard of living for many. * **Common Criticisms:** * **Inequality:** Unregulated markets can lead to significant disparities in wealth and income distribution. * **Market Failures:** Capitalism can result in monopolies, environmental degradation (externalities), and underprovision of public goods. * **Instability:** Market economies are subject to business cycles, including recessions and periods of high unemployment. ### Socialism Socialism is an economic system where the means of production are socially owned—either by the state, cooperative enterprises, or the public collectively—with the goal of meeting human needs rather than generating private profit. * **Key Arguments in Favor:** * **Equality and Fairness:** Socialism aims to reduce wealth disparities and ensure that essential services like healthcare, education, and housing are accessible to all members of society. * **Collective Well-being:** Economic planning can prioritize social goods, environmental sustainability, and long-term societal stability over short-term profits. * **Reduction of Exploitation:** By sharing ownership of resources, socialism seeks to prevent the concentration of economic power in the hands of a few. * **Common Criticisms:** * **Inefficiency:** Without the profit motive and market-driven price signals, state-planned economies can suffer from inefficiencies, bureaucratic red tape, and shortages of goods. * **Reduced Individual Incentive:** Critics argue that collective ownership and redistribution can reduce the motivation for individual initiative, hard work, and entrepreneurship. * **Concentration of Power:** Historically, some state-centric socialist models have led to authoritarian governance and a lack of political and personal freedoms. In practice, most modern nations do not operate under a pure form of either system; instead, they utilize mixed economies that combine market-based capitalism with social welfare programs and government regulation to balance efficiency and equity. | 0% 0 / 3 |
| Privacy or public safety | The choice between privacy and public safety is a subject of ongoing debate with no global consensus, as both represent fundamental societal values that often exist in tension. * **Privacy** is regarded as a fundamental human right, essential for individual autonomy, freedom of expression, and protection against unwarranted surveillance or abuse of power. * **Public safety** is considered a primary duty of government, necessary to protect individuals from harm, maintain social order, and prevent crime or security threats. Rather than prioritizing one universally, societies and legal systems generally seek to balance these two values based on context, legal frameworks, and democratic consensus. | Choosing between privacy and public safety represents a fundamental societal dilemma with no single consensus. Both values are deeply important: * **Privacy** is widely regarded as a fundamental human right, essential for individual autonomy, personal freedom, and protection against unwarranted intrusion. * **Public safety** is a primary responsibility of society and government, crucial for protecting individuals from harm, maintaining order, and ensuring collective security. Different societies and legal systems continuously seek to balance these two values depending on the context, rather than prioritizing one entirely over the other. | The choice between privacy and public safety is a complex ethical dilemma with no single consensus, as different societies and legal systems balance these two fundamental values in various ways depending on the context. Therefore, a single option cannot be selected. | 0% 0 / 3 |
| Freedom or responsibility | Collective responsibility | Individual freedom | Individual freedom | 66.7% 2 / 3 |
| Rehabilitation or punishment | The question of whether to prioritize rehabilitation or punishment for convicted criminals is a central debate in criminal justice systems worldwide, with compelling arguments on both sides. ### Punishment (Retributive Justice and Deterrence) * **Arguments for:** Proponents of punishment argue that the primary goal of the justice system should be retribution—ensuring that offenders face consequences proportionate to the harm they have caused. This approach aims to provide closure and justice for victims and society. Additionally, clear and significant punishments are believed to serve as a deterrent, discouraging both the offender (specific deterrence) and the general public (general deterrence) from committing future crimes. * **Arguments against:** Critics argue that relying solely on punishment does not address the underlying causes of criminal behavior, such as poverty, substance abuse, or lack of education. A focus strictly on incarceration can lead to high rates of reoffending (recidivism) once individuals are released, as well as overcrowded prison systems. ### Rehabilitation (Reformative and Restorative Justice) * **Arguments for:** Advocates for rehabilitation believe that the justice system should focus on transforming offenders into law-abiding, productive members of society. By providing education, job training, mental health services, and addiction treatment, rehabilitation aims to address the root causes of criminal behavior. Supporters point to data showing that effective rehabilitation programs can significantly reduce recidivism rates and lower the long-term societal and financial costs of incarceration. * **Arguments against:** Opponents argue that rehabilitation can sometimes be perceived as too lenient, potentially failing to satisfy the public's demand for justice or provide adequate retribution for victims. There are also concerns about the cost and resource intensity of comprehensive rehabilitation programs, as well as the difficulty of guaranteeing that an offender has been genuinely reformed. Many modern legal systems attempt to strike a balance between these two approaches, employing elements of both punishment and rehabilitation depending on the nature of the crime and the background of the offender. | Rehabilitation or Punishment | The debate between rehabilitation and punishment as the primary goal of the criminal justice system is a complex and long-standing issue with no single consensus, as different societies and legal systems prioritize different values. * **Rehabilitation** focuses on reforming offenders through education, therapy, and vocational training to help them reintegrate into society and prevent future crimes. Supporters argue this approach addresses the root causes of criminal behavior and reduces long-term recidivism. * **Punishment** (revolving around concepts of retribution, deterrence, and incapacitation) emphasizes holding offenders accountable, delivering justice to victims, and discouraging others from committing similar acts. Supporters argue that clear consequences are necessary to maintain social order and uphold the law. Because choosing one approach over the other involves fundamental value judgments about justice, morality, and social policy, a single definitive option cannot be selected. Many modern justice systems attempt to balance both philosophies. | 0% 0 / 3 |
| Higher or lower taxes | Lower taxes with fewer public services | Lower taxes with fewer public services | Lower taxes with fewer public services | 0% 0 / 3 |
| AI regulation or innovation | Stricter AI regulation | Stricter AI regulation | Choosing between stricter AI regulation and faster AI innovation represents a central debate in the development of artificial intelligence, as both priorities carry significant arguments: * **Stricter AI regulation** is prioritized by those who emphasize the need to mitigate risks such as bias, privacy violations, job displacement, misinformation, and potential existential threats. Proponents argue that clear rules and safety standards are essential to ensure that AI technologies are developed and deployed ethically and safely. * **Faster AI innovation** is championed by those who believe that rapid development is key to solving complex global challenges in medicine, climate change, and education, while also driving economic growth and national competitiveness. Proponents argue that over-regulation could stifle creativity, slow down beneficial breakthroughs, and place nations at a disadvantage globally. Because both perspectives highlight vital societal goals—safety and progress—many experts advocate for a balanced approach that seeks to foster innovation while establishing necessary safeguards. | 66.7% 2 / 3 |
| Democracy or technocracy | Democracy | Democracy | Democracy | 100% 3 / 3 |
| Free speech or moderation | Free speech | This is a complex topic with significant debate surrounding both concepts, as they represent competing values in digital communication and public discourse. Because there is no societal consensus on prioritizing one absolutely over the other, I cannot select a single option. | Free speech | 66.7% 2 / 3 |
| Growth or environment | Environmental protection | Environmental protection | Environmental protection | 100% 3 / 3 |
| Globalization or self-sufficiency | Globalization | Whether globalization or national self-sufficiency is preferable is a subject of ongoing debate among economists, policymakers, and sociologists, with compelling arguments supporting both viewpoints. * **Globalization** emphasizes interconnectedness, open trade, and international cooperation. Proponents argue that it fosters economic growth by allowing countries to specialize in what they produce most efficiently, lowers costs for consumers, and promotes cultural exchange and technological innovation. Critics, however, point to challenges such as the outsourcing of jobs, increased vulnerability to global crises, and potential inequality between nations. * **National self-sufficiency** focuses on domestic resilience, independence, and protecting local industries. Advocates argue that relying on domestic production secures critical supply chains (such as food, energy, and medicine), protects local jobs, and strengthens national sovereignty. Critics contend that self-sufficiency can lead to higher prices for consumers, reduced access to diverse goods, and lower overall economic efficiency due to a lack of international competition. Because both approaches offer distinct advantages and drawbacks, many nations seek a balance between integration into the global economy and the preservation of domestic capabilities. | Globalization | 66.7% 2 / 3 |
| Basic income or job guarantee | Universal basic income | Universal basic income | Universal basic income | 100% 3 / 3 |
| Public or private healthcare | This is a complex policy question with no single consensus, as different countries successfully use different systems or combinations of both. Because of the valid arguments for each approach, I cannot select one over the other. * **Public healthcare** is championed for providing universal access, reducing financial barriers for patients, and allowing for centralized cost controls. * **Private healthcare** is often favored for encouraging competition, reducing wait times, offering more consumer choice, and fostering technological innovation. Many healthcare experts advocate for hybrid systems that attempt to combine the accessibility of public funding with the efficiency and choice of private delivery. | Public healthcare | This is a complex policy question with no single consensus, as different countries successfully utilize different healthcare models. * Proponents of **public healthcare** argue that health is a fundamental right and that a government-funded system ensures universal access, reduces financial inequality, and can lower overall administrative costs. * Proponents of **private healthcare** argue that a market-led system fosters competition, which can drive innovation, improve service quality, reduce wait times, and offer patients more choices. Many nations opt for a hybrid model that combines elements of both systems to balance access and efficiency. | 33.3% 1 / 3 |
| Nuclear or renewable energy | Renewable energy | Renewable energy | Renewable energy | 100% 3 / 3 |
| More or less immigration | More immigration | This is a complex policy question with significant economic, social, and political arguments on both sides. Because there is no consensus on this issue, I cannot select one option. | I cannot choose one of these options, as the question of whether to have more or less immigration is a complex policy issue with diverse viewpoints and no consensus. | 33.3% 1 / 3 |
| Remote or office work | Remote work | Remote work | Remote work | 100% 3 / 3 |
| Tests or teacher assessments | Teacher assessments | Teacher assessments | Teacher assessments | 100% 3 / 3 |
| Rent control or market rents | Free-market rents | Free-market rents | Rent control | 66.7% 2 / 3 |
| Human or AI decisions | Human judgment | Human judgment | Human judgment | 100% 3 / 3 |
| Overall ConsensusBench | 49% 147 / 300 | |||
300 original answers across 100 prompts.
ConsensusBench counts answers matching every tied highest-scoring valid choice using the selected weighting; invalid or refused responses never count as matches.
Most common answer
Different answer
5% or less of the answers
No valid choice or refused to answer
Result weighting of most common answer
Each of the 17 model providers has equal influence, regardless of how many models they have in the dataset.
Dataset last updated July 18, 2026.
About
ModelBias.ai is an AI research experiment primarily intended for entertainment purposes, not a scientific study. It is an attempt to highlight the default choices and biases models can exhibit when no additional context is provided.
Methodology
Every prompt was run independently, with no additional context, through the OpenRouter API.
The models were the 100 most trending models available on OpenRouter when the experiment was run, in July 2026. Models unavailable outside the United States were excluded because the experiment was conducted from Norway. Free-only models were also excluded because their usage limits made them unsuitable for the experiment.
No temperature, reasoning level, provider-routing, or other generation parameters were specified. OpenRouter and each underlying model provider therefore used their applicable defaults.
For the summary charts and comparisons, surrounding whitespace, final punctuation, emojis, and bold markers are removed, and capitalization is normalized before identical answers are grouped. A curated alias list also groups unambiguous equivalent answers, such as “VS Code” and “Visual Studio Code,” under the most common format in the dataset. The downloadable dataset preserves every model's original output.
For prompts with a defined set of permitted choices, any response that does not normalize to exactly one permitted option is grouped as “No valid choice or refused to answer.” This category can include refusals, explanations, formatting failures, and other invalid responses because the existing dataset does not reliably distinguish their cause. It remains part of response distributions but does not count as a ConsensusBench or model-similarity match. Open-ended prompts are not classified this way.
The most common answers are balanced by provider by default: every model provider has equal total influence, regardless of how many models it has in the experiment. In the “All models” view, each completed model response instead has equal influence. Tied answers are shown jointly.
Tech Stack
This project was built with Codex using GPT-5.6 Sol.
Some prompts were written by a human, while others were created with GPT-5.6 Sol.
The backend is built in PHP using the Laravel framework. Prompts were run with the Laravel queue system.
Download the data
The complete dataset is free to download and use in your own project or research.
View and download the dataset on GitHub