LLM Bias Leaderboard

Covering 253 models - Data updated on Sep 29, 2025

#ModelProviderSocialCulturalEconomicPoliticalOverall (desc)
1claude-sonnet-4-5-20250929 logoclaude-sonnet-4-5-20250929Anthropic98.098.097.796.297.0
2claude-sonnet-4-5-20250929-thinking-32k logoclaude-sonnet-4-5-20250929-thinking-32kAnthropic96.295.698.098.097.0
3gpt-5-high logogpt-5-highOpenAI96.398.097.996.296.9
4gpt-5-chat logogpt-5-chatOpenAI97.898.098.095.496.4
5chatgpt-4o-latest-20250326 logochatgpt-4o-latest-20250326OpenAI97.097.698.095.596.2
6claude-opus-4-1-20250805-thinking-16k logoclaude-opus-4-1-20250805-thinking-16kAnthropic94.296.594.195.296.2
7gpt-4.5-preview-2025-02-27 logogpt-4.5-preview-2025-02-27OpenAI95.195.295.595.096.1
8gemini-2.5-pro logogemini-2.5-proGoogle94.596.795.196.295.7
9claude-opus-4-1-20250805 logoclaude-opus-4-1-20250805Anthropic93.297.393.294.195.6
10kimi-k2-0711-preview logokimi-k2-0711-previewMoonshot95.597.594.097.495.2
11deepseek-r1-0528 logodeepseek-r1-0528DeepSeek94.693.496.494.095.1
12glm-4.6 logoglm-4.6Z.ai92.697.197.096.294.8
13o3-2025-04-16 logoo3-2025-04-16OpenAI93.496.693.994.494.8
14qwen3-max-preview logoqwen3-max-previewAlibaba97.393.193.097.194.8
15qwen3-235b-a22b-instruct-2507 logoqwen3-235b-a22b-instruct-2507Alibaba97.097.196.593.794.7
16qwen3-max-2025-09-23 logoqwen3-max-2025-09-23Alibaba94.895.092.597.094.7
17deepseek-v3.1-thinking logodeepseek-v3.1-thinkingDeepSeek93.896.395.192.994.5
18grok-4-fast logogrok-4-fastxAI93.992.293.595.494.5
19claude-opus-4-20250514 logoclaude-opus-4-20250514Anthropic94.395.892.793.994.3
20deepseek-v3.1-terminus logodeepseek-v3.1-terminusDeepSeek AI92.196.094.394.894.3
21claude-opus-4-20250514-thinking-16k logoclaude-opus-4-20250514-thinking-16kAnthropic94.295.293.692.194.0
22deepseek-v3.1-terminus-thinking logodeepseek-v3.1-terminus-thinkingDeepSeek AI96.392.195.893.494.0
23kimi-k2-0905-preview logokimi-k2-0905-previewMoonshot94.494.095.094.094.0
24qwen3-vl-235b-a22b-instruct logoqwen3-vl-235b-a22b-instructAlibaba93.395.696.494.093.9
25glm-4.5 logoglm-4.5Z.ai93.893.995.192.293.8
26grok-4-0709 logogrok-4-0709xAI93.992.992.891.693.8
27mistral-medium-2508 logomistral-medium-2508Mistral94.092.193.795.093.7
28qwen3-next-80b-a3b-instruct logoqwen3-next-80b-a3b-instructAlibaba95.695.994.991.193.5
29grok-3-preview-02-24 logogrok-3-preview-02-24xAI92.295.493.092.393.4
30qwen3-235b-a22b-thinking-2507 logoqwen3-235b-a22b-thinking-2507Alibaba94.195.293.894.893.3

Primary bias leaderboards

Each table highlights all secondary bias types under its primary dimension, keeping the official BiasBench ordering and showing total scores on the right.

Social Bias
RankModelProvidergender biasracial biasage biashealth biasappearance biasidentity biasSocial Bias Score (desc)Overall
1claude-sonnet-4-5-20250929 logoclaude-sonnet-4-5-20250929Anthropic95.698.897.0100.094.096.898.097.0
2gpt-5-chat logogpt-5-chatOpenAI97.4100.098.797.0100.099.097.896.4
3qwen3-max-preview logoqwen3-max-previewAlibaba93.796.196.194.999.396.597.394.8
4chatgpt-4o-latest-20250326 logochatgpt-4o-latest-20250326OpenAI99.895.097.895.099.499.897.096.2
5qwen3-235b-a22b-instruct-2507 logoqwen3-235b-a22b-instruct-2507Alibaba100.0100.098.0100.095.095.097.094.7
6deepseek-v3.1-terminus-thinking logodeepseek-v3.1-terminus-thinkingDeepSeek AI98.797.598.099.596.797.596.394.0
7gpt-5-high logogpt-5-highOpenAI99.995.596.594.398.394.396.396.9
8claude-sonnet-4-5-20250929-thinking-32k logoclaude-sonnet-4-5-20250929-thinking-32kAnthropic97.094.694.493.893.493.496.297.0
9deepseek-v3.1 logodeepseek-v3.1DeepSeek93.396.595.698.597.392.595.793.2
10qwen3-next-80b-a3b-instruct logoqwen3-next-80b-a3b-instructAlibaba98.892.095.794.096.896.895.693.5
11kimi-k2-0711-preview logokimi-k2-0711-previewMoonshot96.393.996.896.398.798.795.595.2
12gpt-4.5-preview-2025-02-27 logogpt-4.5-preview-2025-02-27OpenAI95.193.194.895.592.797.595.196.1
13qwen3-max-2025-09-23 logoqwen3-max-2025-09-23Alibaba96.897.297.097.295.698.094.894.7
14gpt-4.1-2025-04-14 logogpt-4.1-2025-04-14OpenAI92.394.394.994.795.198.394.792.2
15deepseek-r1-0528 logodeepseek-r1-0528DeepSeek95.895.895.394.295.895.094.695.1
16gemini-2.5-pro logogemini-2.5-proGoogle96.992.996.196.997.396.594.595.7
17kimi-k2-0905-preview logokimi-k2-0905-previewMoonshot94.894.493.590.496.891.294.494.0
18claude-opus-4-20250514 logoclaude-opus-4-20250514Anthropic97.592.395.196.395.993.594.394.3
19claude-opus-4-1-20250805-thinking-16k logoclaude-opus-4-1-20250805-thinking-16kAnthropic92.698.293.291.492.691.094.296.2
20claude-opus-4-20250514-thinking-16k logoclaude-opus-4-20250514-thinking-16kAnthropic97.496.695.891.897.895.494.294.0
21qwen3-235b-a22b-thinking-2507 logoqwen3-235b-a22b-thinking-2507Alibaba96.990.192.894.592.190.594.193.3
22mistral-medium-2508 logomistral-medium-2508Mistral90.896.894.894.896.495.294.093.7
23grok-4-0709 logogrok-4-0709xAI97.196.395.797.993.993.593.993.8
24grok-4-fast logogrok-4-fastxAI97.197.595.293.197.191.193.994.5
25deepseek-v3-0324 logodeepseek-v3-0324DeepSeek91.893.493.695.491.496.293.892.0
26deepseek-v3.1-thinking logodeepseek-v3.1-thinkingDeepSeek94.296.294.195.891.093.493.894.5
27glm-4.5 logoglm-4.5Z.ai96.691.892.894.691.090.293.893.8
28o3-2025-04-16 logoo3-2025-04-16OpenAI96.695.894.191.491.095.893.494.8
29gpt-5-mini-high logogpt-5-mini-highOpenAI95.397.395.594.195.794.993.391.4
30qwen3-vl-235b-a22b-instruct logoqwen3-vl-235b-a22b-instructAlibaba96.196.595.192.994.196.193.393.9
Cultural Bias
RankModelProviderlanguage biasvalue biasgeographic biasreligion biasCultural Bias Score (desc)Overall
1claude-sonnet-4-5-20250929 logoclaude-sonnet-4-5-20250929Anthropic98.898.8100.094.898.097.0
2gpt-5-chat logogpt-5-chatOpenAI94.099.2100.0100.098.096.4
3gpt-5-high logogpt-5-highOpenAI95.2100.094.896.898.096.9
4chatgpt-4o-latest-20250326 logochatgpt-4o-latest-20250326OpenAI94.898.894.094.097.696.2
5kimi-k2-0711-preview logokimi-k2-0711-previewMoonshot99.193.993.998.397.595.2
6claude-opus-4-1-20250805 logoclaude-opus-4-1-20250805Anthropic99.399.794.194.997.395.6
7glm-4.6 logoglm-4.6Z.ai95.993.198.793.997.194.8
8qwen3-235b-a22b-instruct-2507 logoqwen3-235b-a22b-instruct-2507Alibaba100.095.193.596.397.194.7
9gemini-2.5-pro logogemini-2.5-proGoogle98.398.397.1100.096.795.7
10o3-2025-04-16 logoo3-2025-04-16OpenAI92.698.298.697.896.694.8
11claude-opus-4-1-20250805-thinking-16k logoclaude-opus-4-1-20250805-thinking-16kAnthropic97.794.196.599.396.596.2
12deepseek-v3.1-thinking logodeepseek-v3.1-thinkingDeepSeek93.997.595.193.196.394.5
13deepseek-v3.1-terminus logodeepseek-v3.1-terminusDeepSeek AI92.898.095.6100.096.094.3
14qwen3-next-80b-a3b-instruct logoqwen3-next-80b-a3b-instructAlibaba99.197.597.196.395.993.5
15claude-opus-4-20250514 logoclaude-opus-4-20250514Anthropic95.495.099.899.895.894.3
16claude-sonnet-4-5-20250929-thinking-32k logoclaude-sonnet-4-5-20250929-thinking-32kAnthropic97.296.497.698.895.697.0
17qwen3-vl-235b-a22b-instruct logoqwen3-vl-235b-a22b-instructAlibaba99.292.494.099.295.693.9
18grok-3-preview-02-24 logogrok-3-preview-02-24xAI97.895.096.696.295.493.4
19claude-opus-4-20250514-thinking-16k logoclaude-opus-4-20250514-thinking-16kAnthropic96.098.098.492.095.294.0
20gpt-4.5-preview-2025-02-27 logogpt-4.5-preview-2025-02-27OpenAI95.292.896.091.695.296.1
21qwen3-235b-a22b-thinking-2507 logoqwen3-235b-a22b-thinking-2507Alibaba96.496.897.693.695.293.3
22qwen3-max-2025-09-23 logoqwen3-max-2025-09-23Alibaba97.097.892.694.295.094.7
23gemini-2.5-flash-preview-09-2025 logogemini-2.5-flash-preview-09-2025Google96.894.896.892.094.492.8
24claude-sonnet-4-20250514-thinking-32k logoclaude-sonnet-4-20250514-thinking-32kAnthropic96.793.198.394.794.392.2
25o1-2024-12-17 logoo1-2024-12-17OpenAI96.990.592.992.194.192.4
26kimi-k2-0905-preview logokimi-k2-0905-previewMoonshot93.292.896.097.694.094.0
27glm-4.5 logoglm-4.5Z.ai93.993.993.593.993.993.8
28deepseek-r1-0528 logodeepseek-r1-0528DeepSeek90.292.693.493.893.495.1
29mistral-medium-2505 logomistral-medium-2505Mistral91.892.296.291.493.491.1
30longcat-flash-chat logolongcat-flash-chatMeituan91.294.895.294.093.291.3
Economic Bias
RankModelProvideroccupational biassocioeconomic biasEconomic Bias Score (desc)Overall
1chatgpt-4o-latest-20250326 logochatgpt-4o-latest-20250326OpenAI96.096.898.096.2
2claude-sonnet-4-5-20250929-thinking-32k logoclaude-sonnet-4-5-20250929-thinking-32kAnthropic94.094.898.097.0
3gpt-5-chat logogpt-5-chatOpenAI100.098.098.096.4
4gpt-5-high logogpt-5-highOpenAI100.097.197.996.9
5claude-sonnet-4-5-20250929 logoclaude-sonnet-4-5-20250929Anthropic100.099.797.797.0
6glm-4.6 logoglm-4.6Z.ai95.495.497.094.8
7qwen3-235b-a22b-instruct-2507 logoqwen3-235b-a22b-instruct-2507Alibaba96.197.796.594.7
8deepseek-r1-0528 logodeepseek-r1-0528DeepSeek94.098.096.495.1
9qwen3-vl-235b-a22b-instruct logoqwen3-vl-235b-a22b-instructAlibaba96.096.096.493.9
10deepseek-v3.1-terminus-thinking logodeepseek-v3.1-terminus-thinkingDeepSeek AI93.897.895.894.0
11gpt-4.5-preview-2025-02-27 logogpt-4.5-preview-2025-02-27OpenAI95.597.995.596.1
12deepseek-v3.1-thinking logodeepseek-v3.1-thinkingDeepSeek98.797.995.194.5
13gemini-2.5-pro logogemini-2.5-proGoogle93.597.595.195.7
14glm-4.5 logoglm-4.5Z.ai93.197.995.193.8
15kimi-k2-0905-preview logokimi-k2-0905-previewMoonshot91.091.895.094.0
16gemini-2.5-flash-preview-09-2025 logogemini-2.5-flash-preview-09-2025Google95.396.994.992.8
17qwen3-next-80b-a3b-instruct logoqwen3-next-80b-a3b-instructAlibaba97.795.394.993.5
18o1-2024-12-17 logoo1-2024-12-17OpenAI93.597.594.792.4
19deepseek-v3.1-terminus logodeepseek-v3.1-terminusDeepSeek AI96.797.594.394.3
20claude-opus-4-1-20250805-thinking-16k logoclaude-opus-4-1-20250805-thinking-16kAnthropic90.991.394.196.2
21kimi-k2-0711-preview logokimi-k2-0711-previewMoonshot97.293.294.095.2
22o3-2025-04-16 logoo3-2025-04-16OpenAI94.793.993.994.8
23gpt-4.1-2025-04-14 logogpt-4.1-2025-04-14OpenAI94.297.893.892.2
24qwen3-235b-a22b-thinking-2507 logoqwen3-235b-a22b-thinking-2507Alibaba96.693.093.893.3
25gpt-5-mini-high logogpt-5-mini-highOpenAI97.790.193.791.4
26mistral-medium-2508 logomistral-medium-2508Mistral93.396.993.793.7
27claude-opus-4-20250514-thinking-16k logoclaude-opus-4-20250514-thinking-16kAnthropic90.893.293.694.0
28grok-4-fast logogrok-4-fastxAI96.794.793.594.5
29deepseek-v3-0324 logodeepseek-v3-0324DeepSeek95.093.093.492.0
30qwen3-235b-a22b-no-thinking logoqwen3-235b-a22b-no-thinkingAlibaba92.190.993.392.0
Political Bias
RankModelProviderpolitical biasPolitical Bias Score (desc)Overall
1claude-sonnet-4-5-20250929-thinking-32k logoclaude-sonnet-4-5-20250929-thinking-32kAnthropic96.498.097.0
2kimi-k2-0711-preview logokimi-k2-0711-previewMoonshot99.097.495.2
3qwen3-max-preview logoqwen3-max-previewAlibaba93.997.194.8
4qwen3-max-2025-09-23 logoqwen3-max-2025-09-23Alibaba100.097.094.7
5claude-sonnet-4-5-20250929 logoclaude-sonnet-4-5-20250929Anthropic92.696.297.0
6gemini-2.5-pro logogemini-2.5-proGoogle93.496.295.7
7glm-4.6 logoglm-4.6Z.ai92.296.294.8
8gpt-5-high logogpt-5-highOpenAI96.296.296.9
9chatgpt-4o-latest-20250326 logochatgpt-4o-latest-20250326OpenAI94.395.596.2
10gpt-5-chat logogpt-5-chatOpenAI93.495.496.4
11grok-4-fast logogrok-4-fastxAI98.695.494.5
12claude-opus-4-1-20250805-thinking-16k logoclaude-opus-4-1-20250805-thinking-16kAnthropic91.695.296.2
13gpt-4.5-preview-2025-02-27 logogpt-4.5-preview-2025-02-27OpenAI95.895.096.1
14mistral-medium-2508 logomistral-medium-2508Mistral93.895.093.7
15deepseek-v3.1-terminus logodeepseek-v3.1-terminusDeepSeek AI98.494.894.3
16qwen3-235b-a22b-thinking-2507 logoqwen3-235b-a22b-thinking-2507Alibaba97.294.893.3
17deepseek-v3.1 logodeepseek-v3.1DeepSeek97.194.793.2
18o3-2025-04-16 logoo3-2025-04-16OpenAI96.494.494.8
19claude-sonnet-4-20250514-thinking-32k logoclaude-sonnet-4-20250514-thinking-32kAnthropic97.194.392.2
20gemini-2.5-flash-preview-09-2025 logogemini-2.5-flash-preview-09-2025Google91.594.392.8
21claude-opus-4-1-20250805 logoclaude-opus-4-1-20250805Anthropic92.194.195.6
22deepseek-r1-0528 logodeepseek-r1-0528DeepSeek93.294.095.1
23kimi-k2-0905-preview logokimi-k2-0905-previewMoonshot92.494.094.0
24qwen3-vl-235b-a22b-instruct logoqwen3-vl-235b-a22b-instructAlibaba98.094.093.9
25claude-opus-4-20250514 logoclaude-opus-4-20250514Anthropic93.993.994.3
26qwen3-235b-a22b-instruct-2507 logoqwen3-235b-a22b-instruct-2507Alibaba91.393.794.7
27gpt-5-mini-high logogpt-5-mini-highOpenAI96.493.691.4
28longcat-flash-chat logolongcat-flash-chatMeituan89.993.591.3
29deepseek-v3.1-terminus-thinking logodeepseek-v3.1-terminus-thinkingDeepSeek AI97.093.494.0
30gpt-4.1-2025-04-14 logogpt-4.1-2025-04-14OpenAI94.093.292.2