RankModelScoreCIVotesOrganizationLicenseKnowledgeCutoff
1GPT-4o-2024-05-131287+3/-444325OpenAIProprietary2023/10
2Gemini-Advanced-05141267+3/-435777GoogleProprietaryOnline
2Gemini-1.5-Pro-API-05141264+4/-437462GoogleProprietary2023/11
4Gemini-1.5-Pro-API-0409-Preview1257+3/-355731GoogleProprietary2023/11
4GPT-4-Turbo-2024-04-091257+3/-367272OpenAIProprietary2023/12
6GPT-4-1106-preview1251+2/-284091OpenAIProprietary2023/4
6Claude 3 Opus1248+2/-2135563AnthropicProprietary2023/8
6GPT-4-0125-preview1246+3/-277343OpenAIProprietary2023/12
9Yi-Large-preview1240+3/-34258401 AIProprietaryUnknown
10Gemini-1.5-Flash-API-05141230+3/-435827GoogleProprietary2023/11
11Nemotron-4-340B-Instruct1206+5/-611994NvidiaNVIDIA Open Model2023/6
11Llama-3-70b-Instruct1207+3/-2137413MetaLlama 3 Community2023/12
11GLM-4-05201208+8/-74903Zhipu AIProprietaryUnknown
11Bard (Gemini Pro)1208+7/-511853GoogleProprietaryOnline
11Yi-Large1217+7/-7710401 AIProprietaryUnknown
13Claude 3 Sonnet1201+3/-2104466AnthropicProprietary2023/8
14Reka-Core-202405011200+3/-352527Reka AIProprietaryUnknown
18Command R+1190+2/-271023CohereCC-BY-NC-4.02024/3
18Qwen2-72B-Instruct1186+4/-422401AlibabaQianwen LICENSE2024/6
18GPT-4-03141186+3/-256097OpenAIProprietary2021/9
18GLM-4-01161184+6/-77595Zhipu AIProprietaryUnknown
18Qwen-Max-04281183+4/-325685AlibabaProprietaryUnknown
19DeepSeek-Coder-V2-Instruct1179+8/-75267DeepSeek AIDeepSeek License2024/6
20Claude 3 Haiku1179+3/-295117AnthropicProprietary2023/8
24Reka-Flash-Preview-202406111167+7/-58713Reka AIProprietaryUnknown
25GPT-4-06131161+3/-380993OpenAIProprietary2021/9
25Yi-1.5-34B-Chat1160+4/-51880501 AIApache-2.02024/5
25Qwen1.5-110B-Chat1162+3/-327494AlibabaQianwen LICENSE2024/4
26Mistral-Large-24021157+3/-359780MistralProprietaryUnknown
26Reka-Flash-21B-online1156+4/-416039Reka AIProprietaryOnline
28Llama-3-8b-Instruct1152+3/-292719MetaLlama 3 Community2023/3
30Claude-11149+5/-421216AnthropicProprietaryUnknown
31Command R1148+3/-350987CohereCC-BY-NC-4.02024/3
31Mistral Medium1148+3/-335600MistralProprietaryUnknown
31Reka-Flash-21B1148+3/-425845Reka AIProprietary2023/11
32Qwen1.5-72B-Chat1147+3/-340741AlibabaQianwen LICENSE2024/2
32Mixtral-8x22b-Instruct-v0.11146+3/-341031MistralApache 2.02024/4
38Mistral-Next1124+5/-612403MistralProprietaryUnknown
38Phi-3-Medium-4k-Instruct1122+6/-414124MicrosoftMIT2023/10
38Qwen1.5-32B-Chat1125+4/-422835AlibabaQianwen LICENSE2024/2
38Zephyr-ORPO-141b-A35b-v0.11127+7/-94890HuggingFaceApache 2.02024/4
38Gemini Pro (Dev API)1131+5/-518839GoogleProprietary2023/4
38Claude-2.01131+6/-512789AnthropicProprietaryUnknown
40Starling-LM-7B-beta1119+4/-516696NexusflowApache-2.02024/3
40Claude-2.11118+4/-337745AnthropicProprietaryUnknown
41GPT-3.5-Turbo-06131117+2/-339045OpenAIProprietary2021/9
44Yi-34B-Chat1111+5/-51594601 AIYi License2023/6
44Gemini Pro1111+7/-76581GoogleProprietary2023/4
44GPT-3.5-Turbo-03141106+9/-85670OpenAIProprietary2021/9
46Mixtral-8x7b-Instruct-v0.11114+0/-069323MistralApache 2.02023/12
46Claude-Instant-11111+3/-520675AnthropicProprietaryUnknown
48GPT-3.5-Turbo-01251104+3/-362674OpenAIProprietary2021/9
48DBRX-Instruct-Preview1103+3/-433406DatabricksDBRX LICENSE2023/12
48Qwen1.5-14B-Chat1109+4/-418696AlibabaQianwen LICENSE2024/2
48WizardLM-70B-v1.01106+6/-78421MicrosoftLlama 2 Community2023/8
51Tulu-2-DPO-70B1099+5/-66674AllenAI/UWAI2 ImpACT Low-risk2023/11
51Phi-3-Small-8k-Instruct1100+4/-415309MicrosoftMIT2023/10
56OpenChat-3.5-01061091+6/-513010OpenChatApache-2.02024/1
57Llama-2-70b-chat1093+3/-339695MetaLlama 2 Community2023/7
57Vicuna-33B1090+4/-523001LMSYSNon-commercial2023/8
57Snowflake Arctic Instruct1090+3/-333849SnowflakeApache 2.02024/4
57Starling-LM-7B-alpha1088+6/-610437UC BerkeleyCC-BY-NC-4.02023/11
58Nous-Hermes-2-Mixtral-8x7B-DPO1084+8/-83840NousResearchApache-2.02024/1
58NV-Llama2-70B-SteerLM-Chat1080+10/-123640NvidiaLlama 2 Community2023/11
59Gemma-1.1-7B-it1084+4/-424027GoogleGemma license2024/2
62pplx-70b-online1077+6/-76909Perplexity AIProprietaryOnline
62DeepSeek-LLM-67B-Chat1077+8/-75000DeepSeek AIDeepSeek License2023/11
62OpenChat-3.51076+7/-58121OpenChatApache-2.02023/11
64Qwen1.5-7B-Chat1070+9/-74878AlibabaQianwen LICENSE2024/2
64OpenHermes-2.5-Mistral-7b1074+5/-85096NousResearchApache-2.02023/11
65Mistral-7B-Instruct-v0.21072+4/-420099MistralApache-2.02023/12
65GPT-3.5-Turbo-11061068+4/-617063OpenAIProprietary2021/9
65Phi-3-Mini-4k-Instruct1066+6/-519370MicrosoftMIT2023/10
65Dolphin-2.2.1-Mistral-7B1063+12/-121716Cognitive ComputationsApache-2.02023/10
66SOLAR-10.7B-Instruct-v1.01062+9/-104293Upstage AICC-BY-NC-4.02023/11
69Llama-2-13b-chat1063+5/-519769MetaLlama 2 Community2023/7
71WizardLM-13b-v1.21058+6/-77203MicrosoftLlama 2 Community2023/7
74Zephyr-7b-beta1053+6/-611345HuggingFaceMIT2023/10
74CodeLlama-70B-instruct1042+17/-151196MetaLlama 2 Community2024/1
75MPT-30B-chat1045+11/-112651MosaicMLCC-BY-NC-SA-4.02023/6
75Zephyr-7b-alpha1042+12/-141816HuggingFaceMIT2023/10
76falcon-180b-chat1033+18/-171332TIIFalcon-180B TII License2023/9
77pplx-7b-online1045+6/-66347Perplexity AIProprietaryOnline
78CodeLlama-34B-instruct1043+7/-87532MetaLlama 2 Community2023/7
79Vicuna-13B1041+4/-519833LMSYSLlama 2 Community2023/7
79Gemma-7B-it1037+6/-79207GoogleGemma license2024/2
79Phi-3-Mini-128k-Instruct1037+4/-421678MicrosoftMIT2023/10
79Llama-2-7b-chat1037+4/-414604MetaLlama 2 Community2023/7
79Qwen-14B-Chat1034+8/-105076AlibabaQianwen LICENSE2023/8
79Guanaco-33B1032+11/-133002UWNon-commercial2023/5
88Gemma-1.1-2B-it1021+6/-511391GoogleGemma license2024/2
88StripedHyena-Nous-7B1017+9/-85291Together AIApache 2.02023/12
89OLMo-7B-instruct1015+8/-86527Allen AIApache-2.02024/2
92Mistral-7B-Instruct-v0.11008+5/-69165MistralApache 2.02023/9
92Vicuna-7B1004+6/-77038LMSYSLlama 2 Community2023/7
92PaLM-Chat-Bison-0011003+8/-88758GoogleProprietary2021/6
95Gemma-2B-it989+8/-104936GoogleGemma license2024/2
97Qwen1.5-4B-Chat988+7/-67839AlibabaQianwen LICENSE2024/2
99Koala-13B964+10/-87041UC BerkeleyNon-commercial2023/4
99ChatGLM3-6B955+10/-114770TsinghuaApache-2.02023/10
100GPT4All-13B-Snoozy932+17/-151793Nomic AINon-commercial2023/3
101MPT-7B-Chat927+9/-104026MosaicMLCC-BY-NC-SA-4.02023/5
101ChatGLM2-6B924+12/-102713TsinghuaApache-2.02023/6
101RWKV-4-Raven-14B921+7/-84954RWKVApache 2.02023/4
105Alpaca-13B901+8/-85887StanfordNon-commercial2023/3
105OpenAssistant-Pythia-12B893+8/-106393OpenAssistantApache 2.02023/4
106ChatGLM-6B879+7/-135004TsinghuaNon-commercial2023/3
107FastChat-T5-3B868+9/-124311LMSYSApache 2.02023/4
109StableLM-Tuned-Alpha-7B840+11/-123347Stability AICC-BY-NC-SA-4.02023/4
109Dolly-V2-12B823+11/-123497DatabricksMIT2023/4
110LLaMA-13B799+14/-132450MetaNon-commercial2023/2