Gemma 2 9B
Gemma 2 9B is an open-weights AI model from Google with an index score of 97 (GPT-4 = 100), provisional.
9780–114Index scoreProvisional · results in fewer than three areas so far; not ranked yet
–Price per million tokensno public API price found
–Context windowtokens it reads at once
24 Jun 2024Released2 years 5 months ago
Where it sitson the frontier
GPT-4 reached this score 15 months earlier.
Test resultsby area · tick = best by any model
Reasoning & knowledgeevidence
Mathsevidence
Codingno evidence yet
Agentsno evidence yet
Professional workno evidence yet
Novel problemsno evidence yet
Long tasksno evidence yet
Third-party results only, at the model’s best standard setting. Hover a bar for who ran it.
What others sayrank on 7 leaderboards
LMArena · Creative writingcreative writing#240of 360 · 1259LMArena · Textoverall chat quality, judged by people#262of 362 · 1267LMArena · Instruction followingfollowing detailed instructions#263of 362 · 1245LMArena · Mathsmaths questions in chat#259of 346 · 1221Epoch Capabilities Indexoverall capability from many benchmarks#177of 231 · 112.3LMArena · Long promptslong, complex requests#264of 340 · 1266LMArena · Codingcoding questions in chat#279of 357 · 1270
Best attop three among current models
Not in the top three among current models on any category we track.
Facts and sources
Released24 Jun 2024
Announcementnot linked yet
Release entry–
Scored asGemma 2 9B
Output speed–
Hugging Facenot linked