Gemma
Gemma is an open-weights AI model from Google, released 21 Feb 2024, with no index score yet.
–Index scoreNo third-party results yet
–Price per million tokensno public API price found
–Context windowtokens it reads at once
21 Feb 2024Released2 years 9 months ago
Where it sitson the frontier
Not plotted: no third-party score yet.
Test resultsby area · tick = best by any model
Reasoning & knowledgeevidence
Mathsno evidence yet
Codingno evidence yet
Agentsno evidence yet
Professional workno evidence yet
Novel problemsno evidence yet
Long tasksno evidence yet
Third-party results only, at the model’s best standard setting. Hover a bar for who ran it.
What others sayrank on 7 leaderboards
Epoch Capabilities Indexoverall capability from many benchmarks#185of 231 · 102.9LMArena · Mathsmaths questions in chat#313of 346 · 1121LMArena · Creative writingcreative writing#328of 360 · 1101LMArena · Codingcoding questions in chat#327of 357 · 1167LMArena · Textoverall chat quality, judged by people#332of 362 · 1138LMArena · Instruction followingfollowing detailed instructions#333of 362 · 1105LMArena · Long promptslong, complex requests#327of 340 · 1113
Best attop three among current models
Not in the top three among current models on any category we track.
Facts and sources
Released21 Feb 2024
Announcementblog.google ↗
Release entryGemma (2B/7B)
Scored asGemma 7B
Output speed–
Hugging Facenot linked