> Gemma is an open-weights AI model from Google, released 21 Feb 2024.

[Models](https://themodelindex.org/models/) /[Google](https://themodelindex.org/labs/google/)

# Gemma

Google

Released 21 Feb 2024

Open

Date verified

[Compare](https://themodelindex.org/compare/gemma-vs-gpt-4-turbo/) [Announcement](https://blog.google/innovation-and-ai/technology/developers-tools/gemma-open-models/)

–

Index score

Not yet evaluated independently

0/ 8

Core tests taken

0 of 6 areas · plus 1 anchor tests

–

Versus the frontier at release

–

Price per million tokens

no public API price found

–

Context window

tokens it reads at once

## Where it sits · on the frontier

_Chart: Model Index score of every scored model since late 2022, with the best closed and best open model over time_

GPT-4 reached this score 11 months earlier.

## Test results · by area · tick = best by any model

Show 1 anchor tests

Reasoning & knowledge

evidence

GPQA Diamond

no result

Humanity's Last Exam

no result

Maths

no evidence yet

FrontierMath T1-3

no result

Coding

no evidence yet

SWE-bench Verified

no result

Terminal-Bench

no result

Agents

no evidence yet

APEX-Agents

no result

Novel problems

no evidence yet

ARC-AGI-2

no result

Long tasks

no evidence yet

METR time horizon

no result

Independent results from the Epoch AI benchmarking hub, best reasoning setting. The core tests are shown here; anchor tests also inform the score and can be shown above.

## What others say · rank on each leaderboard

Epoch Capabilities Index

overall capability from many benchmarks

#191

of 239 · 112.0

LMArena · Maths

maths questions in chat

#340

of 373 · 1120

LMArena · Creative writing

creative writing

#354

of 386 · 1101

LMArena · Coding

coding questions in chat

#353

of 383 · 1167

LMArena · Text

overall chat quality, judged by people

#358

of 388 · 1138

Further left is better. Leaderboards measure different things: LMArena is people voting blind between two answers, the others are test scores. Click any row for the source.

## Best at · top three among current models

Not in the top three among current models on any category we track.

Where this model places in the top three of today's models, on category leaderboards and on our core tests.

## Facts and sources

Released

21 Feb 2024

Announcement

[blog.google ↗](https://blog.google/innovation-and-ai/technology/developers-tools/gemma-open-models/)

Release entry

Gemma (2B/7B)

Scored as

Gemma 7B

Artificial Analysis index

–

Output speed

–

Hugging Face

not linked

## Google releases · around this one

Gemini 1.0 Ultra

Closed

8 FEB 2024

Gemini 1.5 Pro

Closed

15 FEB 2024

Gemma

Open

21 FEB 2024

Gemini 1.5 Flash

Closed

14 MAY 2024

index 98

Gemma 2

Open

27 JUN 2024

index 97

---
Source: https://themodelindex.org/models/gemma/ · The Model Index · data as of 2026-10-01