โ† All models
Google ยท 12B ยท Local

Gemma 4 12B the full experience

The point where most boundaries disappear. At 12B, Gemma uses every Aperio tool reliably, chains them without losing the thread, reasons through complex problems, and writes well. The question stops being "can it do this?" and becomes "what should I ask it to do next?"

Size
12B
Comfortable RAM
32 GB ideal ยท 16 GB tight
Memory used
~7โ€“8 GB
Tool calling
~95% โ€” you stop retrying
Best for
A fully capable, reliable local assistant
Avoid if
You have under 16 GB of RAM

New here? The two-minute concepts primer covers the shared jargon โ€” it isn't repeated on each model's page.

Hardware

The first model where hardware genuinely matters. Below 16 GB, use Gemma 4 e4B or Llama 3.1 8B instead. At 16 GB it runs but your machine feels it; at 32 GB it's effortless.

Set the context window in .env (32K at 32 GB; 16โ€“32K at 16 GB):

LLAMACPP_CTX=32768

Try it yourself

These tasks assume the tools work โ€” because at 12B they do, ~95% of the time. They probe depth and reliability, not whether the basics fire.

1 ยท Creative control

At 12B, creative writing crosses a threshold โ€” and stylistic instructions actually land.

Paste thisWrite a four-line poem about a cat who dreams of becoming an astronaut. Then rewrite it in the style of Dr. Seuss, and again as a solemn medieval bard.
โœ… GoodA poem that reads as written rather than assembled, then two genuinely distinct rewrites โ€” bouncing Seussian invented words, then archaic and grand. Smaller models flatten these into the same voice.
โŒ The wallThree near-identical versions with a few swapped words. (Cloud models still edge it on pure prose โ€” but for local, this is strong.)
โ†’ MeansTrust it with tone-matching and "in the style of" rewrites for real writing tasks.

2 ยท Multi-step reasoning

Holds a chain of operations together and catches the wording trap that derails smaller models.

Paste thisA book has 200 pages. On Monday I read 20% of it. On Tuesday I read 30% of the pages that were still unread. On Wednesday I read 50 more pages. How many pages are left, and what percentage of the whole book have I now read? Show every step.
โœ… GoodMonday 40 โ†’ 160 left; Tuesday 30% of 160 = 48 โ†’ 112 left; Wednesday โˆ’50 โ†’ 62 left, 69% read. The key is 30% of the remaining, not the whole.
โŒ The wallIt takes 30% of the full 200 (the trap) or skips steps to a confident wrong number.
โ†’ MeansReliable for everyday budgets, schedules and multi-step logic โ€” still worth checking high-stakes maths.

3 ยท Web research, then synthesis

At this tier you stop wondering whether it'll use the right tool โ€” it just does.

Paste thisSearch the web and tell me who won the most recent FIFA World Cup โ€” the year, the winner, and a source link.
โœ… GoodIt knows it doesn't know, calls fetch_url, and returns a clean sourced answer. No prompting to use the tool.
โŒ The wallRare at 12B โ€” an answer from stale memory with no source.
โ†’ MeansThe training cutoff stops mattering for anything answerable from the web.

4 ยท Memory it reasons over

Not whether it can store a fact โ€” whether it stores a connected picture and reasons from it in a fresh chat.

Paste thisRemember this about me: my hometown is Hirakata, my favourite season is autumn, and I'm learning piano โ€” I started in March and practise Chopin's Prelude in E minor every evening.
Then, new chatStart fresh and paste: "Based on what you remember about me, what music would I enjoy at a live concert?"
โœ… GoodIt recalls, spots the Chopin/piano detail, and reasons to a recommendation โ€” a classical recital, perhaps Debussy or Rachmaninoff. Recall + extraction + inference, working together.
โŒ The wallIt recalls the facts but suggests something generic that ignores them.
โ†’ MeansThis is what makes the memory feel like memory, not a database lookup.

5 ยท A four-tool workflow

A realistic project kickoff โ€” context, documentation, file reading, and a human-facing message in one prompt.

Paste thisI'm starting a project called "Weekend Baker." Please: (1) remember the name and that my goal is to bake one new bread recipe every Saturday; (2) write a wiki article "Weekend Baker" with an overview, three beginner recipes, and a basic equipment list; (3) read the README.md in the project directory and summarise it in one sentence; (4) write a short, encouraging message to me as a friendly baking coach.
โœ… GoodIt attempts and largely succeeds at all four, in sensible order (it may ask to approve the wiki write). The article may be simple, but every step lands.
โŒ The wallIt drops a step on a very long chain. Break into two shorter prompts if so โ€” or step up to the 30B for five-tool chains.
โ†’ MeansThis is the everyday workflow you bought the 32 GB tier for โ€” and it just works.

The verdict

Gemma 4 12B is a milestone: a local AI that remembers, reads, writes, searches and reasons reliably, with a polished voice โ€” all on your own hardware. If you have 32 GB and want the best Google-trained model locally, this is it. The model recedes into the background; the work comes forward.

Where to go next