Sunk Cost sunkcost.ai Data checked 2026-09-03

What hardware do you need to run Ministral 3 8B?

Ministral 3 8B at Q4_K_M is 5.2 GB of weights, with a context ceiling of 256k tokens. Not yet rated: released after our last ratings pass. Mistral's current small model.

Cheapest machine that runs itMac mini M6, 16GB at $899
Fastest of the ones listedMac Studio M5 Ultra, 96GB — 92 tok/s at 32k context
Honest answer on costPays back in 37 years at 500k tokens a day.

How good is it, really?

On the Artificial Analysis Intelligence Index v4.3 it scores 5, which puts it in the Below every hosted tier band. Fine for simple, well-specified tasks. Noticeably less capable than anything the big labs sell today. Score source. See the whole table.

What it costs either way

Renting the same model costs $0.15 per million input tokens and $0.15 per million output (OpenRouter, cheapest active endpoint, checked 2026-09-15). Buying a machine only beats that if you use it hard enough, for long enough, that the hardware price divides down below the rental bill.

Machines that run it

MachinePriceSpeed at 32kPay-back
Mac mini M6, 16GB $899 12 tok/s estimated Pays back in 37 years Run the numbers
Strix Halo Framework Desktop, 32GB $1,269 20 tok/s estimated Pays back in 53 years Run the numbers
MacBook Air M5 (13-inch), 16GB $1,299 12 tok/s estimated Pays back in 53 years Run the numbers
MacBook Pro M5 (14-inch), 16GB $1,999 12 tok/s estimated Pays back in 82 years Run the numbers
Mac Studio M5 Max, 36GB $2,499 35 tok/s estimated Pays back in 99 years Run the numbers
DGX Spark GB10 Grace Blackwell, 128GB $4,699 21 tok/s estimated Pays back in 200 years Run the numbers

One machine per family, cheapest first. Speeds are measured where a public benchmark exists and estimated from memory bandwidth otherwise; the calculator says which for any configuration.

The specifics

Parameters
8.9B
Quantisation
Q4_K_M
Weights on disk
5.2 GB
KV cache
4.6 GB at 32k context — Mistral has dropped sliding-window attention: all 34 layers are full attention.
Maximum context
256k tokens (256k)
Licence
Apache 2.0
Sources
source 1