TALECRAFTERS
GLOSSARY · MODELS · SYSTEMS

QUANTISATION

Storing a model’s weights at lower numeric precision so it runs on smaller hardware, at some cost to output quality.

ALSO CALLEDquantizationmodel compression

A model held at eight or four bits per weight instead of sixteen takes far less memory and runs on far cheaper hardware. For a studio running anything locally, this is the difference between one workstation and a rack.

The quality cost is real but non-linear. Moderate quantisation is often visually indistinguishable; aggressive quantisation shows up first in exactly the places that matter, meaning fine detail, small text and subtle colour.

If you run local inference, record the quantisation level alongside the model version. Two operators running the same model at different precisions will produce a set that does not match, and nobody will guess why.

QUESTIONS PEOPLE ASK

Does quantisation change the output?

Yes, subtly, and first in fine detail, small text and colour subtlety. Moderate levels are often invisible; aggressive levels are not.

Why record the quantisation level?

Because two operators running the same model at different precisions produce sets that do not match, and it is close to undiagnosable unless it was written down.

THEORY IS FREE

Knowing the word is the cheap part.

Running it on a deadline, at volume, without burning the budget is the expensive part. That is the bit we do.

BRIEF US