quant.cpp

WASM
GitHub

Run an LLM in your browser

No install. No API key. No server.

Llama 3.2 1B Instruct
~770 MB · Better quality
Quality

or load your own GGUF · runs 100% client-side