|

Bonsai 27B: Running a 1-Bit Model on an 8GB GPU

PrismML’s Bonsai 27B squeezes Qwen 3.6 27B into roughly 4GB with 1-bit compression. How it runs on an 8GB GPU, and what compression costs.