Bonsai 27B: First 27B-Parameter LLM to Run on a Phone

Researchers have unveiled Bonsai 27B, a 1-bit large language model with 27 billion parameters that can operate entirely on a mobile device. By using extreme quantization, the model achieves unprecedented efficiency for its size. This breakthrough could enable advanced on-device AI applications without internet connectivity.

Sources (1)