Microsoft Research has been pushing the boundaries of 1-bit LLMs with its BitNet architecture. In a new paper, the researchers introduce BitNet a4.8, ...

Discover how 1-bit LLMs and extreme quantization are reshaping AI with smaller, ... BitNet’s architecture features innovations like “Bit Linear” layers, bit-packing, ...

To run such a model, the team created a runtime environment for it. The new environment is called bitnet.cpp and was designed to make the best use of the 1-bit architecture.

Microsoft’s “1‑bit” AI model runs on a CPU only, while matching larger systems Future AI might not need supercomputers thanks to models like BitNet b1.58 2B4T.