Bonsai 2 fits a 27B model in 5.9GB. The average hides where it lost
中文摘要
Bonsai 2 将 27B 模型压缩至 5.9GB，体积仅为原先九分之一，却保留了 98.2% 的性能。
English Summary
Bonsai 2 compresses a 27B model to 5.9GB, retaining 98.2% of benchmark performance at one-ninth the size.
Original Excerpt
The compressed model keeps 98.2% of the original’s benchmark average at a ninth of the size. Continue reading on Generative AI »