Insane! Run Kimi K3, 2.8 Trillion Parameters, on a Single 4GB GPU
中文摘要
拥有2.8万亿参数的最大开源模型Kimi K3，竟然可以在单张4GB显卡上运行。
English Summary
The massive 2.8 trillion-parameter open-weight model Kimi K3 can remarkably run on a single 4GB GPU.
Original Excerpt
The largest open weight model ever released can run on a 4GB GPU. Continue reading on Towards AI »