"PrismML 称 1-bit Bonsai 27B 只需 3.9GB、在 iPhone 上达到每秒 11 token,并保留 FP16 平均分的 89.5%。这几个数字分别意味着什么?"
"PrismML says its 1-bit Bonsai 27B occupies 3.9GB, runs at 11 tokens per second on an iPhone, and retains 89.5% of FP16 performance. Here is what each