☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 2 months agoBonsai 27B: The First 27B-Class Model to Run on a Phoneprismml.comexternal-linkmessage-square1linkfedilinkarrow-up18arrow-down10cross-posted to: technology@midwest.socialhackernews@lemmy.bestiver.se
arrow-up18arrow-down1external-linkBonsai 27B: The First 27B-Class Model to Run on a Phoneprismml.com☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 2 months agomessage-square1linkfedilinkcross-posted to: technology@midwest.socialhackernews@lemmy.bestiver.se
minus-squareIrdial@lemmy.mllinkfedilinkEnglisharrow-up2·2 months agoI’m surprised that the model’s benchmark performance isn’t that much worse than the base given that it’s running with 1-bit quantization. Impressive.
I’m surprised that the model’s benchmark performance isn’t that much worse than the base given that it’s running with 1-bit quantization. Impressive.