PrismML debuts Bonsai 27B for Apple as tech giant evaluates
- Source
- CNBC
- Time
- 7:39 PM
- Weight
- 94/100
PrismML, a Silicon Valley startup spun out of Caltech, has released a highly compressed version of Alibaba’s open-source Qwen model designed to run directly on mobile devices. The new model, named Bonsai 27B, reportedly reduces memory requirements from 54 GB to less than 4 GB by simplifying how internal data is stored.
This optimization allows the 27-billion-parameter model to operate on an iPhone 15 or newer, offering faster response times and significantly lower energy consumption than standard versions. Apple is currently evaluating the technology as it seeks to move more complex artificial intelligence tasks from the cloud to local hardware.