Our state-of-the-art mixture-of-experts model is now available on the Apple app store! The OLMoE app allows anyone to test the model privately and securely on their devices.
It’s Apple’s API for hardware-accelerated machine learning. Their new devices have specialized ML hardware so it’s actually feasible to run on mobile devices. Probably what they also use for Apple Intelligence. https://developer.apple.com/documentation/coreml
Why only iPhone?
It probably uses Apple’s CoreML. Not sure if Android has an equivalent API.
https://developers.google.com/ml-kit/
Explain it pls
It’s Apple’s API for hardware-accelerated machine learning. Their new devices have specialized ML hardware so it’s actually feasible to run on mobile devices. Probably what they also use for Apple Intelligence. https://developer.apple.com/documentation/coreml
Seems like a good project to implement on the green side (Or pinguin side)
according to the linked article, it sounds like it is for performance reasons.