Add internal Apple's on-device Foundation Model integration in Tahoe
Louis Faure
Tahoe now enables access to Apple's on-device LLM from within apps (https://developer.apple.com/documentation/foundationmodels).
Integrating this model within Kerlig would be wonderful! Here is how someone has already experimented with that approach: https://github.com/gety-ai/apple-on-device-openai
Simon
It would also be good to use Apple's speech to text model to quickly dictate prompts. Apparently, the built-in, offline model in the new MacOS beta is as accurate and faster than OpenAI's whisper (https://9to5mac.com/2025/06/18/apple-devices-offer-amazing-speech-to-text-transcription-in-developer-betas-shows-test/)
anschmieg
Simon and TTS would be nice as well :)