Leonard Greulich
The On-Device Foundation Model support released in 2.5.0 is already great!
However, adding the Private Cloud Compute Server Foundation Model would complement that perfectly, because:
  • It’s probably the most secure model for sensitive data right after offline models
  • It’s much more capable (at eye level with 70B models, instead of only 7B)
  • It’s entirely free for users
https://machinelearning.apple.com/research/introducing-apple-foundation-models
If it’s possible to integrate it, that would be really cool.
Thank you!