Add Cerebras-specific Support (Need to Strip Unsupported OpenAI API Features)
H
Harsha K
Hello!
Cerebras is a ridiculously fast provider that has a very generous free tier, which would make it great for Spelling/Grammar fixes.
It supports the OpenAI API spec
partially
; the catch is that it does not
support the following fields:- frequency_penalty
- logit_bias
- presence_penalty
- parallel_tool_calls
- service_tier
Those have to be stripped out of the API request that you make, otherwise it fails. Can you add Cerebras as a default provider and make the changes it needs?
Pramod J
+1 on this. Cerebras isn't working with Kerlig right now. It is my go-to service provider these days, as they have a generous free tier, and a service that is 4x faster than Groq. Jarek Ceborski, any chance Cerebras can be made a first class citizen in Kerlig's service providers?