[Done] Add Cerebras-specific Support (Need to Strip Unsupported OpenAI API Features)
complete
H
Harsha K
Hello!
Cerebras is a ridiculously fast provider that has a very generous free tier, which would make it great for Spelling/Grammar fixes.
It supports the OpenAI API spec
partially
; the catch is that it does not
support the following fields:- frequency_penalty
- logit_bias
- presence_penalty
- parallel_tool_calls
- service_tier
Those have to be stripped out of the API request that you make, otherwise it fails. Can you add Cerebras as a default provider and make the changes it needs?
Jarek Ceborski
complete
H
Harsha K
What a wonderful surprise this morning! Thank you so much, Jarek :)
Pramod J
Thanks a lot for implementing this feature Jarek!
Jarek Ceborski
It's released in Kerlig v2.4.0
H
Harsha K
Bumping my request again.
g
ghani
I came to make a request.
Thank you.
Pramod J
+1 on this. Cerebras isn't working with Kerlig right now. It is my go-to service provider these days, as they have a generous free tier, and a service that is 4x faster than Groq. Jarek Ceborski, any chance Cerebras can be made a first class citizen in Kerlig's service providers?