Error: "you must provide a model parameter"

[carlos666a]

Hi team, I had encountered a error when upgrade to 3.11, since it don’t support a ali provider, so pervious I was use huggingface instead, but now it failed. "{“error”:{“message”:"you must provide a model parameter. “,“type”:“invalid_request_error”,“param”:null,“code”:null},“request_id”:“c78e4cc9-b284-919c-b32c-441296bff6f6”}”, This is my config:

[Wangchong_Zhou]

Hi @carlos666a , based on the documentation, the compatible interface is OpenAI instead of huggingface. So you would need to use the openai provider instead of huggingface.
Huggingface has deprecated some of their old API and thus Kong has also updated the format conversion, previously it was just working coincidently.

[carlos666a]

Thanks, it works now. Btw, now we are request to the same endpoint and route with model name which in header, if any better method about route by model name but in request body?