How to intergate with self model，such as tencent hunyuan, ailibaba qianwen。

[Rainmen-xia]

How to intergate with self model，such as tencent hunyuan, qianwen。

[pelikhan]

We don't support those yet. Do you know if they have an OpenAI compatible api?

[Rainmen-xia]

yes。

[pelikhan]

@Rainmen-xia #888

[pelikhan]

Alibaba was added.

[anrgct]

You can call it using OpenAI-compatible endpoints. If you want to be compatible with function calls, you need to modify the code or use fallback tools.

[pelikhan]

@anrgct are these mods for alibaba? I could enable fallback-tools automatically for those?

[anrgct]

Are these mods for Alibaba? Well, that's just my hack code because it's not fully compatible with the OpenAI format's function call modifications.
I could enable fallback-tools automatically for those? Maybe yes? I found that most models' function call capabilities are quite poor, but using fallback-tools works very well, like qwen2.5-coder-32b.

[pelikhan]

Yes we can definitely enable fallback on those.

[pelikhan]

Fix in 1.84.1

[yaonan]

The usage of Alibaba Cloud API KEY in the getting-started/configuration document is inaccurate.

The value of the environment variable ALIBABA_API_KEY should use the Bearer sk-... format instead of sk_..., otherwise, the following error will occur

genaiscript: error
LLM error (401): You didn't provide an API key. You need to provide your API key in an Authorization header using Bearer auth (i.e. Authorization: Bearer YOUR_KEY).

[pelikhan]

Thanks for pointing this out. Fix coming.

[pelikhan]

fixed in 1.86.2