Support new features from DevDay

[danmou]

OpenAI just released some new features to their API, namely:

• Assistants
• Threads
• Vision input for Chat Completions
• Text to speech
• DALL-E 3 model for image generation

Here are the corresponding changes in the Python API, for reference.

[anasfik]

Hello @danmou.

I will work on new things once I get older issues fixed, if you can code implment this or anyone can from the community, I will be happy to review and merge it.

[anasfik]

After rethinking, I don't really want to invest time to implement such BETA features, since I am sure they will just move and change around after a while as it happens with the chat API and functions...

Let me know if anyone needs this really for production use. otherwise, I will be happy to review your pull requests and help with them.

[patgpt]

I would like to add the beta features to instance.
I will do my best to maintain the breaking changes.

[anasfik]

@patgpt

Cool, let me know if you got issues or questions.

[odedsolutions]

JsonMode is something worth supporting IMO and relatively super easy.

https://platform.openai.com/docs/guides/text-generation/json-mode

[anasfik]

JsonMode is something worth supporting IMO and relatively super easy.

https://platform.openai.com/docs/guides/text-generation/json-mode

It is already implmented.

[anasfik]

The dall-e-3 (model field for image methods), text-to-speech, vision input for chats and other old APIs feature changes are implemented.

[anasfik]

@patgpt
We would appreciate it if you could handle the threads and assistant new features that are in BETA.

[RockStone]

@patgpt We would appreciate it if you could handle the threads and assistant new features that are in BETA.

very much appreciate it. though in Beta, these features can come really handy if implemented 🙏🏼 wish I could help but I've not much experience 🥲

[anasfik]

Anu updates on this?

[anasfik]

if anyone is interested in working on this, these are the BETA features that I don't intend to touch until they are in alpha or stable in the API reference:

• https://platform.openai.com/docs/api-reference/assistants
• https://platform.openai.com/docs/api-reference/threads
• https://platform.openai.com/docs/api-reference/messages
• https://platform.openai.com/docs/api-reference/runs

if you want to help, please do.

[odedsolutions]

Thanks for all the progress!

[RockStone]

doesn't seem like this is going anywhere? 🥹

[peoplesdriver]

Hi,
Anybody made any progress with the Assistant API, I would really like to integrate it in my app. Thank you

[anasfik]

Hi, Anybody made any progress with the Assistant API, I would really like to integrate it in my app. Thank you

do you need it for a production app? I intend currently to support it once it gets out of BETA phase, so I can ensure I don't reimplement the same things twice.

[5hirish]

Hey y'all, looking at the assistant APIs, there is lot to be desired honestly. And hence, a lot of room for improvement. It seems highly unlikely that unofficial SDKs would take on that kinda implementation efforts when the APIs are expected to go through a lot of changes. I am building an MVP and I went ahead and implemented those APIs from scratch if anyone wants to reuse them feel free to reach out to me via Twitter or mail. I might be able to get you a head start!

[RockStone]

Hey y'all, looking at the assistant APIs, there is lot to be desired honestly. And hence, a lot of room for improvement. It seems highly unlikely that unofficial SDKs would take on that kinda implementation efforts when the APIs are expected to go through a lot of changes. I am building an MVP and I went ahead and implemented those APIs from scratch if anyone wants to reuse them feel free to reach out to me via Twitter or mail. I might be able to get you a head start!

Hi Shirish, I do need the assistant API for my app. Did you build it based on this dart_openai package or totally from scratch?

[davidmigloz]

https://pub.dev/packages/openai_dart now supports the assistant API (docs)

[anasfik]

@5hirish Thank you for helping the community out.

[anasfik]

@davidmigloz

Thank you!

[anasfik]

I knew they will deprecate things there.

Update: still waiting for a stable release for the Assistant & Threads.. APIs to have them in the package.