You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, the OpenAiClient::chat_completions method returns a stream of sse::Event messages when stream: true, as opposed to deserializing the events to ChatCompletionChunks as we are passing them through to the client directly. As we will need to apply detections on the chunks, this needs to be changed to the latter.
Acceptance Criteria
ChatCompletionsResponse::Streaming variant receiver type is updated to mpsc::Receiver<Result<ChatCompletionChunk, Error>>
OpenAiClient::chat_completions deserializes SSE event data to ChatCompletionChunk and maps errors to client::Error
Orchestrator::handle_chat_completions_detection is updated accordingly
The text was updated successfully, but these errors were encountered:
Description
Currently, the
OpenAiClient::chat_completions
method returns a stream ofsse::Event
messages whenstream: true
, as opposed to deserializing the events toChatCompletionChunk
s as we are passing them through to the client directly. As we will need to apply detections on the chunks, this needs to be changed to the latter.Acceptance Criteria
ChatCompletionsResponse::Streaming
variant receiver type is updated tompsc::Receiver<Result<ChatCompletionChunk, Error>>
OpenAiClient::chat_completions
deserializes SSE event data toChatCompletionChunk
and maps errors toclient::Error
Orchestrator::handle_chat_completions_detection
is updated accordinglyThe text was updated successfully, but these errors were encountered: