Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

“createStream” method may lead to duplicate invocations of listeners. #173

Open
NingNing0111 opened this issue May 1, 2024 · 4 comments

Comments

@NingNing0111
Copy link

Test Code

  test('chat stream', () async {
    OpenAI.baseUrl = "https://api.openai.com";
    OpenAI.apiKey = "sk-**********";
    var createStream =
        OpenAI.instance.chat.createStream(model: "gpt-3.5-turbo", messages: [
      OpenAIChatCompletionChoiceMessageModel(
          role: OpenAIChatMessageRole.user,
          content: [
            OpenAIChatCompletionChoiceMessageContentItemModel.text("Hi!")
          ])
    ]);

    final completer = Completer<bool>();
    // Count the number of calls
    var count = 0;
    // Merge results
    var assistant = "";
    createStream.listen((event) {
      count++;
      final content = event.choices.first.delta.content;
      if (content != null) {
        assistant = assistant + content.first!.text!;
      }
    }, onDone: () {
      completer.complete(true);
      print(assistant);
      print(count);
    });
    await completer.future;
  });

Logs

Hello! How can I assist you today?Hello! How can I assist you today?Hello! How can I assist you today?Hello! How can I assist you today?Hello! How can I assist you today?Hello! How can I help you today?Hello! How can I assist you today?Hello! How can I assist you today?Hello! How can I assist you today?Hello! How can I assist you today?Hello! How can I help you today?
121

 If my processing method is incorrect, how can I correctly obtain unique values?

@anasfik
Copy link
Owner

anasfik commented May 8, 2024

I guess there was some external factor that made this function behavior, I just copied your code and runned it, and this was the response:

image

can you retry again, so you make sure if the issue is caused by the package or from the API itself

@NingNing0111
Copy link
Author

I'm currently learning to use OpenAI in Flutter. I recreated a simple demo to demonstrate how I use OpenAI in Flutter, but unfortunately, the issue still persists.

import 'dart:async';

import 'package:dart_openai/dart_openai.dart';
import 'package:flutter/material.dart';

void main() {
  runApp(const MyApp());
}

class MyApp extends StatelessWidget {
  const MyApp({super.key});
  @override
  Widget build(BuildContext context) {
    return const MaterialApp(
      home: MyHomePage(title: 'Flutter Demo Home Page'),
    );
  }
}

class MyHomePage extends StatefulWidget {
  const MyHomePage({super.key, required this.title});

  final String title;

  @override
  State<MyHomePage> createState() => _MyHomePageState();
}

class _MyHomePageState extends State<MyHomePage> {
  String _result="";
  int _count = 0;
  int _countFun = 0;

  @override
  Widget build(BuildContext context) {
    return Scaffold(
      body: Center(
        child: Column(
          mainAxisAlignment: MainAxisAlignment.center,
          children: <Widget>[
            Text(_result),
            const SizedBox(height: 50,),
            Text("Count: $_count"),
            const SizedBox(height: 50,),
            Text("Count Function: $_countFun"),
          ],
        ),
      ),
      floatingActionButton: TextButton(
        onPressed: _chatStream,
        child: Container(
          padding: const EdgeInsets.all(5),
            child: const Text("Get Stream Response")),
      ),
    );
  }

  Future<void> _chatStream() async {

    setState(() {
      // count the number of _chatStream method
      _countFun ++;
    });

    OpenAI.baseUrl = "https://api.openai.com";
    OpenAI.apiKey = "sk-****";

    var createStream =
        OpenAI.instance.chat.createStream(model: "gpt-3.5-turbo", messages: [
      OpenAIChatCompletionChoiceMessageModel(
          role: OpenAIChatMessageRole.user,
          content: [
            OpenAIChatCompletionChoiceMessageContentItemModel.text("Hi!")
          ])
    ]);
    final completer = Completer<bool>();
    // Count the number of calls
    var count = 0;
    // Merge results
    var assistant = "";
    createStream.listen((event) {
      count++;
      final content = event.choices.first.delta.content;
      if (content != null) {
        assistant = assistant + content.first!.text!;

        setState(() {
          _result = assistant;
          _count = count;

        });
      }
    }, onDone: () {
      completer.complete(true);
    });
    await completer.future;
  }
}

 In my pubspec.yaml, I only imported the dependency dart_openai.

image

 The results are shown in the figure.I am speculating whether I am handling asynchronous streams incorrectly.

@NingNing0111
Copy link
Author

image

@depombo
Copy link

depombo commented Jul 28, 2024

I am running into the same issue, were you able to find what was wrong @NingNing0111 ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants