Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix usage in ChatResponse metadata when tool calling is used #1843

Open
1 of 10 tasks
ilayaperumalg opened this issue Nov 28, 2024 · 0 comments
Open
1 of 10 tasks

Fix usage in ChatResponse metadata when tool calling is used #1843

ilayaperumalg opened this issue Nov 28, 2024 · 0 comments
Assignees
@ilayaperumalg
Labels
bug Something isn't working epic
Milestone
1.0.0-M5

Comments

@ilayaperumalg
Copy link
Member

When the tool calling is used, the Chat Model's Chat response metadata doesn't accumulate the usage metrics (accumulated prompt, chat completion and total tokens) from all the Chat responses involved - including the tool calling.

This epic addresses the fix needed for all the supported models.
@ilayaperumalg ilayaperumalg added bug Something isn't working epic labels Nov 28, 2024
@ilayaperumalg ilayaperumalg added this to the 1.0.0-M5 milestone Nov 28, 2024
@ilayaperumalg ilayaperumalg self-assigned this Nov 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ilayaperumalg ilayaperumalg

Labels
bug Something isn't working epic
Projects
None yet
Milestone
1.0.0-M5
Development

No branches or pull requests
1 participant
@ilayaperumalg