Request for Batches API Integration to Reduce Claude API Costs

[vasi26ro]

Hello,

Thank you for creating and maintaining the Page Assist extension! I’d like to suggest a new feature that could optimize the extension’s API usage costs when using Anthropic’s Claude model.

Feature Request:

Integrate the Batches API to reduce the cost of API calls. As Anthropic offers a 50% discount on prompt processing with Batches API, this would significantly reduce costs and make the extension more sustainable.

Benefits of the Batches API:

1. Cost-effective: Reduces prompt processing costs by 50%.
2. Scalable: Allows multiple requests to be bundled, improving API efficiency.

Let me know if I can provide any further information. Thank you for considering this suggestion!

[n4ze3m]

Hey, thank you for the feedback! Are you using the Claude API directly?

[vasi26ro]

I have tried, without success, I received a 404 error. After that I have found something about the https://github.com/open-webui/pipelines. I did not try yet.

How should I use Claude API?

[n4ze3m]

Page Assist is currently not supported for the Anthropic API format. It will be added in an upcoming version. 😊

[spj2401Dev]

I'am all for Claude support. Looking forward to it :D