-
Notifications
You must be signed in to change notification settings - Fork 117
Rate limit #8
Comments
What are you using in promptable? Can you share your usage? |
It should be able to handle API ratelimits and retry |
What are your thoughts on using something like this?? |
I've just discovered this repo and it is very promising. It would sooo good to have an NPM alternative of GPT Index. Thanks for the great work! My humble view: #12 looks great. But in |
Whoops! Yeah i'll update that @ymansurozer Thanks for pointing that out. Also, I'd love your input on the api you think we should make for Indexing. Want to DM me in Discord? https://discord.gg/PGVadrjm |
Happy to help! Now we need to somehow handle embedding requests that exceed 250,000 tokens in total to overcome rate limits. :) I'll DM on Discord now. @cfortuner |
@cfortuner if openai returns a retry-after header in their 429 status code we should use that for the rate limiting |
Hey just a quick update. we're still working on the right implementation here, but coming soon! |
Running into rate limit
The text was updated successfully, but these errors were encountered: