Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

further explaination needs reader_sleep_time=12 #18

Closed
ahmadjd94 opened this issue Oct 24, 2018 · 1 comment
Closed

further explaination needs reader_sleep_time=12 #18

ahmadjd94 opened this issue Oct 24, 2018 · 1 comment

Comments

@ahmadjd94
Copy link

I have a question regarding setting the sleep interval for the subprocesses in the consumer
reader_sleep_time=12
should setting the variable actually slow down the loop (the iter overrided in the class), or does it internally set the sleep interval for the subprocess that is listening the stream?

I could not find anything regarding that in the documentation.
thanks

@borgstrom
Copy link
Contributor

Hi @ahmadjd94,

Pardon the delay on replying to this issue.

The reader_sleep_time controls how often the subprocess that reads from each shard polls the Kinesis end point. The default value of 1.0 is generally sufficient if you're the only thing reading from the shards. You would want to supply a larger value if there are multiple different systems reading from the same shards to prevent having to deal with throttling from the AWS APIs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants