Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug Fix] Add missing sync_progress call for parallel play #1703

Merged
merged 1 commit into from
Sep 18, 2024

Conversation

QuantuMope
Copy link
Contributor

Noticed a bug where certain schedulers had their progresses set to 0 incorrectly when --parallel_play > 1. After debugging, I found that this only occurred for process specific code (e.g., tasks) and did not affect the main process's schedulers (e.g., DeltaControl). Furthermore, when setting parallel_play to 0, all schedulers were properly set, which heightened my suspicion of there being a syncing issue when creating parallel processes.

This PR solves this issue by adding an env_sync_progress() call before the play loop starts. Now, all process-specific schedulers are properly initialized and parallel_play works as expected.

Copy link
Contributor

@emailweixu emailweixu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I should have mentioned this earlier. I vaguely thought this might be related, but somehow didn't talked about it.

@QuantuMope QuantuMope merged commit 26acfad into pytorch Sep 18, 2024
2 checks passed
@QuantuMope QuantuMope deleted the PR/andrew/fix-parallel-play branch September 18, 2024 22:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants