Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Resolve benchmark sporadic failure #379

Closed
seabbs opened this issue Jul 17, 2024 · 1 comment
Closed

Resolve benchmark sporadic failure #379

seabbs opened this issue Jul 17, 2024 · 1 comment
Labels
bug Something isn't working EpiAware

Comments

@seabbs
Copy link
Collaborator

seabbs commented Jul 17, 2024

See conversation in this PR #358

essentially the issue is that main and some target PRs produce output that doesn't have a judge method despite seeming to work as intended. It is unclear what could be driving this.

PRs that failed

PRs that worked

@seabbs seabbs changed the title Resolve benchmark issues Resolve benchmark sporadic failure Jul 17, 2024
@seabbs seabbs added the bug Something isn't working label Jul 18, 2024
@seabbs
Copy link
Collaborator Author

seabbs commented Jul 22, 2024

This seems to have resolved itself and have been a problem with the specific PRs we were investigating. If we start to see this again we should reopen.

@seabbs seabbs closed this as completed Jul 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working EpiAware
Projects
None yet
Development

No branches or pull requests

1 participant