Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Report error in scanMirrors #241

Open
rgaudin opened this issue Mar 21, 2023 · 0 comments
Open

Report error in scanMirrors #241

rgaudin opened this issue Mar 21, 2023 · 0 comments

Comments

@rgaudin
Copy link
Member

rgaudin commented Mar 21, 2023

I am not sure how frequent and in under which circumstances but scanning a mirrorbrain mirror can fail.
Obviously, we don't want to halt the scanning process (because currently it loops over each folder over each mirror sequentially – could be different though) but we should at least report somehow that something went wrong.

This is following wikimedia mirror changing its URL (HTTP 301) without informing us, leading to scans all failing for wikimedia, disabling this major mirror in mirrorbrain ; thus increasing traffic to other mirrors ; (at least one) of which disabled itself as unable to respond to this increased traffic.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant