We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Google is doing some crazy spidering. Just found 10 pages of this kinda thing pointing to my one page.
https://stats.dnagames.site/hlstats.php?mode=playerinfo&player=5&ppa_sort=obj_count&ppa_sortorder=desc&maps_sort=headshots&maps_sortorder=desc&server_sort=server&server_sortorder=desc&playerkills_page=2&obj_sort=obj_bonus&obj_sortorder=asc&playerkills_sort=name&playerkills_sortorder=desc&roles_sort=deathsTotal&roles_sortorder=desc&weap_sort=smhits&weap_sortorder=asc
Will try using rotbots.txt with:
User-agent: * Disallow: /*?*teams_sort=* Disallow: /*?*teams_sortorder=* Disallow: /*?*server_sort=* Disallow: /*?*server_sortorder=* Disallow: /*?*obj_sort=* Disallow: /*?*obj_sortorder=* Disallow: /*?*ppa_sort=* Disallow: /*?*ppa_sortorder=* Disallow: /*?*playerkills_sort=* Disallow: /*?*playerkills_sortorder=* Disallow: /*?*roles_sort=* Disallow: /*?*roles_sortorder=* Disallow: /*?*weap_sort=* Disallow: /*?*weap_sortorder=*
and also these
Disallow: /ingame.php Disallow: /show_graph.php Disallow: /sig.php Disallow: /trend_graph.php Disallow: /assets/ Disallow: /hlstatsimg/ Disallow: /includes/ Disallow: /updater/
The text was updated successfully, but these errors were encountered:
?mode=chathistory Should be blocked as well, lots of empty pages being generated.
Perhaps everything should be blocked apart from the player's pages?
Sorry, something went wrong.
✨ feat:manage search engines #62
9c3b216
DNA-styx
No branches or pull requests
Google is doing some crazy spidering. Just found 10 pages of this kinda thing pointing to my one page.
https://stats.dnagames.site/hlstats.php?mode=playerinfo&player=5&ppa_sort=obj_count&ppa_sortorder=desc&maps_sort=headshots&maps_sortorder=desc&server_sort=server&server_sortorder=desc&playerkills_page=2&obj_sort=obj_bonus&obj_sortorder=asc&playerkills_sort=name&playerkills_sortorder=desc&roles_sort=deathsTotal&roles_sortorder=desc&weap_sort=smhits&weap_sortorder=asc
Will try using rotbots.txt with:
and also these
The text was updated successfully, but these errors were encountered: