Skip to content

Commit

Permalink
Update robots.txt
Browse files Browse the repository at this point in the history
  • Loading branch information
danon committed Dec 27, 2023
1 parent 8817a51 commit dce34eb
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion public/robots.txt
Original file line number Diff line number Diff line change
Expand Up @@ -2,13 +2,17 @@ User-agent: *
Allow: /
Disallow: /User/
Disallow: /Szukaj/
Disallow: *Search?q=*
Sitemap: https://4programmers.net/sitemap

User-agent: AhrefsBot
Disallow: /

User-agent: proximic
Disallow: /

User-agent: Baiduspider
Disallow: /

User-agent: sentibot
Disallow: /
Disallow: *Search?q=*

0 comments on commit dce34eb

Please sign in to comment.