Commit Graph

4 Commits

Author SHA1 Message Date
ghost
6f4daf7a25 update host.robotsPostfix rule 2023-04-09 02:19:07 +03:00
ghost
f4db66d53f add new host.robotsPostfix rules 2023-04-09 02:14:13 +03:00
ghost
3c9bc1adaa add required user-agent construction #5 2023-04-09 00:02:31 +03:00
ghost
b819fda025 init yggdrasil robots.txt registry #5 2023-04-08 22:29:33 +03:00