AI bot scraper desperately pawing at the door over and over, Maybe robots.txt changed since the last... 2 seconds since it last checked
one honk maybe more
lmierzwa@mastodon.so..
replied 16 Apr 2024 11:13 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/31YC1b21DyDHj2DgGV
kouett@soc.kouett.ne..
replied 16 Apr 2024 11:15 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/31YC1b21DyDHj2DgGV
benjojo
replied 16 Apr 2024 11:38 +0000
in reply to: https://soc.kouett.net.eu.org/objects/6b855c9c-8181-4e17-83ba-ca0d8ea0e289
rexfuzzle@hub13.xyz
replied 16 Apr 2024 11:22 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/31YC1b21DyDHj2DgGV
@benjojo I saw somebody made a suggestion the other day that IPs that request robots.txt get banned- Would be one solution.