A tool for fighting web crawler and LLM's ignoring the robots.txt file.Fight back!
https://zadzmo.org/code/nepenthes/
Mastodon is the best way to keep up with what's happening.
Follow anyone across the fediverse and see it all in chronological order. No algorithms, ads, or clickbait in sight.