Interesting: robots.txt, is a standard used by websites to communicate with web crawlers and other web robots.

Even more interesting: it kind of happened... by accident.

· · Web · 0 · 0 · 3
Sign in to participate in the conversation

Server run by the main developers of the project 🐘 It is not focused on any particular niche interest - everyone is welcome as long as you follow our code of conduct!