Travis 'Nep' Smith<p>I really like the idea of a <a href="https://mastodon.cloud/tags/noml" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>noml</span></a> meta tag in addition to <a href="https://mastodon.cloud/tags/noindex" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>noindex</span></a> nofollow, etc. </p><p>I think there could be a way added in <a href="https://mastodon.cloud/tags/robots" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>robots</span></a>.txt as well, but honestly, robots.txt was always a solution meant to minimize the amount/scope of pages a robot tries to fetch, whereas a meta-tag / x-header solution is better when you want some but not all uses of page content (i.e. the robot still ought to fetch the page) - so I'm not in a rush to modify robots.txt's spec</p><p><a href="https://mastodon.cloud/@Mojeek@mastodon.social/113078163267679409" rel="nofollow noopener" target="_blank"><span class="invisible">https://</span><span class="ellipsis">mastodon.cloud/@Mojeek@mastodo</span><span class="invisible">n.social/113078163267679409</span></a></p>