@dajbelshaw @rysiek There already seems to be a delay before fetching previews, dunno whether it is an explicit one or just the result of the action landing in the back of my sidekiq queue and needing some time to be at the front.
But spreading preview fetches over a short time frame helps cutting the spikes. @Gargron
@Gargron that said, at some point a conversation might need to happen on how to stop fedi from accidentally becoming a distributed denial of service tool.
400 requests in a few short minutes is something that *could* already cause some issues for some poorly configured sites. And fedi is growing.
It is not out of the realm of possibility that in a year or two it grows to a level where posting a link can bring most WordPress sites down for a few minutes.
With deniability ("I was only sharing).
@rysiek It's not rare to see "temporary overload" type messages from web sites that have been linked from the Fediverse. Usually takes 10 to 15 minutes until the worst of the storm is over.
Personally, I'd really like to be able to disable link preview fetching on my instance - they also take up a sizable chunk of storage on my side.
Otherweise, maybe distribute link previews as actual media from the originating instance and have others fetch just the page title for verification?
@rysiek @Gargron I guess it's safe as long as we're talking about a few hundreds in few minutes, not seconds. And even then disruption will be only temporary. But if it is really a problem, maybe it's worth to report an issue? Fediverse probably could somehow fetch preview once and share it internally.
Server run by the main developers of the project It is not focused on any particular niche interest - everyone is welcome as long as you follow our code of conduct!