New blog post! "Where is all of the fediverse?" The fediverse is de-centralised, but it still needs to be hosted behind something, in this post I investigate where the most of the instances are, and working around caching proxies to get a better idea of how resilient to hosting disasters the ecosystem is. https://blog.benjojo.co.uk/post/who-hosts-the-fediverse-instances
ninkosan@netsplit.so..
replied 12 Jan 2024 13:10 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
@benjojo Great post, do love some stats. One question, you mention: “While I believe that Hetzner and OVH is a better pick than say, Amazon/Azure/Oracle/Google” Is there a particular reason why?
benjojo
replied 12 Jan 2024 13:14 +0000
in reply to: https://netsplit.social/users/ninkosan/statuses/111743140385578316
@ninkosan Amazon/Azure/Oracle/Google are already extremely large in modern internet presence, the more players in this space is better
ninkosan@netsplit.so..
replied 12 Jan 2024 13:16 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/cbLw2d7CyqD93669g1
@benjojo that figures, I guessed it might be from the perspective of avoiding further centralisation. Thanks for confirming 🙂
bortzmeyer@mastodon...
replied 12 Jan 2024 13:56 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
@benjojo There is also some concentration for the #DNS authoritative servers : https://www.bortzmeyer.org/nameservers-fediverse.html
benjojo
replied 12 Jan 2024 14:00 +0000
in reply to: https://mastodon.gougere.fr/users/bortzmeyer/statuses/111743322673746395
@bortzmeyer I didnt show it off on the post, but I here is also the distribution of recursive DNS providers for instances (by instance, not by user volume)
penguin42@mastodon.o..
replied 15 Jan 2024 13:51 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
@benjojo I'm surprised by so many home ISP users putting stuff behind cloudflare; is that their ISP doing that or are they doing that themselves?
benjojo
replied 15 Jan 2024 14:22 +0000
in reply to: https://mastodon.org.uk/users/penguin42/statuses/111760290802355345
@penguin42 It will be the user opting to go behind cloudflare, it does make sense, it's a anti-ddos and caching layer, both ideal properties if you are hosting on your home line
benjojo
replied 15 Jan 2024 15:46 +0000
in reply to: https://social.dev-wiki.de/users/URH/statuses/111760725390873472
karpour@mstdn.social
replied 12 Jan 2024 12:56 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
@benjojo I didn't realize Hetzner was *this* popular. Though I'm pretty happy with them and usually recommend them when people need a VPS
eloy@hsnl.social
replied 12 Jan 2024 14:17 +0000
in reply to: https://mstdn.social/users/karpour/statuses/111743085656668170
eloy@hsnl.social
replied 12 Jan 2024 13:03 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
ian@phpc.social
replied 13 Jan 2024 01:57 +0000
in reply to: https://mastodon.gougere.fr/users/bortzmeyer/statuses/111743375961347923
@bortzmeyer @benjojo I would wager that fewer rely on S3 than you'd expect, and even fewer when you account for user counts. A lot of these providers have their own S3 workalikes that are easy enough to set up, or folks can use R2, B2, or Wasabi. My guess is no single cloud storage provider has 51% like Hetz er does of compute.
tchambers@indieweb.s..
replied 12 Jan 2024 15:54 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
tchambers@indieweb.s..
replied 12 Jan 2024 19:37 +0000
in reply to: https://indieweb.social/users/tchambers/statuses/111743786366960450
@benjojo Hmmm. Then I wonder why Hetzner hosts so much of the Fediverse even when you remove Mastodon.social -- do they do managed hosting of their own for Mastodon?
tomasekeli@plud.re
replied 12 Jan 2024 19:39 +0000
in reply to: https://indieweb.social/users/tchambers/statuses/111744665074991960
@tchambers@indieweb.social @benjojo@benjojo.co.uk they're cheap, good and European. what's not to like?
ian@phpc.social
replied 13 Jan 2024 01:59 +0000
in reply to: https://indieweb.social/users/tchambers/statuses/111744665074991960
@tchambers @benjojo They don't, but a number of other large instances use them. There's another instance run my Mastodon "corporate" that's of course gonna be on Hetzner, and e.g. infosec.exchange uses them.
kazaii@noc.social
replied 12 Jan 2024 16:21 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
mirabilos@toot.mirbs..
replied 12 Jan 2024 16:37 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
@benjojo ouch! From eMail spamming I have blacklisted all of OVH and DigitalOcean, and Contabo as I see them… and people are running legit Fedi instances there? Oh my. Also, Hetzner Uffline (east german pronunciation of offline) is a running gag even among its employees, and wasn’t it OVH with the datacentre fire? While I also host on a cheap VM it’s at least a somewhat respectable provider… (plus backup with a different provider)
KuJoe@mindly.social
replied 12 Jan 2024 17:29 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
@benjojo This was an awesome post! I loved that over 30% of instances behind Cloudflare are self-hosted at home. Mindly.Social does fit into that larger percentage of users hosted at Hetzner, but that changes tomorrow once I migrate to our new host so the timing of this article is great because I'm glad to see I'm reducing the number of users hosted on a single host. 🤓
ian@phpc.social
replied 13 Jan 2024 01:59 +0000
in reply to: https://mindly.social/users/KuJoe/statuses/111744162082663651
KuJoe@mindly.social
replied 13 Jan 2024 02:19 +0000
in reply to: https://phpc.social/users/ian/statuses/111746165926965652
ian@phpc.social
replied 13 Jan 2024 02:01 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
@benjojo One potentially useful edit: pointing out "Constant" is basically exclusively Vultr (there are other brands but folks are realistically gonna use Vultr, as it's DO-ish). Also curious where folks with dedicated media hosts are putting their stuff. Guessing Bunny shows up a lot there (I know we are far from the only ones).
DarkMatterZine@masto..
replied 13 Jan 2024 06:27 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
@benjojo It’s more resilient to disasters than other platforms, like Twitter. Especially because if Musk thinks he can help eg Putin, he’ll spread disinformation. Or, like he did with Starlink, he’ll turn the damn thing off.
hugo@masto.pt
replied 13 Jan 2024 09:06 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
@benjojo Thank you for gathering and sharing this information. Love what you did to bypass the Proxies and "Getting servers to talk to you" 😂 well done!
Varpie@peculiar.flor..
replied 13 Jan 2024 09:37 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
@benjojo Great article! I'm surprised the big 3 (AWS, GCP, Azure) are so low on the list, I know that the Fediverse is overall against big tech but I still expected to see more of it.
rysiek@mstdn.social
replied 15 Jan 2024 10:59 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
@benjojo great work! One thing I am quite surprised by: on the Fediverse backend hosting providers by active users chart, Hringdu ehf. gets 1.4%, translating to over 40k active users. Thing is, Hringdu ehf. is a consumer ISP. I do not believe Hringdu offers any hosting services, nor any Internet services to actual datacenters. That's super weird!
Edent@mastodon.socia..
replied 15 Jan 2024 11:20 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/f3bf45y8btSQL6f17B
kouett@soc.kouett.ne..
replied 12 Jan 2024 12:49 +0000
in reply to: https://chaos.social/users/vidister/statuses/111743046481061922