@benjojo Definitely applies to CEPH. I run CEPH on my cluster and I'd definitely recommend reading about it in the CEPF doc, trying to understand what it is doing and what it's quirks and requirements are. Also definitely read the CEPH docs for Proxmox. You don't have to become a expert, but you can experience some funnies if you don't know the basics. I have to admit though, I only use it for VM images and failover. The important stuff lives on ZFS on a seperate box.

@benjojo I remember using proxmox with a big shared storage with a cluster of nodes over multipath. Normally you use clvm to manage it and give each node a different slice, but proxmox insisted they can do that without clvm because “they have custom locking”. Obviously it didn’t work as they said and you, for example, migrate a vm to a different node just to discover that this different node nas a different idea of how volumes on the shared storage look and where’s the disk image for that vm.

@benjojo I don't know what you're talking about. EVPN to the host is premium network operations. /s