Cortisol generating machine
jonty@chaos.social
replied 01 Aug 2025 11:28 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/FfblFX8hCVSpjtGZCx
tef@mastodon.social
replied 01 Aug 2025 11:29 +0000
in reply to: https://chaos.social/users/jonty/statuses/114953270004495079
benjojo
replied 01 Aug 2025 13:12 +0000
in reply to: https://chaos.social/users/jonty/statuses/114953270004495079
@jonty and this particular instance is not actually even a big deal it just didn't manage to do a periodic scrubbing time because it was too busy shuffling data amongst itself, it's just that ceph doesn't really have "really big problem" and a " minor problem " difference... Then again, the last piece of software that I used that had that (green, orange, red) was elastic search and honestly speaking that traffic lights system status is burned right into my head as something they can go straight to hell I guess error reporting is just hard, every single data center hall I have walked through had every single router in at least some state of major/minor alarm state. My favorite is the equipment has a dedicated " catastrophic " alarm state.
dwm@mastodon.social
replied 01 Aug 2025 12:01 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/8bCM5H19qtRHylD7SP
Have had cases where an OSD would get stuck on snap removal, which then prevented scrubs from running until the OSD was restarted... But yes, Ceph's WARN state is generally, "You probably want to look at this at some point", whereas CRIT is the (thankfully rare!) state that there's something to really worry about..
benjojo
replied 01 Aug 2025 12:45 +0000
in reply to: https://mastodon.social/users/dwm/statuses/114953399166639199
bix@chaos.social
replied 01 Aug 2025 11:43 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/8bCM5H19qtRHylD7SP
hugh@social.crablab...
replied 01 Aug 2025 11:48 +0000
in reply to: https://chaos.social/users/bix/statuses/114953328305402492
benjojo
replied 01 Aug 2025 11:54 +0000
in reply to: https://social.crablab.uk/users/hugh/statuses/114953349945857467