Doing a bit of aliexpress safari again, and while this motherboard looks incredibly silly if you added a load of PLX PCIe switch/failover chips you would basically have a motherboard+CPU that is functionally the same as most big carrier routers
dashdsrdash@tilde.zo..
replied 21 Nov 2024 16:43 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/By8rY9Sml37w1flDcw
It looks like they designed it for the cryptocurrency market, and then repurposed it for the LLM farm market. Being good at routing is a side effect, I'm sure.
benjojo
replied 21 Nov 2024 17:06 +0000
in reply to: https://tilde.zone/users/dashdsrdash/statuses/113521946382101493
dashdsrdash@tilde.zo..
replied 21 Nov 2024 17:37 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/rBjp64LWyCf7lPpP31
benjojo
replied 21 Nov 2024 17:43 +0000
in reply to: https://tilde.zone/users/dashdsrdash/statuses/113522156197365865
@dashdsrdash Yes but this board is not useful for that. Poor PCIe bandwidth to each slot, and poor CPU (it's DDR3!) It would be terrible for training (where most of the GPUs are in use, and where all of the PCIe bandwidth possible is used), and it would be terrible for inference (where CPUs are far more power efficient etc, and if you are in the market running it with GPUs you would be PCIe bandwidth blocked, plus, DDR3)
kouett@soc.kouett.ne..
replied 21 Nov 2024 16:34 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/By8rY9Sml37w1flDcw