home tags events about login
one honk maybe more

qwertyoruiop@nso.gro.. replied 18 Apr 2024 10:42 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/HK4XxtVln4cxq42n11

@benjojo flash for the ASIC. The x86 part doesn’t boot either so I connected the dataplane directly to another switch. Lspci indicates the asic is in ‘livefish’ mode, which is a firmware flashing mode, and it appears the whole flash is just empty. Mellanox has neat instructions on what to do in this case but unfortunately none of the files they reference are publicly available (and seem to be gated to OEMs… :() - and I assume x86 part doesn’t boot because the bios flash chip is also empty…

erincandescent@akko... replied 18 Apr 2024 11:06 +0000
in reply to: https://benjojo.co.uk/u/benjojo/h/BDc9VkBrB8c92615MS


I hope this changes in the future, as Mikrotik’s hardware price point is very competitive, it’s just the software reliability that always turns me off their products, so having an option to not use RouterOS while keeping their very competitive hardware would be a huge deal.

That hit’s hard. Not only is their price point great, their power consumption is also often one of the lowest for a given port count

But even as little as I use RouterOS it drives me nuts

electronic_eel@socia.. replied 18 Apr 2024 22:15 +0000
in reply to: https://akko.erincandescent.net/objects/98511c08-9678-4bcb-bf4d-74cf9f584efb

@erincandescent @benjojo @grawity are the switch ICs documented well enough? As far as I've seen Marvell is not exactly forthcoming with documentation about their stuff.

It wouldn't help much if you just get basic switching running and can't implement acls, igmp multicast and similar things due to those parts not being documented or part of a published driver.

nolanl@mastodon.soci.. replied 19 Apr 2024 00:12 +0000
in reply to: https://akko.erincandescent.net/objects/3026d2b7-4a78-4ca5-b799-dcaf5619876a

@erincandescent @benjojo @electronic_eel @grawity Unfortunately, despite the name, that is not actually a Prestera driver.
So called "DENT" switches have a 2nd CPU, and the firmware that driver uploads to the prestera is actually encrypted code for that CPU, which the driver then RPCs high level commands to.
Microtik switches won't have that 2nd CPU, which I usually refer to as the "GPL circumvention co-processor".

nolanl@mastodon.soci.. replied 19 Apr 2024 01:39 +0000
in reply to: https://akko.erincandescent.net/objects/d0a4193f-dd9d-4cfd-85d7-f3cd7cd539c3

@erincandescent @benjojo @electronic_eel @grawity Yeah, that is how Sparx-5 and Spectrum work.

Marvell is as NDA locked down as always. What happened here is that Amazon (or Marvell, on behalf of Amazon) used the proprietary SDK to write a driver that is driven via RPC, and then hired an outside contractor to write a switchdev driver to that RPC interface.

If the "firmware" blob wasn't encrypted, we could run it in CPU emulation and use the in-kernel driver, but alas...

equinox@chaos.social replied 20 Apr 2024 13:59 +0000
in reply to: https://akko.erincandescent.net/objects/cbfac555-8f5d-44b1-a77d-b2c780da2463

@erincandescent @benjojo @nolanl @electronic_eel @grawity

We (NetDEF, the FRR non-profit) are currently looking into this too, including trying to find an answer to how to source SparX-5 hardware. For the time being, we've ordered one of the $5k devkits… (ETA 2 months or so)

Whether we can push anything in an useful direction remains to be seen, but I'm personally vested in pushing this as far as I (and we) can.

electronic_eel@socia.. replied 20 Apr 2024 18:07 +0000
in reply to: https://mastodon.social/users/nolanl/statuses/112304636269448748

@nolanl @equinox @erincandescent @benjojo @grawity even if you do all the development work in your spare time for free, the final prices for such a switch won't go into reasonable regions unless you have substantial sales volume behind it. There won't be many people buying such a switch if it would cost something like $3k in the end.

So I think it would be much better to invest time into building a contact to those chinese manufacturers linked above or something along those lines instead of designing your own. Testing the devboard to get a feeling for the capabilites and limitations of the chipset is a commendable thing though.

On the other hand I had a peek at the Sparx-5 datasheet. I was missing things like VXLAN and support for 25G ports (they have 25G SERDES, but they are limited to 10G speeds). On something released in 2021 I would have expected those features.

nolanl@mastodon.soci.. replied 20 Apr 2024 18:25 +0000
in reply to: https://social.treehouse.systems/users/electronic_eel/statuses/112304877457200651

@electronic_eel @equinox @erincandescent @benjojo @grawity No VXLAN (and no ERSPAN) are bummers, but where did you get the idea that the 25G ports only run at 10G? The article I linked earlier has benchmarks that show the 25G ports doing better than 10G. It didn't get to 25G, but that is because the benchmark was all-ports, which ran into the total 160G total throughput limit of that part #.