We have a separate OOB/east-west network which is 100G and would be used for external storage. We're spending an absurd amount of money on just cables.
It is documented on the website [0], but I do see that I did not document the actual cards for that, will add when I wake up tomorrow. The card is:
Broadcom 57504 Quad Port 10/25GbE,SFP28, OCP NIC 3.0
As far as I know, AMD doesn't really have the docs, it is Dell. Their team actively helped us design this whole cluster.
We haven't decided on which type storage we want to get yet. It'll really depend on customer demand and since we haven't deployed quite yet, we are punting that can down the road a bit. Our boxes do all have 122TB in them and we have some additional servers not listed as well with 122TB... so for now I think we can cobble something useful together.
It is documented on the website [0], but I do see that I did not document the actual cards for that, will add when I wake up tomorrow. The card is:
Broadcom 57504 Quad Port 10/25GbE,SFP28, OCP NIC 3.0
As far as I know, AMD doesn't really have the docs, it is Dell. Their team actively helped us design this whole cluster.
We haven't decided on which type storage we want to get yet. It'll really depend on customer demand and since we haven't deployed quite yet, we are punting that can down the road a bit. Our boxes do all have 122TB in them and we have some additional servers not listed as well with 122TB... so for now I think we can cobble something useful together.
[0] https://hotaisle.xyz/networking/