New testbed installed
Since I changed jobs, I left behind a lot of my test systems, but I now have a couple of test systems set up. Here is the rather crazy set of non-chipset devices I now have in one box:
$ lspci -nn|grep -v 8086: 03:00.0 InfiniBand [0c06]: Mellanox Technologies MT25208 [InfiniHost III Ex] [15b3:6282] (rev 20) 04:00.0 Ethernet controller [0200]: Mellanox Technologies MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] [15b3:6750] (rev b0) 05:00.0 InfiniBand [0c06]: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] [15b3:673c] (rev b0) 84:00.0 Ethernet controller [0200]: NetEffect NE020 10Gb Accelerated Ethernet Adapter (iWARP RNIC) [1678:0100] (rev 05) 85:00.0 Ethernet controller [0200]: Chelsio Communications Inc T310 10GbE Single Port Adapter [1425:0030] 86:00.0 InfiniBand [0c06]: Mellanox Technologies MT25204 [InfiniHost III Lx HCA] [15b3:6274] (rev 20)
(I do have a couple of open slots if you have some RDMA cards that I’m missing to complete my collection
)
I would so love for you to take a look at bufferbloat issues in that gear….
I know bufferbloat is the trendy thing to talk about these days, but do you really think it’s an issue on networks with single-digit-microsecond latencies and 10s of Gb/sec of bandwidth?
How it interacts with other networks with 10s of ms latencies is the problem. ECN and SACK are not widely tested, and RED and other AQMs are buggy.
See papers by Kathie Nichols and Van Jacobson here:
https://lists.bufferbloat.net/pipermail/bloat/2011-February/000108.html