Network Requirements
Networking has the greatest impact on AIStor Server performance. Low per-host bandwidth artificially constrains the potential performance of the storage.
MinIO recommends high speed networking to support the maximum possible throughput of the attached storage (aggregated drives, storage controllers, and PCIe busses). For best performance, use 100GbE or higher networking infrastructure.
The following table provides a general guideline for the maximum storage throughput supported by a given physical or virtual network interface. This table assumes all network infrastructure components, such as routers, switches, and physical cabling, also supports the NIC bandwidth.
| NIC Bandwidth (Gbps) | Estimated Aggregated Storage Throughput (GBps) |
|---|---|
| 10Gbps | 1.25GBps |
| 25Gbps | 3.125GBps |
| 50Gbps | 6.25GBps |
| 100Gbps | 12.5GBps |
If the node host can only support 25GbE of throughput, then the read/write performance of that host can never exceed that amount regardless of the number or speed of attached drives.
RDMA
A deployment using RDMA acceleration has additional network requirements:
| Requirement | Detail |
|---|---|
| Fabric | InfiniBand (HDR or NDR) or RoCE v2 |
| NIC | An RDMA-capable adapter. NVIDIA/Mellanox ConnectX-6 or newer is recommended. |
| Losslessness | On a RoCE fabric, inter-node RDMA requires PFC end to end, DCQCN on every host NIC, and ECN with RED on every switch in the path. A lossy fabric collapses under the all-to-all erasure-write pattern. |
| Peer port | Inter-node RDMA listens on TCP port 5555 by default, set with MINIO_RDMA_PEER_PORT. Open it between cluster nodes only. |