Echelon GPU clusters need InfiniBand (or another high-speed network interconnect solution) to maximize bandwidth and minimize latency within the cluster.
Additionally, high-speed network interconnects such as InfiniBand support RDMA (Remote Direct Memory Access). RDMA technology significantly reduces latency between nodes by enabling the nodes to directly access each other’s memory, bypassing the node operating systems and CPUs.