Efficient Direct-Connect Topologies for Collective Communications

We consider the problem of distilling efficient network topologies for collective communications. We provide an algorithmic framework for constructing direct-connect topologies optimized for the latency vs. bandwidth trade-off associated with the workload. Our approach synthesizes many different top...

Full description

Bibliographic Details

Main Authors:	Zhao, Liangyu, Pal, Siddharth, Chugh, Tapan, Wang, Weiyang, Fantl, Jason, Basu, Prithwish, Khoury, Joud, Krishnamurthy, Arvind
Format:	Article
Published:	2022
Subjects:	Networking and Internet Architecture Distributed, Parallel, and Cluster Computing Machine Learning
Online Access:	https://arxiv.org/abs/2202.03356 http://arxiv.org/abs/2202.03356
Tags:	Add Tag No Tags, Be the first to tag this record!