Ali-Perseus: Unified and Distributed Communication Framework for Deep Learning

Design of the Universal Distributed Communication Architecture

Interface Layer

Communication Layer

Framework Layer

# For tensorflow with horovod
sed -i 's/import horovod.tensorflow as/import perseus.tensorflow.horovod as/g' model.py
# For pytorch with horovod
sed -i 's/import horovod.torch as/import perseus.torch.horovod as/g' model.py

Communication Optimization

Bandwidth Optimization

Latency Optimization

Optimal Configuration

Performance Comparison

Customer Case Study

Summary

Reference

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store