Parameter Box, Parameter Hub and Parameter Link

Parameter Box for Private Clusters: Parameter Hub: High Performance Parameter Servers for Efficient Distributed Deep Neural Network Training.

Parameter Hub for Datacenters: PHub: a Rack-Scale Parameter Server for Distributed Deep Neural Network Training

Paramter Link for Public Clouds PLink: Discovering and Exploiting Locality for Accelerated Distributed Training on the public Cloud


Luis Ceze