Parameter Box for Private Clusters: Parameter Hub: High Performance Parameter Servers for Efficient Distributed Deep Neural Network Training.
Parameter Hub for Datacenters: PHub: a Rack-Scale Parameter Server for Distributed Deep Neural Network Training
Paramter Link for Public Clouds PLink: Discovering and Exploiting Locality for Accelerated Distributed Training on the public Cloud