Table 3 AlexNet using GLOO framework or MPI framework to classify the Cifar-10.
From: Deploying and scaling distributed parallel deep neural networks on the Tianhe-3 prototype system
Communication framework | Training time (mins) |
|---|---|
MPI | 141.55 |
GLOO | 732.94 |
