Table 2 Neural network configuration.

From: Deploying and scaling distributed parallel deep neural networks on the Tianhe-3 prototype system

Model

Conv layers

FC layers

Dataset

LeNet

2

2

Mnist

AlexNet

5

3

Cifar-10

VGG16

13

3

Cifar-10

ResNet18

17

1

Cifar-10