Table 2 Characteristics of heterogeneous computing resource types.

From: Attention-based workload prediction and dynamic resource allocation for heterogeneous computing environments

Resource type

Peak performance (TFLOPS)

Memory bandwidth (GB/s)

Power consumption (W)

Cost efficiency

CPU (32-core)

2.5

128

180

Moderate

GPU (V100)

14.0

900

300

High for parallel tasks

GPU (A100)

19.5

1555

400

Very high for AI workloads

TPU v4

275.0

1200

450

Optimal for transformers

FPGA

8.0

512

225

High for specific algorithms