Table 2 Detailed specifications of the experimental setup for the configurations related to the transformer model.

From: Efficient memristor accelerator for transformer self-attention functionality

RRAM Array

Subarray size

128 \(\times\) 128

Cell percision

2 bit

\(R_{off}/R_{on}\)

1\(M \Omega\)/ 100\(k \Omega\)

ADC

Precision

5 bits

Shift and add

Precision

14 bits

Back to article page