Fig. 2: Details of the encoder/decoder modules.
From: Development of the Senseiver for efficient field reconstruction from sparse observations
This builds on the Perceiver IO architecture and adds bottlenecks in the form of dimension-reducing linear layers to decrease parameters and computational cost, which is critical for field-deployable devices such as drones. X is a generic input to a generic attention block.
