Fig. 7: Implementation details of wavelet attention module.
From: Flight trajectory prediction enabled by time-frequency wavelet transform
Conv denotes the convolution operation. The first stage is the enhancement process, in which the trajectory embeddings obtained from the encoder are weighted by attention scores to yield enhanced scale-oriented features, i.e., enhanced trajectory embeddings. The attention scores (scorei, i = 0, 1, ⋯ , M − 1) are calculated from the trajectory embeddings to determine the importance of historical trajectory points. Further, the second stage is the convolution process, in which the enhanced trajectory embeddings are extracted into the contextual embeddings for generating wavelet components and aligned into the same temporal dimension as the corresponding wavelet components.
