Summary of Fourier Position Embedding: Enhancing Attention’s Periodic Extension For Length Generalization, by Ermo Hua et al.
Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalizationby Ermo Hua, Che Jiang, Xingtai…