Attention

Wayformer: Motion Forecasting via Simple and Efficient Attention Networks

Efficient attention architecture for motion forecasting.

Attention & Language

Tutorial on how attention mechanism enhances language modeling.