Neural Machine Translation

concepts · 2 notes linked

Related: Jay Alammar · Seq2seq · Attention Mechanism · Transformers · Synced · Attention Mechanisms · Sequence To Sequence

Notes

• A Brief Overview of Attention Mechanism — Encoder-decoder attention as context vector over all hidden states
• Visualizing A Neural Machine Translation Model (Mechanics of Seq2seq Models With Attention) — Visual walkthrough of seq2seq encoder-decoder and attention mechanism