Overview:

• Encoding and decoding sequences
  • RNN for Translation
  • Translation as String Completion
  • Encoder-Decoder Architecture
• Attention
  • Attention Distribution over Source Words
  • Bidirectional RNN
  • Attention and Alignment

Encoding and decoding sequence

Attention