Overview:

1. Pre-training and Finetuning
2. Word Embeddings
   1. Static Word Embeddings
3. Negative sampling

Content:

Pre-training and Finetuning

Word Embeddings

Notes: (Negative Sampling)