Overview:

In-Context Learning — Downsides

Fine-Tuning → Parameter Efficient Fine-Tuning