1.Previous
3.Next

Fine-tuning can be combined with a reinforcement learning from human feedback-based objective to produce language models such as ChatGPT (a fine-tuned version of GPT models) and Sparrow.

Robustness

Fine-tuning can degrade a model's robustness to distribution shifts.

1.Previous
3.Next