LLM fine-tuning and generative models

Explain how large language models are fine-tuned: supervised fine-tuning, parameter-efficient methods such as LoRA, and preference tuning, with the trade-offs of each. Then compare the main families of generative models and what each is good at.