What is RLHF? Why do interviewers ask about it?

Question

Accepted Answer

RLHF (Reinforcement Learning from Human Feedback): After pre-training, humans rate model outputs → train a reward model → fine-tune LLM to prefer helpful, safe responses.