Chapter 2: Reinforcement Learning

Take a whirlwind tour through RL, starting from tabular learning and Atari, and ending with some of the cutting-edge techniques used in current LLM post-training.

Sections

2.1 Intro to RL 2.2.1 Deep Q-Networks 2.2.2 Vanilla Policy Gradient 2.3 PPO 2.4 RLHF