Content

Chapter 0: Fundamentals Chapter 1: Transformer Interpretability Chapter 2: Reinforcement Learning Chapter 3: LLM Evaluations Chapter 4: Alignment Science

Planner Setup Instructions FAQ

RL

2.1 Intro to RL
2.2 DQN & VPG
2.2.1 DQN
2.2.2 VPG
2.3 PPO
2.4.1 RLHF
2.4.2 RLVR
2.4.3 RLAIF
2.5 MCTS & AlphaZero

In this section

Introduction
1️⃣ Coming soon

On this page

1️⃣ Coming soon

Content
RL
2.4.3 RLAIF
1️⃣ Coming soon

1️⃣ Coming soon

Select Context

Select exercise content to download as text files, or to provide as context when asking questions below.

Sections

File type

Markdown (full) Markdown (without solutions) Python Paper(s)

Visit a chapter section to download content

Ask a Question

Ask questions about the exercises. The model will use the context you've selected above to provide relevant answers.

Model:

Ask questions about the exercises...

ARENA - Alignment Research Engineer Accelerator

Web Analytics Made Easy - Statcounter

Web Analytics Made Easy - Statcounter