Where this topic leads

Topics that build on Policy Optimization: PPO and TRPO

Once you have Policy Optimization: PPO and TRPO, these are the topics that cite it as a prerequisite. Pick by tier and the area you want to push into next.

Editor's suggested next (2)

DPO vs GRPO vs RL for Reasoning
Post-Training Overview

Standard topics (2)

DPO vs GRPO vs RL for Reasoninglayer 5 · llm-construction
Post-Training Overviewlayer 5 · llm-construction