Prerequisite chain
Prerequisites for Perplexity and Language Model Evaluation
Topics you need before working through Perplexity and Language Model Evaluation. Direct prerequisites are listed first; transitive prerequisites (the chain reachable through them) follow.
Direct prerequisites (3)
- Information Theory Foundationslayer 0B, tier 2
- Bits, Nats, Perplexity, and BPBlayer 3, tier 2
- Log-Probability Computationlayer 1, tier 1
Reachable through the chain (17)
These topics are not directly cited as prerequisites but are reached transitively by following the chain upward. Working through the direct prerequisites pulls these in.
- KL Divergencelayer 1, tier 1
- Common Probability Distributionslayer 0A, tier 1
- Sets, Functions, and Relationslayer 0A, tier 1
- Basic Logic and Proof Techniqueslayer 0A, tier 2
- Exponential Function Propertieslayer 0A, tier 1
- Integration and Change of Variableslayer 0A, tier 2
- Measure-Theoretic Probabilitylayer 0B, tier 1
- Cardinality and Countabilitylayer 0A, tier 2
- Kolmogorov Probability Axiomslayer 0A, tier 1
- Random Variableslayer 0A, tier 1
- Zermelo-Fraenkel Set Theorylayer 0A, tier 2
- Distance Metrics Comparedlayer 1, tier 2
- Metric Spaces, Convergence, and Completenesslayer 0A, tier 1
- Non-Euclidean and Hyperbolic Geometrylayer 1, tier 2
- Vectors, Matrices, and Linear Mapslayer 0A, tier 1
- Total Variation Distancelayer 1, tier 1
- Softmax and Numerical Stabilitylayer 1, tier 1