Recommended Readings
Most of my blog posts have prerequisites stated at the beginning of the post. If you are unfamiliar with one or another, please refer to the following table for recommended readings.
I only list references that I found helpful, so it is by no means exhaustive nor objective, and you might find better references. If you do, please let me know! I update the table regularly.
| Topic | Light introduction | Deep dive |
|---|---|---|
| A/B testing | Vincent Vanhoucke's blog post on A/B testing | |
| AI alignment problem | See "Friendly AI" | See "Friendly AI" |
| AI safety | See "Friendly AI" | See "Friendly AI" |
| automatic differentiation | Ari Seff's video | |
| Bayesian statistics | MacKay | |
| classical mechanics | Landau and Lifshitz | |
| convex optimization | Intelligent Systems Lab's video | |
| deep implicit layers | The NeurIPS 2020 tutorial | |
| finite factored sets | Scott Garrabant's lecture | |
| friendly AI | Bostrom Eliezer Yudkowski's presentation | Leike et al. Everitt et al. alignmentforum.org * |
| functional decision theory | Yudkowski and Soares | |
| game theory | Leyton-Brown and Shoham * | |
| Gaussian processes | David MacKay's lecture (slides and alternative upload here) | Rasmussen and Williams * |
| information theory | MacKay | |
| integral equations | Wazwaz * | |
| LSTMs | Christopher Olah's blog post | |
| model compression | Sam Sučík's blog post | |
| neural differential equations | Kidger * | |
| neural networks | 3blue1brown’s series of videos | Roberts, Yaida, and Hanin Off the Convex Path blog * |
| neural processes | Garnelo et al. | |
| object-oriented programming | Graham's blog post | |
| reinforcement learning | David Silver's lecture series Berkley deep reinforcement learning lecture series* | Sutton and Barto |
| relativity | Einstein's wonderful nearly-equation-free book | Wald Misner et al. Penrose and Rindler |
| transformers | Dinan, et al. | |
| writing | George Orwell's essay John Wentworth's post on quick and rigorous writing Michael Nielsen's post on Discovery Fiction | Douglas |
Sources with a “*” are those which I have read only partially.