Recommended Readings

Most of my blog posts have prerequisites stated at the beginning of the post. If you are unfamiliar with one or another, please refer to the following table for recommended readings.

I only list references that I found helpful, so it is by no means exhaustive nor objective, and you might find better references. If you do, please let me know! I update the table regularly.

TopicLight introductionDeep dive
A/B testingVincent Vanhoucke's blog post on A/B testing
AI alignment problemSee "Friendly AI"See "Friendly AI"
AI safetySee "Friendly AI"See "Friendly AI"
Bayesian statisticsMacKay 
classical mechanicsLandau and Lifshitz 
finite factored setsScott Garrabant's lecture
friendly AIBostrom
Eliezer Yudkowski's presentation
Leike et al. 
Everitt et al. *
functional decision theoryYudkowski and Soares 
game theoryLeyton-Brown and Shoham *
Gaussian processesDavid MacKay's lecture (slides and alternative upload here)Rasmussen and Williams  *
information theoryMacKay 
LSTMsChristopher Olah's blog post
neural networks3blue1brown’s series of videosOff the Convex Path blog *
Saxe et al. 
neural processesGarnelo et al. 
object-oriented programmingGraham's blog post
reinforcement learningDavid Silver's lecture series
Berkley deep reinforcement learning lecture series*
Sutton and Barto 
relativityEinstein's wonderful nearly-equation-free book Wald 
Misner et al. 
Penrose and Rindler 
writingGeorge Orwell's essayDouglas 

Sources with a “*” are those which I have read only partially.


Saxe, A. M., McClelland, J. L. & Ganguli, S. A mathematical theory of semantic development in deep neural networks. arXiv:1810.10531 [cs, q-bio, stat] (2018).
Douglas, Y. The Reader’s Brain: How Neuroscience Can Make You a Better Writer. (Cambridge University Press, 2015).
Wald, R. M. General relativity. (University of Chicago Press, 1984).
Misner, C. W., Thorne, K. S. & Wheeler, J. A. Gravitation. (W. H. Freeman, 1973).
Einstein, A. Relativity : the special and general theory. (2005).
Penrose, R. & Rindler, W. Spinors and space-time. vol. 1 (Cambridge University Press, 1984).
Landau, L. D. & Lifshitz, E. M. Mechanics. (Elsevier, 1982).
Leyton-Brown, K. & Shoham, Y. Essentials of Game Theory: A Concise Multidisciplinary Introduction. Synthesis Lectures on Artificial Intelligence and Machine Learning 2, 1–88 (2008).
Rasmussen, C. E. & Williams, C. K. I. Gaussian processes for machine learning. (MIT Press, 2008).
Everitt, T., Lea, G. & Hutter, M. AGI Safety Literature Review. arXiv:1805.01109 [cs] (2018).
Bostrom, N. Superintelligence: paths, dangers, strategies. (Oxford University Press, 2014).
Leike, J. et al. Scalable agent alignment via reward modeling: a research direction. arXiv:1811.07871 [cs, stat] (2018).
Garnelo, M. et al. Neural Processes. arXiv:1807.01622 [cs, stat] (2018).
Sutton, R. S. & Barto, A. G. Reinforcement Learning: An Introduction.
Yudkowsky, E. & Soares, N. Functional Decision Theory: A New Theory of Instrumental Rationality. arXiv:1710.05060 (2017).
MacKay, D. J. C. Information Theory, Inference, and Learning Algorithms. (Cambridge University Press, 2003).