Neural Networks: Zero to Hero
Neural Networks: Zero to Hero A course by Andrej Karpathy on building neural networks, from scratch, in code. We start with the basics of backpropagation and build up to modern deep neural networks, like GPT. In my opinion language models are an excellent place to learn deep learning, even if your intention is to eventually go to other areas like computer vision because most of what you learn will be immediately transferable. This is why we dive into and focus on languade models. Prerequisites: solid programming (Python), intro-level math (e.g. derivative, gaussian). Learning is easier with others, come say hi in our Discord channel: Syllabus 2h25m The spelled-out intro to neural networks and backpropagation: building micrograd This is the most step-by-step spelled-out explanation…
