Video course · 10 chapters · 27 min · certificate
Biological Learning Algorithms: Backpropagation vs Predictive Coding Explained
How might the brain learn? The credit assignment problem, why backpropagation is biologically implausible, predictive coding and its energy formalism, activity and weight update rules, the neural connectivity they need, and how the full system learns.
What you'll learn
- Explain the credit assignment problem
- Identify why backprop is biologically implausible
- Describe predictive coding
- Understand energy-based formulations
- Derive local activity and weight updates
- See how predictive coding learns as a whole
Chapters
10 chapters · 26:51-
1:15
01Intro Members
Introduction
How does the brain learn?
-
1:34
02Concepts Members
Credit assignment problem
Which weights to change?
-
3:16
03Plausibility Members
Problems with backprop
Why the brain likely doesn't use it.
-
2:02
04Theory Members
Foundations of predictive coding
Predicting the senses.
-
3:01
05Math Members
Energy formalism
One number for the state.
-
4:04
06Dynamics Members
Activity update rule
Rolling downhill.
-
2:30
07Circuits Members
Neural connectivity
Where errors live.
-
3:16
08Learning Members
Weight update rule
Local synaptic change.
-
4:17
09System Members
Putting it all together
Learning from experience.
-
1:36
10Wrap-up Members
Outro
Further learning.