06. Module 01 Review — Neural Networks Foundations¶
Focus: init, forward pass, backpropagation, loss functions, mini-batch SGD, activations, optimizers, regularization, scaling-law intuition.
Review loop¶
- Skim
02_explainer.mdTOC — note any chapter where you are not confident, then re-read just that chapter. - Re-answer the self-check questions in
01_weekly_plan.mdwithout looking at notes. - Re-do the hardest prompts in
04_daily_recall.mdfrom memory. - Sketch the failure-fix table from explainer §6.1 — all 11 rows — without looking.
- Review
05_hands_on_lab.mdand note one implementation bug, one design choice, and one thing you'd improve. - Try the hard exercise in explainer §6.5 (numpy XOR MLP) if you have not — confirms you can implement backprop end-to-end.
Reflection¶
- What clicked this week that previously felt abstract?
- Which part of backprop, init, or optimization still feels fuzzy?
- What should feel automatic before starting Module 02 (Tokenization & Attention)?
Completion gate¶
- [ ] All 6 explainer chapters read at least once
- [ ] Failure-fix table sketched from memory (all 11 rows)
- [ ] Weekly plan completed
- [ ] MNIST hands_on_lab shipped
- [ ] All daily-recall prompts answerable
- [ ] Ready to move to Module 02