Gradient Descent, Step-by-Step

Gradient Descent is the workhorse behind most of Machine Learning. When you fit a machine learning method to a training dataset, you're probably using Gradient Descent. It can optimize parameters in a wide variety of settings. Since it's so fundamental to Machine Learning, I decided to make a...

Beginner - 24 min - AI & Data - StatQuest with Josh Starmer

The full course: Learn Math for ML free

What you'll need

• Laptop stand: Screen at eye level for long study sessions.
• Noise-cancelling headphones: Focus through long video lessons.
• Second monitor: Video on one screen, practice on the other.
• Wireless keyboard and mouse: Comfortable for hours of typing.

Books

1. Mathematics for Machine Learning by Marc Peter Deisenroth - View on Amazon
2. Naked Statistics by Charles J. Wheelan - View on Amazon
3. Practical Statistics for Data Scientists by Peter Bruce - View on Amazon
4. The Art of Statistics by David Spiegelhalter - View on Amazon
5. The Elements of Statistical Learning by Trevor Hastie - View on Amazon

Next lessons

• But what is a convolution? (23 min, 3Blue1Brown, Beginner)
• But what is the Fourier Transform? A visual introduction. (20 min, 3Blue1Brown, Beginner)
• How (and why) to take a logarithm of an image (45 min, 3Blue1Brown, Intermediate)
• Simulating an epidemic (23 min, 3Blue1Brown, Intermediate)
• But what are Hamming codes? The origin of error correction (20 min, 3Blue1Brown, Intermediate)
• Divergence and curl: The language of Maxwell's equations, fluid flow, and more (16 min, 3Blue1Brown, Intermediate)
• Solving Wordle using information theory (31 min, 3Blue1Brown, Intermediate)
• Taylor series | Chapter 11, Essence of calculus (22 min, 3Blue1Brown, Intermediate)