Skip to content
EP 60 | MIT 6.036: Logistic Regression & ML as Optimization episode artwork

Oct 22, 2026 59 min

EP 60 | MIT 6.036: Logistic Regression & ML as Optimization

from AI Bites: The Academic Series Hosted by Jack Lakkapragada

Welcome to Week 4 of MIT 6.036! This week we transition from heuristic rules to the formal framework of Machine Learning as Optimization. We explore why traditional step-function loss fails calculus, introduce smooth Sigmoid probabilities, and derive the Negative Log-Likelihood loss function. Key Topics: Framing ML as Loss Minimization plus $L_2$ Regularization. Why $0\text{--}1$ Loss fails (zero gradients & NP-hardness). The Linear Logistic Classifier and the Sigmoid function ($\sigma(z)$). Deriving Negative Log-Likelihood (NLL) and cross-entropy loss. Disclaimer: Note: This is an AI-generated discussion created using Google's NotebookLM, Gemini, and other AI tools, based on the freely and publicly available MIT 6.036 - Introduction to Machine Learning course material and personal study notes.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

EP 60 | MIT 6.036: Logistic Regression & ML as Optimization

0:00 59:47

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of AI Bites: The Academic Series?

This episode is 59 minutes long.

When was this AI Bites: The Academic Series episode published?

This episode was published on October 22, 2026.

Can I download this AI Bites: The Academic Series episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.