All Episodes

Era_of_Experience

[Research] The Era of Experience

[Product] Llama4-Natively Multimodal AI

[Nature] Google DeepMind DreamerV3

[Research] Meta MoCha

[Product] GPT-4o Native Image Generation

[Research] Gemini Robotics

[Research] GSM-∞

[Research] AI CUDA Engineer

[Research] Mixture of Block Attention

[Research] NSA

[Research] LIMO: Less is More

[Research] S1: Simple Test-Time Scaling

[Blog] Reward Hacking

[Research] Kimi K1.5

[Research] DeepSeek-R1

[Ebooks] The Founders

[Ebooks] Life After Google

[Ebooks] Cryptonomicon

[Ebooks]The Hard Thing About Hard Things

[Ebooks] The Sovereign Individual

[Ilya's reading list] Kolmogorov Complexity and Algorithmic Randomness

[Ilya's reading list] A Tutorial Introduction to the MDL Principle

[Ilya's reading list] Scaling Laws for Neural Language Models

[Ilya's reading list] Deep Speech 2

[Ilya's reading list] Neural Turing Machines

[Ilya's reading list] The Coffee Automaton

[Ilya's reading list] Relational recurrent neural networks

[Ilya's reading list] VARIATIONAL LOSSY AUTOENCODER

[Ilya's reading list] A simple neural network module for relational reasoning

[Ilya's reading list] Identity Mappings in Deep Residual Networks

[Ilya's reading list] NEURAL MACHINE TRANSLATION

[Ilya's reading list] Neural Message Passing for Quantum Chemistry

[Ilya's reading list] MULTI-SCALE CONTEXT AGGREGATION BY DILATED CONVOLUTIONS

[Ilya's reading list](ResNet)Deep Residual Learning for Image Recognition

[Ilya's reading list] GPipe

[Ilya's reading list] Order matters: sequence to sequence for sets

[Ilya's reading list] ImageNet Classification with Deep CNNs

[Ilya's reading list] Pointer Networks

[Ilya's reading list] Keeping NN Simple by MDL

[Ilya's reading list] RNN Regularization

[Ilya's reading list] Understanding LSTM Networks

[Ilya's reading list] The Unreasonable Effectiveness of RNNs

[Ilya's reading list] The First Law of Complexodynamics

[Ilya's reading list] The Annotated Transformer

[MultiModal] MAE

[MultiModal] CLIP

[MultiModal] ViT

GPT-o1

GPT-4o

GPT4

InstructGPT

BERT

GPT3

GPT2

GPT

Transformer