What are the key takeaways from “How I use LLMs” on Andrej Karpathy?

What is this episode about?

Andrej Karpathy demystifies large language models by framing them as 'lossy zip files' of the internet. He demonstrates that moving beyond basic chat requires understanding context windows, tool use, and the shift toward 'thinking models' that leverage reinforcement learning to solve complex reasoning tasks.