AI Inference Podcast Summaries
AI Inference on Yedapo: 2 summarized podcast and YouTube episodes. Each includes key takeaways, core concepts and notable quotes with timestamps.
DeepSeek's Absolutely Insane AI Speed Hack
Two Minute Papers
Jul 7, 2026
DeepSeek introduces DSpark, a speculative decoding technique that pairs a high-performance 'senior' AI editor with a 'junior' writer model. By implementing memory, smart verification thresholds, and workload-aware forecasting, DSpark achieves significant speed gains without compromising accuracy. It optimizes inference by predicting which draft tokens are likely to succeed, effectively streamlining resource-heavy GPU processes.
Key insight: DSpark boosts inference speeds by 60% to 85% by predicting which draft tokens are doomed to fail, preventing the senior model from wasting compute cycles on incorrect outputs.
DeepSeek Just Solved AI's Billion Dollar Problem
Two Minute Papers
Jun 22, 2026
Dr. Károly Zsolnai-Féhér reveals that current AI systems suffer from massive underutilization because memory access bottlenecks—not processing power—cripple performance. By implementing a smart traffic-control system that redirects data streams to idle decoding hardware, researchers at DeepSeek have successfully boosted GPU utilization from 40% to 80% for complex agentic workloads.
Key insight: Modern AI systems often waste billions in hardware costs because their 'straw'—the memory bandwidth—is too narrow, leaving GPUs idling while they wait for data to read.