Memory Bandwidth Podcast Summaries

Memory Bandwidth on Yedapo: 1 summarized podcast and YouTube episode. Each includes key takeaways, core concepts and notable quotes with timestamps.

Testing VLMs and LLMs for robotics w/ the Jetson Thor devkit
sentdex
Aug 30, 2025
The Jetson Thor devkit offers an impressive 128GB of memory at 130 watts, making it a breakthrough for edge robotics. While its memory bandwidth limits traditional high-speed compute tasks, creative techniques like pipeline parallelism allow developers to maximize its potential for local LLM and VLM inference, outperforming standard setups in power-constrained environments.
Key insight: By running multiple concurrent instances of a model, developers can bypass memory bandwidth bottlenecks to achieve higher effective frame rates and smoother performance on robotics applications.