web scraping Podcast Summaries
web scraping on Yedapo: 7 summarized podcast and YouTube episodes. Each includes key takeaways, core concepts and notable quotes with timestamps.
Ernie 5.1 Web Scraping That Actually Works
Eric Tech
Jul 11, 2026
Traditional web scraping often breaks with website changes, demanding constant parser rewrites. This episode reveals how Ernie 5.1, compatible with the OpenAI SDK, creates a universal AI data pipeline, transforming messy HTML into clean, database-ready JSON efficiently and cost-effectively for large-scale applications.
Key insight: Ernie 5.1's "dialogue prefix continuation" feature ensures models output pure JSON without conversational text, crucial for production systems and seamless integration into applications.
They'll Fly You to Vegas if You Win This Coding Challenge
Tech With Tim
Jun 13, 2026
A developer project tutorial reveals how to combine Bright Data's scraping tools with RAG architectures to build specialized AI applications. Participants can win a VIP trip to Las Vegas by creating projects that analyze BattleBots data.
Key insight: You can force AI models to return structured JSON responses that map directly to UI components using response schemas, enabling consistent data visualization from LLM outputs.
Web Scraping for Beginners – Extract Data with an API
freeCodeCamp.org
Jun 8, 2026
Anna Kubo demonstrates how to bypass common web scraping barriers like CAPTCHAs and rate limits by using the SERP API. The tutorial guides viewers through building a fully functional web app that fetches, displays, and downloads short-form video content locally.
Key insight: You can offload the entire burden of proxy management and CAPTCHA solving to an API like SERP, which returns clean JSON data directly to your application.
Web Scraping with Python & JavaScript – MERN Stack Full Course
freeCodeCamp.org
May 29, 2026
This course demonstrates how to build production-grade web scrapers using Node.js, React, and Python while bypassing sophisticated anti-bot defenses. It highlights leveraging Evomi’s Scraper API and Residential Proxy infrastructure to extract data from high-friction targets like Amazon and the Tiobe Index at scale.
Key insight: Anti-bot systems track behavioral signals like mouse movement, request intervals, and IP stability; bypassing them effectively requires tools that mimic genuine residential user fingerprints rather than just rotating IPs.
Claude Code + Playwright Automates Literally Anything
Nate Herk | AI Automation
Apr 25, 2026
Pairing AI coding assistants with CLI browser tools transforms rigid scripts into self-healing agents. The host demonstrates how AI can autonomously QA test code, bypass scraper blocks, and manage authenticated community interactions.
Key insight: Using Playwright CLI instead of standard MCP servers saves massive amounts of context tokens, allowing the AI to retain longer memory for complex agentic loops.
Cara web scraping data di balik Login Form (Python)
Sekolah Koding
Apr 30, 2025
Mengakses data di balik sistem login membutuhkan pemahaman mendalam tentang manajemen sesi dan penanganan token CSRF. Dengan menggunakan pustaka 'requests' di Python dan objek sesi, Anda dapat mengotomatisasi proses login untuk mengambil konten dari halaman yang terproteksi.
Key insight: Mengirimkan token CSRF secara manual tidak akan berhasil karena token tersebut dinamis; Anda harus menggunakan objek 'session' untuk mempertahankan status dan validitas token di antara permintaan HTTP.
Belajar web scraping - spoofing headers
Sekolah Koding
Apr 26, 2025
Website sering memblokir request bot dengan mendeteksi asal sumber. Trik header spoofing memungkinkan Anda memanipulasi data header agar request terbaca seolah-olah berasal dari browser asli.
Key insight: Anda bisa menemukan header yang dibutuhkan website target dengan membuka tab 'Network' di menu 'Inspect' browser saat halaman dimuat ulang.
