Corpora Blog
Engineering guides on YouTube video and audio datasets, yt-dlp at scale, proxies and bandwidth planning for multimodal AI training data.
-
Recaptioning Video Datasets: Why Caption Quality Matters
Recaptioning video datasets: why titles and ASR make poor training captions, how dense synthetic captions are built, and how to measure caption quality.
-
Video Data Curation for Generative Models: Filters That Matter
Video data curation for generative models: shot splitting, motion, OCR, aesthetic, alignment and dedup filters, in cost order, with scores you can re-threshold.
-
Why Are YouTube Downloads So Slow? A Diagnosis Guide
Find out why YouTube downloads are slow: per-connection limits, serial pipelines, proxy paths, disk and CPU. Measure correctly, then fix the real bottleneck.
-
Creative Commons YouTube Videos for AI Training: Find & Filter
Find and filter Creative Commons YouTube videos for AI training: Data API videoLicense, yt-dlp license checks, attribution records and re-check workflows.
-
yt-dlp Audio Only: Download YouTube Audio for Speech Datasets
yt-dlp audio only downloads for ASR and TTS datasets: pick bestaudio, keep native Opus or M4A, select the original track, convert to 16 kHz at train time.
-
yt-dlp Subtitles: Download YouTube Auto Captions for ASR Data
Use yt-dlp subtitles options to download YouTube manual and auto-generated captions, drop auto-translated tracks, and clean rolling VTT for ASR datasets.
-
How to Build a YouTube Video Dataset for Multimodal Training
Build a YouTube video dataset for multimodal training: metadata-first discovery, filtering, yt-dlp downloads, scene splitting, dedup, ASR, shards and lineage.
-
Download YouTube Video Datasets: Panda-70M, HD-VILA, InternVid
How to download YouTube video datasets like Panda-70M, HD-VILA-100M and InternVid from IDs and timestamps: tooling, clip cutting, storage math and link rot.
-
yt-dlp Proxy Guide: --proxy, SOCKS5, Sessions and Workers
How to use a yt-dlp proxy: --proxy URL format, socks5 vs socks5h, env vars, config files, Python API, sticky sessions, aria2c and fixing 403/407 errors.
-
yt-dlp "Sign in to confirm you're not a bot": How to Fix It
Fix yt-dlp "Sign in to confirm you're not a bot" plus 403/429 errors: update, JS runtime, PO tokens, sleep flags, cookies and IP reputation at scale.