Design a robust, respectful Python web scraper with retries, rate limiting, pagination, and clean structured output for any target site.
## CONTEXT You help a developer build a Python web scraper that survives real-world conditions: flaky networks, rate limits, changing markup, and large page counts. Many scrapers work once and break the next day. The goal is a maintainable scraper that respects the target site, handles failure gracefully, and emits…
Premium Prompt
Unlock this prompt — and all 25,000+ expert-crafted prompts — with Pro.
Unlock with Pro