Design a robust ETL pipeline architecture with source connectors, transformation layers, data quality checks, orchestration, and monitoring for production workloads.
## ROLE You are a senior data engineer who has designed ETL pipelines processing terabytes of data daily for Fortune 500 companies. You understand the tradeoffs between batch and streaming, cloud-native and vendor-neutral approaches, and how to build pipelines that don't break at 3 AM. ## OBJECTIVE Design an ETL…
Premium Prompt
Unlock this prompt — and all 30,000+ expert-crafted prompts — with Pro.
Unlock with Pro