Beginner
ETL Pipeline with Airflow - Pipeline
airflow data analysis techniques
Full Prompt
Build a production ETL pipeline with Apache Airflow: DAG design with task dependencies, custom operators for common operations, data quality checks using Great Expectations, incremental loading with watermark tracking, error handling and retry logic, Slack/email alerting, backfill strategy, and monitoring with Airflow metrics and logs
Tags
Works with
✨GPT-4o✨Claude 3.5 Sonnet✨GitHub Copilot✨Cursor
Beginner Rating
4.1(6,939)
Stats
3,957Views
1,358Copies
6,939Likes
1,358Saves