ETL Pipeline with Airflow

Build a production ETL pipeline with Apache Airflow: DAG design with task dependencies, custom operators for common operations, data quality checks using Great Expectations, incremental loading with watermark tracking, error handling and retry logic, Slack/email alerting, backfill strategy, and monitoring with Airflow metrics and logs