Data Pipelines with Apache Airflow | Bas Harenslak, Julian de Ruiter

Data pipelines are at the heart of modern data engineering. Data Pipelines with Apache Airflow is a practical guide to building, managing, and maintaining reliable data pipelines using Apache Airflow. With its simple UI, plug-and-play options, and flexible Python scripting, Airflow is the go-to platform for orchestrating complex data workflows. Inside, you’ll learn how to: • Build, test, and deploy Airflow pipelines as DAGs • Automate moving and transforming data • Analyze historical datasets with backfilling • Create custom components and operators • Run Airflow in production environments Written by experienced data engineers Bas Harenslak and Julian de Ruiter, this book combines step-by-step tutorials and real-world patterns to help you master Airflow for analytics, cloud, and ML applications. Publisher: Manning Publications ISBN: 9781617296901 Essential for DevOps, data engineers, ML engineers, and sysadmins with Python skills who want to streamline their workflows and scale data processing with Airflow.