After learning to install, run and test workflows in Airflow in Part 1: Up & Running with Airflow of Workshop Track 6: Apache Airflow, the instructor, Arthur Wiedmer, will lead you through practical, hands-on training on customizing operators and hooks, best practices and more.
In part two, you’ll learn:
- More advanced patterns like dynamic tasks generation.
- How to customize operators and hooks and create your own.
- Some best practices about running Airflow in production.
Skill Level:
Intermediate - Advanced
Prerequisites:
What you should know (or have pre-installed) to get the most value.
- Good familiarity with Python. To benefit most from the workshop, having some knowledge about Python classes and subclassing will help.
- Airflow should be correctly installed with the right dependencies.
Meet Your Instructor:
Arthur Wiedmer | Data Engineer | Airbnb
Arthur Wiedmer joined Airbnb as a Data Engineer in 2014. He builds frameworks and pipelines on top of Airflow and focuses on disseminating best practices for data pipelines and data security at Airbnb as part of the Data Platform Team. He is a committer on Apache Airflow (incubating). He is @awiedmer on Twitter and @artwr on Github.
