Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $11.99/month.

Putting Airflow Into Production With James Meickle - Episode 43

Putting Airflow Into Production With James Meickle - Episode 43

FromData Engineering Podcast


Putting Airflow Into Production With James Meickle - Episode 43

FromData Engineering Podcast

ratings:
Length:
48 minutes
Released:
Aug 13, 2018
Format:
Podcast episode

Description

The theory behind how a tool is supposed to work and the realities of putting it into practice are often at odds with each other. Learning the pitfalls and best practices from someone who has gained that knowledge the hard way can save you from wasted time and frustration. In this episode James Meickle discusses his recent experience building a new installation of Airflow. He points out the strengths, design flaws, and areas of improvement for the framework. He also describes the design patterns and workflows that his team has built to allow them to use Airflow as the basis of their data science platform.
Released:
Aug 13, 2018
Format:
Podcast episode

Titles in the series (100)

Weekly deep dives on data management with the engineers and entrepreneurs who are shaping the industry