Skip to main content

Airflow 2.0 on docker-compose

· 4 min read

So you heard of the brand new Airflow 2.0 and want to run it on your own machine to give it a go.

Sadly, the getting started isn’t nearly ready for an integration environment as it neglects most of the interesting components and features like multiple workers to distribute tasks.

Don’t worry I have you covered.

Kubernetes Cronjob 101: part 1

· 9 min read

In this article I will try to explain with some specific examples how to run Cronjob on Kubernetes.

Cronjob are basically Kubernetes jobs with a scheduling and some specific parameters to handle failure. Each Kubernetes job contains 1 to n pod.

Those pods runs a program defined for the task and are killed when the task is over.