Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Auto Buy and alert of breakout or possibly breakout stocks

A Helm chart to install Apache Airflow on Kubernetes

Airflow DAGs for the Stellar ETL project

Airflow configuration for Telemetry

In this project, we developed an ETL pipeline using Apache Airflow to process delivery data and track delayed shipments. The pipeline downloads data from an AWS S3 bucket, cleans it using Spark/Spark SQL to identify missing delivery deadlines, and uploads the cleaned dataset back to S3. This ensures efficient delivery performance tracking.

Apache Airflow Website

Workflow Engine for Kubernetes

AWS Summit 2022 ASEAN --- COM203 Using IaC with Terraform to provision Big Data Platform on Amazon EMR

Production Grade Terraform for Provisioning Infrastructure

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

Common Tools Installation Files in Data Analysis, Machine Learning, and Deep Learning

Setup Airflow and Implement Some Operators Deployed on K8s

Apache Airflow - OpenApi Client for Python

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.

O objetivo deste projeto é contribuir com a formação de iniciantes que almejam entrar na área de dados, fornecendo uma visão baseada em dados sobre as habilidades e conhecimentos mais demandados pelo mercado. Através da coleta e análise de vagas de emprego/estágio, o projeto visa responder à pergunta: “Como se tornar um profissional de dados?"

A Python package to submit and manage Apache Spark applications on Kubernetes.

A flexible, configuration driven CLI for Apache Airflow local development

collection of image docker