The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
-
Updated
Jul 25, 2024 - Python
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
Declarative Continuous Deployment for Kubernetes
Machine Learning Pipelines for Kubeflow
MLops
A free and open-source tool that allows engineering teams to add visual interest to their README files through the use of customized animated GIFs.
A terminal filter to colorize output
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
XLS: Accelerated HW Synthesis
Process raw haplotagging data, from raw sequences to phased haplotypes, batteries included.
A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.
An HPC abstraction over MPI with built-in parallel compute primitives
Automatically process entire electrophysiological datasets using MNE-Python.
Modular image processing pipelines with Python. Built for Astronomy.
A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.
Documentation for Kestra — an event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
Turns Data and AI algorithms into production-ready web applications in no time.
Add a description, image, and links to the pipeline topic page so that developers can more easily learn about it.
To associate your repository with the pipeline topic, visit your repo's landing page and select "manage topics."