Dags Python Packages

dag-factory

Construct Apache Airflow DAGs Declaratively via YAML configuration files

astro-sdk-python

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

astro-provider-ray

This provider contains operators, decorators and triggers to send a ray job from an airflow task

burr

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

dagma

A Python 3 package for learning Bayesian Networks (DAGs) from data. Official implementation of the paper "DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterization"

gcp-airflow-foundations-dev

Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse

astro-provider-databricks

Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows

airflowctl

A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects

astro-extras

Astro SDK extras project

airflow-parse-bench

Easily measure and compare your Airflow DAGs' parse time.

gcp-airflow-foundations

Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse

custom-deferrable-dataflow-operator

Start your Dataflow jobs execution directly from the Triggerer without going to the Worker.

apache-airflow-provider-transfers

This project provides the Universal Transfer Operator to seamlessly transfer data from source to destination Datasets via a single operator invocation within DAGs.

dag-factory-hotfix

Construct Apache Airflow DAGs Declaratively via YAML configuration files

universal-transfer-operator

Universal Transfer Operator for Apache Airflow to transfer between files, tables, dataframes, apis.

airconditioner

YAML-based generic DAG builder for Apache Airflow

uto

Universal Transfer Operator for Apache Airflow to transfer between files, tables, dataframes, apis.

gcp-airflow-foundations-dev-jiny

Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse

astro-providers-databricks

Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows