Data Engineer Python Packages

quickstart-vdk

One framework to develop, deploy and operate data workflows with Python and SQL.

36K 481 66

vdk-core

One framework to develop, deploy and operate data workflows with Python and SQL.

4K 481 66

vdk-jupyterlab-extension

One framework to develop, deploy and operate data workflows with Python and SQL.

2K 481 66

vdk-control-cli

VDK Control CLI allows user to create, delete, manage and their Data Jobs in Kubernetes runtime.

1K 481 66

vdk-impala

One framework to develop, deploy and operate data workflows with Python and SQL.

943 481 66

vdk-trino

Versatile Data Kit SDK plugin provides support for trino database and trino transformation templates.

888 481 66

vdk-heartbeat

One framework to develop, deploy and operate data workflows with Python and SQL.

652 481 66

vdk-server

Versatile Data Kit SDK plugin that facilitates the installation of a local Control Service.

642 481 66

vdk-test-utils

One framework to develop, deploy and operate data workflows with Python and SQL.

620 481 66

vdk-plugin-control-cli

Versatile Data Kit SDK plugin exposing CLI commands for managing the lifecycle of a Data Jobs.

579 481 66

airflow-provider-vdk

Airflow provider for Versatile Data Kit.

523 481 66

vdk-ingest-http

Versatile Data Kit SDK ingestion plugin to ingest data via http requests.

504 481 66

vdk-lineage-model

One framework to develop, deploy and operate data workflows with Python and SQL.

466 481 66

vdk-kerberos-auth

One framework to develop, deploy and operate data workflows with Python and SQL.

454 481 66

vdk-control-api-auth

Versatile Data Kit plugin library provides support for authentication.

450 481 66

vdk-postgres

Versatile Data Kit SDK plugin provides support for PostgreSQL database and postgres transformation templates.

410 481 66

vdk-csv

Versatile Data Kit SDK CSV plugin to ingest, export, or manipulate csv files.

349 481 66

vdk-oracle

Support for VDK Managed Oracle connection

347 481 66

vdk-lineage

VDK Lineage plugin collects lineage (input -> job -> output) information and send it to a pre-configured destination.

333 481 66

vdk-greenplum

One framework to develop, deploy and operate data workflows with Python and SQL.

330 481 66

vdk-structlog

Structured logging for versatile data kit

329 481 66

vdk-ingest-file

Versatile Data Kit SDK ingestion plugin to ingest data into a file.

315 481 66

vdk-ipython

Ipython extension for VDK

303 481 66

vdk-notebook

One framework to develop, deploy and operate data workflows with Python and SQL.

299 481 66