Bigdata Python Packages

fastwarc

A robust web archive analytics toolkit

resiliparse

A robust web archive analytics toolkit

uproot

ROOT I/O in pure Python and NumPy.

pybloom-live

Scalable Bloom Filter implemented in Python

uproot3

ROOT I/O in pure Python and NumPy.

cuallee

Possibly the fastest DataFrame-agnostic quality check library in town.

timehash

An algorithm for creating user configurable, variable-precision sliding windows of time. Useful for binning time values in large collections of data.

legend-pydataobj

LEGEND Python Data Objects

rayforce-py

High-performance and powerful Python DataFrame library built on top of RayforceDB

uproot4

ROOT I/O in pure Python and NumPy.

optimuspyspark

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

pysparkgateway

Connect to remote Spark clusters seamlessly.

visualpython

Visual Python is a GUI-based Python code generator, developed on the Jupyter Notebook as an extension.

athenacli

AthenaCLI is a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.

databend

Data Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. — rebuilt from scratch. Unified architecture on your S3.

quantms-utils

A python library with scripts and helpers classes for quantms workflow

airavata-django-portal-sdk

Apache Airavata Django Portal SDK

jupyterlab-visualpython

GUI-based Python code generator for data science, extension to Jupyter Lab, Jupyter Notebook and Google Colab.

bigartm

Fast topic modeling platform

pyoptimus

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

ukv

Python bindings for Unum's UStore.

hadeploy

An Hadoop Application Deployment tool

datafaker

Datafaker is a large-scale test data and flow test data generation tool. Datafaker fakes data and inserts to varied data sources. 测试数据生成工具

arvados-tools

A single package to install all Arvados client tools