Data Management Python Packages

dvc-data

DVC's data management subsystem

geoh5py

Python API for geoh5, an open file format for geoscientific data.

pylerc

Limited Error Raster Compression

rucio-clients

Rucio - Scientific Data Management

lerc

Limited Error Raster Compression

osfclient

A python library and command-line client for file storage on OSF

signac

Manage large and heterogeneous data spaces on the file system.

wdmtoolbox

Command line script and Python package to work with Hydrological Simulation Programs-FORTRAN (HSPF) Watershed Data Management (WDM) files.

rucio

Rucio - Scientific Data Management

rucio-webui

Rucio - Scientific Data Management

girder-import-tracker

A data management platform for the web, developed by Kitware

tpcp

Pipeline and Dataset helpers for complex algorithm evaluation.

elastro-client

A comprehensive Python library for Elasticsearch management with both programmatic and CLI interfaces

pyvelox

A composable and fully extensible C++ execution engine library for data management systems.

welly

Welly helps with well loading, wireline logs, log quality, data science

pastastore

:spaghetti: :convenience_store: Tools for managing timeseries and Pastas models

whyqd

data wrangling simplicity, complete audit transparency, and at speed

h5rdmtoolbox

Supporting a FAIR Research Data lifecycle using Python and HDF5.

biomedsheets

:books: JSON/TSV sample sheets for biomedical experiments

isatools

Metadata tracking tools help to manage an increasingly diverse set of life science, environmental and biomedical experiments

datashuttle

Tool for the creation, validation and transfer of neuroscience project folders.

sensitive-variables

strip local variables in tracebacks

rheel-data-management

Data management for python made easy

datalab-server

datalab is a place to store experimental data and the connections between them.