Storage Python Packages

hf-xet

xet client tech, used in huggingface_hub

databento-dbn

Databento Binary Encoding (DBN) - Fast message encoding and storage format for market data

pypowerstore

Python library for Dell PowerStore

opendal

Apache OpenDAL: One Layer, All Storage.

gcp-storage-emulator

Local emulator for Google Cloud Storage

pytest-servers

Create temporary directories on the various filesystems for testing

rucio-clients

Rucio - Scientific Data Management

fs-gcsfs

Google Cloud Storage filesystem for PyFilesystem2

s3shutil

Pythonic copy, move and sync for Amazon S3

kinto

A generic JSON document store with sharing and synchronisation capabilities.

django-s3file

A lightweight file upload input for Django and Amazon S3

rucio

Rucio - Scientific Data Management

rgwadmin

Ceph Object Storage Admin API python library bindings.

fundrive

云存储驱动工具包 - 支持多种云存储服务的统一接口

st-supabase-connection

An easy-to-use Supabase connector for Streamlit that caches your API calls to make querying fast and cheap.

rucio-webui

Rucio - Scientific Data Management

televault

Unlimited cloud storage using Telegram MTProto. No local DB - everything on Telegram.

excludarr

Excludarr manages your libraries in Radarr/Sonarr. It keeps track of your library and checks if your movies and series are also available on a configured streaming provider. It can exclude the movies and series that are available on a configured streaming provider. But it can also re-add movies and series if they are not streaming anymore.

datago

A natively parallel dataloader for Python, written in Rust. Serving data at GB/s speeds, while covering aspect ratio bucketing, crop and resize for image ML workloads.

blivet

A python module for configuration of block devices

file-keeper

Abstraction layer for reading, writing and managing file-like objects.

django-webdav-storage

A Django storage backend allowing you to easily save user-generated and static files into your own WebDAV storage rather than a local filesystem, as Django does by default

bahub

Backup storage for E2E GPG-encrypted files, with multi-user, quotas, versioning, using a object storage (S3/Min.io/GCS etc.) and deployed on Kubernetes or standalone.

django-anchor

Attach files to Django models, inspired by Ruby on Rails' Active Storage.