S3 Storage Python Packages

sqlalchemy-file

SQLAlchemy-file is a SQLAlchemy extension for attaching files to SQLAlchemy model and uploading them to various storage such as Local Storage, Amazon S3, Rackspace CloudFiles, Google Storage and others using Apache Libcloud.

django-minio-backend

Minio Backend for Django

filedepot

Toolkit for storing files and attachments in web applications

modelstore

🏬 modelstore is a Python library that allows you to version, export, and save a machine learning model to your filesystem or a cloud storage provider.

s3-parse-url

A small tool to parse URLs for S3 compatible storage services

borgstore

key/value store with nice features

nanio

What MinIO was... A minimal, stateless, S3-compatible object storage server.

apipod

Create web-APIs for long-running tasks. Job based task handling. Get the result with the job id later. FastTaskAPI creates threaded jobs and job queues on the fly. Router functionality for Runpod. Run services anywhere, be it local, hosted or serverless.

pys3uploader

Upload objects to S3

pds-data-upload-manager

Data Upload Manager (DUM) component for managing the interface for data uploads to the Planetary Data Cloud from Data Providers and PDS Nodes.

x2s3

S3 Proxy Service

flask-imagealchemy

SQLAlchemy Standarized Image Field for Flask

todus3

ToDus client for S3

article-dataset-builder

Open Access scholar PDF harvester, metadata aggregator and full-text ingester

s3dol

s3 (through boto3) with a simple (dict-like or list-like) interface

ak-django-minio-backend

Minio Backend for Django

ubarec

Universal backup and recovery using S3 repo

b-cfn-s3-large-deployment

Custom AWS CDK resource that enables larger than usual deployments to S3.

flask-s3-viewer

Flask S3 Viewer is a powerful extension that makes it easy to browse S3 in any Flask application.

etlx-wrapper

Python wrapper for ETLX CLI to run ETL workflows from Python

biblio-glutton-harvester

Open Access PDF harvester

simpledocumentstore

SimpleDocumentStore is used to store the documents on the local file system or AWS S3. This can be easily configured by sending the storage mode during the creation of the storage mode.

s3tui

A Terminal User Interface (TUI) for AWS S3 with ranger-style navigation.

theloop

A command-line utility that downloads large files directly from any URL and uploads them to an S3-compatible bucket in manageable chunks. Efficient for handling huge files without storing them locally, ensuring reliability and minimal disk usage during transfers.