Multimodality Python Packages

fedot

Automated modeling and machine learning framework FEDOT

big-sleep

A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun

fuse-med-ml

A python framework accelerating ML based discovery in the medical field by encouraging code reuse. Batteries included :)

emmental

A deep learning framework for building multimodal multi-task learning systems.

navit-torch

navit - Pytorch

fonduer

A knowledge base construction engine for richly formatted data

swarms-torch

swarms-torch - Pytorch

mirasol-pytorch

Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch

tfce-mediation

Fast regression and mediation analysis of vertex or voxel MRI data with TFCE

medpalm

MedPalm - Pytorch

pali-torch

Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"

nmtpytorch

Sequence-to-Sequence Framework in Pytorch

tmi-viewer

tmi_viewer

pydance

Deep Learning for Single-cell Analysis

pali3

pali3 - Pytorch

fedot-example-test

Automated modeling and machine learning framework FEDOT

sygra

SyGra - Graph-oriented Synthetic data generation Pipeline

mmca

The open source community's implementation of the all-new Multi-Modal Causal Attention from "DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention"

mmqqa

Experiments around using Multi-Modal Casual Attention with Multi-Grouped Query Attention

mmmgqa

Experiments around using Multi-Modal Casual Attention with Multi-Grouped Query Attention

mmca-mgqa

Experiments around using Multi-Modal Casual Attention with Multi-Grouped Query Attention