kyegomez

A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.

The Enterprise-Grade Multi-Agent Orchestration Framework. Website: https://swarms.ai

Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

A compilation of the best multi-agent papers

Implementation of Alpha Fold 3 from the paper: "Accurate structure prediction of biomolecular interactions with AlphaFold3" in PyTorch

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

Build high-performance AI models with modular building blocks

Democratization of RT-2 "RT-2: New model translates vision and language into action"

Implementation of Vision Mamba from the paper: "Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model" It's 2.8x faster than DeiT and saves 86.8% GPU memory...

A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.

The open source implementation of Gemini, the model that will "eclipse ChatGPT" by Google

Towards Generalist Biomedical AI

Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"

Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.

An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal AI that uses just a decoder to generate both text and images

Implementation of "PaLM-E: An Embodied Multimodal Language Model"

My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"

Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"

An open source implementation of LFMs from Liquid AI: Liquid Foundation Models

Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling

Open source implementation of "Vision Transformers Need Registers"

PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"

A easy, reliable, fluid template for python packages complete with docs, testing suites, readme's, github workflows, linting and much much more

Implementation of "Attention Is Off By One" by Evan Miller

Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊

An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast

Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"

Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"

Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!

an open-source, from-first-principles reconstruction of the ideas behind TypeSafe AI's Jev, written in pytorch

Implementation of "MORPHEUS-1" from Prophetic AI and "The world’s first multi-modal generative ultrasonic transformer designed to induce and stabilize lucid dreams. "

Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Zeta

Implementation of MambaByte in "MambaByte: Token-free Selective State Space Model" in Pytorch and Zeta

Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"

"Improving Mathematical Reasoning with Process Supervision" by OPENAI

Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"

Get down and dirty with FlashAttention2.0 in pytorch, plug in and play no complex CUDA kernels

Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"

My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"

Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"

Implementation of Deepmind's RoboCat: "Self-Improving Foundation Agent for Robotic Manipulation" An next generation robot LLM

My implementation of Kosmos2.5 from the paper: "KOSMOS-2.5: A Multimodal Literate Model"

Plug in and play implementation of " Textbooks Are All You Need", ready for training, inference, and dataset generation

Implementation of Liquid Nets in Pytorch

The Next Generation Multi-Modality Superintelligence

Implementation of the transformer from the paper: "Real-World Humanoid Locomotion with Reinforcement Learning"

Implementation of PyTorch: "GAMBA: MARRY GAUSSIAN SPLATTING WITH MAMBA FOR SINGLE-VIEW 3D RECONSTRUCTION"

A multi-modal AI Model that can generate high quality novel videos with text, images, or video clips.

An open source community implementation of the model from the paper: "Movie Gen: A Cast of Media Foundation Models". Join our community to help implement this model!

Finetune any model on HF in less than 30 seconds

Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTORCH

Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"

Triton implementation of Flash Attention2.0

Implementation of the premier Text to Video model from OpenAI

Implementation of the text to video model LUMIERE from the paper: "A Space-Time Diffusion Model for Video Generation" by Google Research

32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.

Implementation of Qformer from BLIP2 in Zeta Lego blocks.