Lightning-AI

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

Machine learning metrics for distributed, scalable PyTorch applications.

PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily write your own.

Pytorch Lightning code guideline for conferences

Speed up model training by fixing data loading.

Deep Learning Fundamentals -- Code material and exercises

Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.

Lightning Bits: Engineering for Researchers repo

Python pdb for multiple processes

Common Python utilities and GitHub Actions in Lightning Ecosystem

LLM router + minimal agent framework in one. Call any LLM API with OpenAI format. Unified billing, tools, retries, fallback, logging. Build agents and AI apps in pure Python. Full control. Zero...