Starred repositories
Context7 Platform -- Up-to-date code documentation for LLMs and AI code editors
🔥 The Web Data API for AI - Power AI agents with clean web data
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
A simple, performant and scalable Jax LLM!
an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM
Incredibly fast JavaScript runtime, bundler, test runner, and package manager – all in one
A high-performance inference engine for LLMs, optimized for diverse AI accelerators.
Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, a…
System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge
Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflo…
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
Open Source Landscapes and Insights Produced by AntOSS
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & TIS & vLLM & Ray & Async RL)
[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
verl: Volcano Engine Reinforcement Learning for LLMs
iTerm2 is a terminal emulator for Mac OS X that does amazing things.
[HPCA 2026] AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and versatility of software and hardware.
Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible.
DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
CUDA Templates and Python DSLs for High-Performance Linear Algebra
FlashMLA: Efficient Multi-head Latent Attention Kernels
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
SGLang is a high-performance serving framework for large language models and multimodal models.
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Super-Efficient RLHF Training of LLMs with Parameter Reallocation
Module, Model, and Tensor Serialization/Deserialization