FastChat is a platform for training, serving, and evaluating large language models.
Open Source: #llm
Catalog projects marked with #llm. Tags work as dedicated landing pages, so related tools are easier to find and connect.
This collection holds 55 projects with a combined 4,548,466 GitHub stars. Main languages: Python, TypeScript, Go.
About the LLM tools
Large language models stopped being research-lab magic — people now run them locally, fine-tune them on their data, and ship them inside products. The open source ecosystem around LLMs moves faster than any other: new tools land literally every week.
This collection covers inference engines, RAG and agent frameworks, API wrappers, and local runners. If you are building on top of language models, start here: these are proven projects under active development.
Repositories
Open Assistant is an open project around a chat assistant and conversational AI data.
LightRAG is a Python project for simple and fast retrieval-augmented generation.
LangExtract is a Google Python library for extracting structured data from unstructured text.
LangGraph is a library for building resilient LLM agents as state graphs.
DSPy is a Stanford NLP framework for programming LLM systems instead of manually tuning instructions.