Open Source: #llm

Catalog projects marked with #llm. Tags work as dedicated landing pages, so related tools are easier to find and connect.

This collection holds 55 projects with a combined 4,548,466 GitHub stars. Main languages: Python, TypeScript, Go.

About the LLM tools

Large language models stopped being research-lab magic — people now run them locally, fine-tune them on their data, and ship them inside products. The open source ecosystem around LLMs moves faster than any other: new tools land literally every week.

This collection covers inference engines, RAG and agent frameworks, API wrappers, and local runners. If you are building on top of language models, start here: these are proven projects under active development.

Filters

Reset
Languages

Repositories

Found: 55
meta-llama/llama
Llama

Llama is Meta’s repository with inference code for earlier Llama models and links to newer family repositories.

Stars 59,472 Forks 9,792 Author meta-llama Language Python License NOASSERTION
Open
karpathy/nanochat
nanochat

nanochat is Andrej Karpathy’s educational project for walking through the main stages of training a small language model and running a simple chat.

Stars 55,484 Forks 7,632 Author karpathy Language Python License Unknown
Open
jingyaogong/minimind
MiniMind

MiniMind is an educational PyTorch project for reproducing a small language model end to end: data, pretraining, finetuning, and experiments.

Stars 52,236 Forks 6,726 Author jingyaogong Language Python License Unknown
Open
BerriAI/litellm
LiteLLM

LiteLLM is a Python SDK and proxy for calling many LLM providers through one interface.

Stars 51,738 Forks 9,225 Author BerriAI Language Python License NOASSERTION
Open
run-llama/llama_index
LlamaIndex

LlamaIndex is a framework for connecting LLM applications to external data, indexes, and tools.

Stars 50,442 Forks 7,642 Author run-llama Language Python License MIT
Open
oobabooga/textgen
TextGen

TextGen is a desktop app and web interface for local LLMs: chat, generation, vision, tool-calling, and compatible APIs.

Stars 47,281 Forks 5,977 Author oobabooga Language Python License AGPL-3.0
Open
mudler/LocalAI
LocalAI

LocalAI is an open AI engine for running LLM, vision, voice, image, and video models through compatible APIs on your own hardware.

Stars 47,172 Forks 4,174 Author mudler Language Go License Unknown
Open
CherryHQ/cherry-studio
Cherry Studio

Cherry Studio is a desktop AI client for multiple LLM providers, assistants, documents, MCP, and local models.

Stars 47,170 Forks 4,475 Author CherryHQ Language TypeScript License AGPL-3.0
Open
janhq/jan
Jan

Jan is an open source desktop app for chatting with local LLMs.

Stars 43,251 Forks 2,871 Author janhq Language TypeScript License NOASSERTION
Open