Overview
What is NobodyWho?
NobodyWho is a lightweight, open-source inference engine for running open-weights LLMs inside your software. We provide a simple, efficient, offline and privacy forward way of interacting with LLMs. No infrastructure needed!
In short, if you want to run a LLM, integrate it with tools, configure its output, enable real-time streaming of tokens, create embeddings, or synthesize speech, NobodyWho makes it easy.
All of this is enabled by Llama.cpp, while having nice, simple API.
No need to mess around with docker containers, GPU servers, API keys, etc. We make it easy to run local models in Kotlin, Swift, Python, Flutter, React Native, Expo and Godot!
Code documentation
If you already know the basics of LLMs, jump to the docs for your favorite language:
Or install the skill so your AI coding agent knows everything about NobodyWho:
npx skills add https://github.com/nobodywho-ooo/nobodywho --skill nobodywho
Basic LLM concepts
If you are unfamiliar with the basics of LLMs or are just interested we also provide a simple introduction to the most important concepts you need to know in order to get the most out of NobodyWho.