Skip to main content

OpenAI-compatible server

NobodyWho provides an experimental local server that implements the OpenAI Chat Completions API. It loads one model and requires no API key.

note

nobodywho-server is experimental! Not to be used for any production/sensitive loads.

Setup (for a coding agent)​

Start the server:

uvx \
  --from 'git+https://github.com/nobodywho-ooo/nobodywho.git#subdirectory=nobodywho/server' \
  nobodywho-server \
  --model hf://NobodyWho/Qwen_Qwen3-0.6B-GGUF/Qwen_Qwen3-0.6B-Q4_K_M.gguf \
  --name qwen

The server listens on http://127.0.0.1:8888 by default.

To use with, for example Pi, load the Pi extension:

NOBODYWHO_BASE_URL=http://127.0.0.1:8888/v1 \
  pi -e 'git:https://gist.github.com/duarteocarmo/39a3f1148e2e33c27fddbbef2d971deb.git' \
  --model nobodywho/qwen

And start working.

API​

The API is very minimal for now:

  • GET /health
  • GET /v1/models
  • POST /v1/chat/completions
curl http://127.0.0.1:8888/v1/chat/completions \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "qwen",
    "messages": [{"role": "user", "content": "Say hello."}],
    "stream": true
  }'

Limitations​

  • single model
  • sequential generations
  • no auth of any kind
  • no required tool choice (only auto, none, or a named function)

References​

Future enhancements​

  • Expose GGUF metadata through the API
  • Publish an official NobodyWho Pi extension instead of a gist