Skip to content

docs: Add Q-Lite deployment guide + edge device integration#521

Open
RalphBigBear wants to merge 1 commit intokarpathy:masterfrom
RalphBigBear:docs/q-lite-integration-2
Open

docs: Add Q-Lite deployment guide + edge device integration#521
RalphBigBear wants to merge 1 commit intokarpathy:masterfrom
RalphBigBear:docs/q-lite-integration-2

Conversation

@RalphBigBear
Copy link

This PR adds deployment documentation for edge devices, mentioning Q-Lite as ultra-lightweight gateway option.

Changes

  • Add 'Deployment' section to README
  • Create docs/DEPLOYMENT.md with detailed Q-Lite workflow
  • Document NanoChat → Q-Lite integration (train → serve → deploy)

Workflow

Complete pipeline enabled:

  1. Train model with NanoChat (on desktop/HPC)
  2. Serve with Ollama (on desktop/server)
  3. Deploy with Q-Lite (to edge devices like ESP32/Pico)

Q-Lite Highlights

  • <1MB RAM - Runs on ESP32, Raspberry Pi Zero
  • 69KB binary - Ultra-lightweight C implementation
  • Ollama-compatible - Drop-in replacement
  • Pure C - Zero dependencies

Inspiration

Inspired by OpenClaw Discussion #14132:
https://github.com/openclaw/openclaw/discussions/14132

Special thanks to @karpathy for proving that minimalism beats feature bloat.

Q-Lite stands on the shoulders of giants.

This PR adds deployment documentation for edge devices, mentioning Q-Lite as the ultra-lightweight gateway option for NanoChat-trained models.

Changes:
- Add 'Deployment' section to README
- Create docs/DEPLOYMENT.md with detailed Q-Lite workflow
- Document NanoChat → Q-Lite integration (train → serve → deploy)

Inspired by OpenClaw Discussion #14132:
https://github.com/openclaw/openclaw/discussions/14132

Special thanks to @karpathy.
@svlandeg svlandeg added the docs Improvements or additions to documentation label Feb 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants