Skip to content

tomsch/lmstudio-nix

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LM Studio for NixOS

Unofficial Nix package for LM Studio - discover, download, and run local LLMs.

Installation

Flake Input (NixOS/Home Manager)

{
  inputs.lmstudio.url = "github:tomsch/lmstudio-nix";

  outputs = { self, nixpkgs, lmstudio, ... }: {
    # NixOS
    nixosConfigurations.myhost = nixpkgs.lib.nixosSystem {
      modules = [{
        nixpkgs.config.allowUnfree = true;
        environment.systemPackages = [
          lmstudio.packages.x86_64-linux.default
        ];
      }];
    };
  };
}

Direct Run (no install)

nix run github:tomsch/lmstudio-nix --impure

Imperative Install

nix profile install github:tomsch/lmstudio-nix --impure

Features

  • Run LLMs locally - complete privacy, no data leaves your machine
  • Download models from Hugging Face with one click
  • GPU acceleration with NVIDIA CUDA and AMD ROCm support
  • OpenAI-compatible API server for local development
  • Chat interface with customizable system prompts
  • Supports Llama, Mistral, Phi, Gemma, DeepSeek, and more

System Requirements

  • x86_64 Linux
  • Recommended: NVIDIA or AMD GPU with 8GB+ VRAM
  • Minimum 16GB RAM
  • AVX2 compatible processor

Update Package

Maintainers can update to the latest version:

./update.sh

License

The Nix packaging is MIT. LM Studio itself is proprietary software.

Links

About

LM Studio Nix package - run local LLMs

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published