Nvidia on NixOS WSL – Ollama up 24/7 on your gaming PC
a year ago
- #LLM
- #WSL
- #NixOS
- Running NixOS with WSL on a gaming PC for LLM experimentation.
- Challenges included VRAM locking, WSL auto-shutdown, and Nvidia support.
- Solutions: Ollama auto-unloads models, WSL stays running, Nvidia Container Toolkit configured.
- NixOS configuration for system-wide setup, including Tailscale for networking.
- Steps to install NixOS on WSL and basic configuration.
- Configuring Nvidia Container Toolkit for NixOS on WSL.
- Setting up Ollama Docker container with optional Tailscale integration.
- Networking setup and testing for both Tailscale and non-Tailscale users.
- Final setup allows for convenient LLM access and experimentation at home.