Commit Graph
14 Commits
Author SHA1 Message Date
ari 6db82ed10a Merge branch 'main' of gitea.app.internal:ari/nixos-setup 2026-11-11 17:02:43 -05:00
ari 09c6fe2235 debug agent 2026-11-11 17:02:36 -05:00
hermenix 26856003d4 llama-cpp: add CUDA support and bigbox1 RTX 3060 service config
- Extend pkgs/llama-cpp to support CUDA backend (backend="cuda") for NVIDIA GPUs
- Add llama-cpp-cuda variant to modules/core/default.nix overlay
- Create hosts/hl-bigbox1/services/llama-cpp.nix with RTX 3060 tuning:
  * gpuLayers=30 (conserve 12GB VRAM for context)
  * parallel=2 (handle concurrent requests on smaller VRAM)
  * Same Qwen3.8-27B + DFlash2 drafter as fwdesk
- Wire service into bigbox1 services/default.nix
- Disabled by default (weights download manual)
2026-11-11 16:02:41 +00:00
ari 0cf504ad27 remiving fwmgr from bigboxes too 2026-10-21 14:43:02 -04:00
ari 3c244541cb cleaner caddy setup 2026-10-20 16:11:13 -04:00
ari 4f3a95b42c tracking 2026-10-19 14:49:47 -04:00
ari e719674851 killing exporters 2026-10-16 16:59:09 -04:00
ari faeeb885b6 immich in parallel 2026-10-16 10:08:33 -04:00
ari aa81ecdb3d agent eyes + clean up of jellyfin + more eyes on crashes 2026-09-29 16:54:05 -04:00
ari 045702e909 dns refactor 2026-09-26 02:41:43 -04:00
ari 09e2e03423 single file for dns 2026-09-26 01:47:42 -04:00
ari 0737f21ccb clean up of secrets and a better namespace for delta 2026-09-25 16:06:01 -04:00
ari b615811418 using rootdir properly 2026-09-25 14:59:18 -04:00
ari b5bde292d2 refactoring hosts too big 2026-09-25 14:51:13 -04:00