Files
nixos-setup/hosts/hl-fwdesk/services/default.nix
T
hermenix ce92096042 llama-cpp: llama-server with DFlash2 speculative decoding for gfx1151
v0.8.0 is the first upstream release with DFlash2 drafters; nixpkgs has 0.6.0 (unstable) and an older tree (stable), so the engine is built here. HIP build for Strix Halo. The NixOS module exposes llama-server behind skyg.nixos.server.services.llama-cpp; fwdesk wires it to Qwen3.8-27B + its DFlash2 drafter, disabled until the weights are on disk.
2026-11-11 16:01:32 +00:00

15 lines
210 B
Nix

{
imports = [
./ds4.nix
./llama-cpp.nix
./ollama.nix
./libretranslate.nix
./hermenix.nix
./wyoming.nix
./steam.nix
./buildbot.nix
./linux-tracker.nix
./nbot.nix
];
}