llama-cpp: llama-server with DFlash2 speculative decoding for gfx1151

v0.8.0 is the first upstream release with DFlash2 drafters; nixpkgs has 0.6.0 (unstable) and an older tree (stable), so the engine is built here. HIP build for Strix Halo. The NixOS module exposes llama-server behind skyg.nixos.server.services.llama-cpp; fwdesk wires it to Qwen3.8-27B + its DFlash2 drafter, disabled until the weights are on disk.
This commit is contained in:
hermenix committed 2026-11-11 16:01:32 +00:00
1 parent 62c41a6f8e
commit ce92096042
9 files changed
+392

No files matched your search

+1
View File
@@ -339,6 +339,7 @@
buzz-desktop = lib.pkgs.${system}.buzz-desktop;
delta-editor = lib.pkgs.${system}.delta-editor;
colibri = lib.pkgs.${system}.colibri;
llama-cpp-halo = lib.pkgs.${system}.llama-cpp-halo;
herdr = herdr.packages.${system}.default;
}
);