v0.8.0 is the first upstream release with DFlash2 drafters; nixpkgs has 0.6.0 (unstable) and an older tree (stable), so the engine is built here. HIP build for Strix Halo. The NixOS module exposes llama-server behind skyg.nixos.server.services.llama-cpp; fwdesk wires it to Qwen3.8-27B + its DFlash2 drafter, disabled until the weights are on disk.
14 lines
192 B
Nix
14 lines
192 B
Nix
{ ... }:
|
|
{
|
|
imports = [
|
|
./audiobookshelf.nix
|
|
./ai-services.nix
|
|
./colibri.nix
|
|
./llama-cpp.nix
|
|
./comfyui
|
|
./jellyfin.nix
|
|
./nbot-agent.nix
|
|
./signal-cli.nix
|
|
];
|
|
}
|