Commit Graph
36 Commits
Author SHA1 Message Date
Hermenix ff770c1d03 dns-resilience: Hardened systemd-resolved with scoped host enablement
Add hardened systemd-resolved DNS with boot verification and journal recovery,
enabled only on specific hosts:
- hl-bigbox1, hl-bigbox2 (experienced DNS resilience issues)
- hl-minipc1, hl-minipc2, hl-minipc3 (minipc cluster)
- hl-fwdesk, hl-fws1 (desktop/workstation nodes)

Changes:
1. New module: modules/nixos/common/dns/default.nix
   - systemd-resolved with LLMNR fallback and DNSSEC tolerance
   - Hardened journald with persistent storage and auto-recovery
   - Boot-time DNS verification service with 5 retries
   - Systemd watchdog for automatic reboot on DNS failure

2. Default to false, enabled explicitly on target hosts only
3. Updated host configs to enable dns resilience module
2026-11-17 18:25:20 +00:00
Hermenix a8bc08de43 container-services: queue the env-reload restart instead of blocking on it
The env-reload unit is a oneshot whose ExecStart was a blocking
systemctl restart of the group unit. When the stack's cold start failed
transiently (container-services-buzz on minipc1, where buzz-relay-1 came
up unhealthy and compose exited 1), the group unit recovered on its own a
few seconds later through its own Restart=on-failure, but the reload unit
had already exited 1 with no restart policy and stayed failed until the
next env file write.

The trigger unit should queue the restart, not own the health of the whole
stack: pass --no-block. Real failures still surface on the group unit,
which carries Restart=on-failure and the start limit and is what the fleet
scan reports.
2026-11-09 15:04:30 +00:00
ari e719674851 killing exporters 2026-10-16 16:59:09 -04:00
ari 1e6cf7251f full deprecation 2026-10-16 15:07:11 -04:00
ari 17b14b33e5 making sure files will cause a restart 2026-10-03 00:57:28 -04:00
ari 4f396d93c4 new dns routing 2026-09-29 11:23:25 -04:00
ari 045702e909 dns refactor 2026-09-26 02:41:43 -04:00
ari 09e2e03423 single file for dns 2026-09-26 01:47:42 -04:00
ari f1e71fa1e9 configured portainer 2026-09-22 22:21:12 -04:00
ari cbba7075a7 fixing ip routing for tailscale outside 2026-09-22 14:29:50 -04:00
ari f8444b1549 dns + keybinding consolidation 2026-09-21 10:52:32 -04:00
ari df46627173 some security patches + buzz updates 2026-09-20 20:55:17 -04:00
ari 8cb5978f3a fixing podmand virt 2026-09-20 20:20:25 -04:00
ari beb83f21b3 buz support 2026-09-20 20:13:39 -04:00
ari a7b9273296 new static ip and merge approach 2026-09-16 22:02:04 -04:00
ari 7cd2b2ca20 macvlan 2026-09-16 16:18:25 -04:00
ari bdfcb9e814 clean up & consoldiation of custom pkgs from flakes & herdr 2026-09-09 11:46:46 -04:00
ari 2a2bdd0b4b moving minipc2 services to nix 2026-08-27 15:15:06 -04:00
ari e5c264d3ab compose fix + boot all script 2026-07-19 09:26:06 -04:00
ari 916799509c latest container work 2026-07-17 20:27:21 -04:00
ari 3d20e0f709 fixing containers 2026-07-15 17:46:01 -04:00
ari 1e8cf01461 initial work on iu + more compose refactoring 2026-07-13 22:25:23 -04:00
ari 896d7480c1 autoupdates 2026-07-09 01:02:10 -04:00
ari c82088b35a cleaner volumes 2026-07-08 22:22:43 -04:00
ari f8874f6e15 better cleaner containers 2026-06-29 09:57:40 -04:00
ari 4bd849e534 better cleaner containers 2026-06-28 16:05:54 -04:00
ari d9b984db7f better cleaner containers 2026-06-28 15:55:16 -04:00
ari 3aa7119bed guidlines & restart on env change 2026-06-28 15:35:11 -04:00
ari cf2f221a94 container framework + initial work on signal-cli + hermes 2026-06-28 15:30:15 -04:00
ari d9cacefa0f added manual secrets 2026-06-26 16:07:47 -04:00
ari 1cb62df487 latest 2026-01-01 16:02:35 -05:00
ari 53fbd3300f added exporters 2024-11-11 16:06:43 -05:00
ari 7892912f4d container exporters 2024-11-11 15:13:16 -05:00
ari ebb321f671 Name refactor + move 2024-08-18 21:36:32 -04:00
ari 1d0188e199 Moved over containers 2024-08-18 21:27:16 -04:00
ari a86fd67f5a Moved container config 2024-08-18 21:19:08 -04:00