Moved Authentik (2026.2.2 -> 2026.5.2, +Redis, dedicated auth Docker net) off LXC 124 onto the VPS so netbird-mgmt's OIDC dependency no longer requires the mesh it authenticates. depends_on: service_healthy makes the deadlock structurally impossible. Full Postgres DB migrated (users/apps/passwords/groups). - investigations/2026-05-31-authentik-vps-migration.md: full writeup + lessons - 124-authentik: migration banner + changelog (now legacy; dnsmasq stays) - dns: auth.hubris.network -> 82.165.190.79; NetBird resolver cache gotcha - ingress: auth served by local container via Docker-provider labels (not cert-mirror) - mesh: follow-up entry superseding the morning band-aid; bootstrap note obsolete Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
1.1 KiB
1.1 KiB
Investigations
Time-stamped incident reports and experiments. One entry per incident; the entry is the canonical source. Per-node changelog entries link back here.
Index
| Date | Title | Status |
|---|---|---|
| 2026-05-31 | Authentik migrated from LXC 124 to the VPS | Resolved; LXC 124 Authentik in ~2-week dual-run before decommission |
| 2026-04-21 | Hubris crash loop — thermal + USB drive | Drive removal A/B test passing as of 2026-04-28 (3+ days uptime) |
Conventions
- File name:
YYYY-MM-DD-<slug>.md. Use the first date if the incident spans multiple days. - Mandatory sections: Summary, Timeline, Root cause, Mitigations applied, Open questions.
- Update the entry as the situation evolves; never rewrite history. Add new dated sections at the bottom.
- Link back from every node's changelog that's affected.