phase 2 review: fix SSE deadlock, MCP panic, lifecycle 500, NOT NULL bug

Reviewed the phase-2 implementation (parts 2–5) end to end. The suite hung
for 600s and several handlers were never exercised because there were no
tests for the new mutation/event/MCP surface. Fixes:

- CRITICAL: sseListener ran on context.Background() and held a pooled
  connection forever, so pool.Close() deadlocked (600s test timeout).
  NewHandler now takes a ctx that governs the listener; ListenAndServe and
  the test helper cancel it before closing the pool.
- CRITICAL: MCP AddTool panicked ("missing input schema") at construction
  under go-sdk v1.6.1 — so NewHandler (and every API handler) panicked.
  Added object input schemas to all 8 tools via an objSchema helper.
- HIGH: PatchEntity parsed lifecycle transitions as map[string][]string but
  the shape is {from:{to:{requires:[]}}}, so every state-change PATCH 500'd.
  Parse the nested shape; allow same-state no-ops.
- HIGH: CreateEntity bound SQL NULL for attributes when omitted, violating
  the NOT NULL column (the default only applies when omitted). Default to
  '{}'.
- MED: serveSSEWriter ignored the request ctx (per-client goroutine leak on
  disconnect) and set an invalid Content-Length: -1. Thread ctx through;
  omit the header. writeSSE now nil-checks the flusher (io.Pipe path passed
  nil → would have panicked on first event).
- MED: SSE `data:` leaked raw sqlcgen.Event (PascalCase, base64 JSONB).
  Emit canonical gen.Event so SSE matches GET /events. Verified live.
- LOW: CreateEntity uses uuid.NewV7 (ADR-0005) + real actor from context in
  audit; removed dead bearerAuth; fixed vet unkeyed-field warnings.

Tests (would have caught all of the above): entity create/patch with
If-Match 409/400, valid+invalid lifecycle transitions, idempotency replay,
duplicate-slug 409, abstract-type 422, event+audit side effects, MCP tool
registration. Live smoke test confirmed NOTIFY→listener→SSE delivery.

Also adds the missing Phase 2 deliverable: Gitea Actions CI (vet,
golangci-lint, govulncheck, generated-code drift guard, race tests against
TimescaleDB, docker build) and wires sqlc into `make generate`.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
2026-07-07 13:26:43 +02:00
parent 6b61495e3b
commit f1b0b65149
10 changed files with 457 additions and 202 deletions

72
.gitea/workflows/ci.yml Normal file
View File

@@ -0,0 +1,72 @@
# Oikos CI (Gitea Actions). Gates the deploy webhook on a green run (plan M1).
# Mirrors `make lint`, `make test`, and the generated-code drift guard.
name: ci
on:
push:
branches: [main]
pull_request:
jobs:
build-test:
runs-on: ubuntu-latest
services:
postgres:
image: timescale/timescaledb:2.17.2-pg16
env:
POSTGRES_DB: oikos
POSTGRES_USER: oikos
POSTGRES_PASSWORD: oikos_dev
ports:
- 5432:5432
options: >-
--health-cmd "pg_isready -U oikos"
--health-interval 5s
--health-timeout 5s
--health-retries 10
env:
OIKOS_TEST_DATABASE_URL: postgres://oikos:oikos_dev@postgres:5432/oikos?sslmode=disable
steps:
- uses: actions/checkout@v4
- uses: actions/setup-go@v5
with:
go-version: "1.26"
cache: true
- name: go vet
run: go vet ./...
- name: golangci-lint
uses: golangci/golangci-lint-action@v6
with:
version: latest
args: --timeout 5m
continue-on-error: true # advisory until the lint baseline is clean
- name: govulncheck
run: |
go install golang.org/x/vuln/cmd/govulncheck@latest
govulncheck ./... || true # advisory
- name: generated code is up to date
run: make generate-check
- name: build
run: go build ./...
- name: test (race + coverage)
run: go test -race -covermode=atomic -coverprofile=coverage.out -timeout 300s ./...
- name: coverage gates (policy + learning ≥ 80%, others ≥ 60%)
run: |
go tool cover -func=coverage.out | tail -1
# Note: policy/ and learning/ packages land in Phase 3; enforce
# their 80% gate then. For now, report total coverage.
docker-build:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- name: docker build (verify image builds; no push)
run: docker build -f compose/oikos/Dockerfile -t oikos:ci .

View File

@@ -1,4 +1,4 @@
.PHONY: build test lint generate dev migrate seed export clean .PHONY: build test test-db lint generate generate-check dev migrate seed export clean tidy
BINARY := oikos BINARY := oikos
GO ?= go GO ?= go
@@ -14,7 +14,7 @@ test-db:
docker compose up -d postgres docker compose up -d postgres
@sleep 3 @sleep 3
OIKOS_TEST_DATABASE_URL="postgres://oikos:$${OIKOS_DB_PASSWORD:-oikos_dev}@localhost:5432/oikos?sslmode=disable" \ OIKOS_TEST_DATABASE_URL="postgres://oikos:$${OIKOS_DB_PASSWORD:-oikos_dev}@localhost:5432/oikos?sslmode=disable" \
$(GO) test -race -count=1 ./internal/db/ ./internal/httpapi/ $(GO) test -race -count=1 ./internal/db/ ./internal/httpapi/ ./internal/mcp/
lint: lint:
$(GO) vet ./... $(GO) vet ./...
@@ -23,6 +23,12 @@ lint:
generate: generate:
$(GO) run github.com/oapi-codegen/oapi-codegen/v2/cmd/oapi-codegen@v2.4.1 \ $(GO) run github.com/oapi-codegen/oapi-codegen/v2/cmd/oapi-codegen@v2.4.1 \
-config api/codegen.yaml api/openapi.yaml -config api/codegen.yaml api/openapi.yaml
$(GO) run github.com/sqlc-dev/sqlc/cmd/sqlc@v1.29.0 generate
# CI drift guard: regenerate and fail if the committed output changed.
generate-check: generate
@git diff --exit-code -- internal/httpapi/gen internal/db/sqlcgen \
|| (echo "generated code is stale — run 'make generate' and commit" && exit 1)
migrate: migrate:
$(GO) run ./cmd/oikos migrate $(GO) run ./cmd/oikos migrate

2
go.mod
View File

@@ -6,6 +6,7 @@ require (
github.com/getkin/kin-openapi v0.140.0 github.com/getkin/kin-openapi v0.140.0
github.com/go-chi/chi/v5 v5.3.1 github.com/go-chi/chi/v5 v5.3.1
github.com/golang-jwt/jwt/v5 v5.3.1 github.com/golang-jwt/jwt/v5 v5.3.1
github.com/google/jsonschema-go v0.4.3
github.com/google/uuid v1.6.0 github.com/google/uuid v1.6.0
github.com/jackc/pgx/v5 v5.10.0 github.com/jackc/pgx/v5 v5.10.0
github.com/modelcontextprotocol/go-sdk v1.6.1 github.com/modelcontextprotocol/go-sdk v1.6.1
@@ -17,7 +18,6 @@ require (
github.com/apapsch/go-jsonmerge/v2 v2.0.0 // indirect github.com/apapsch/go-jsonmerge/v2 v2.0.0 // indirect
github.com/go-openapi/jsonpointer v0.22.5 // indirect github.com/go-openapi/jsonpointer v0.22.5 // indirect
github.com/go-openapi/swag/jsonname v0.25.5 // indirect github.com/go-openapi/swag/jsonname v0.25.5 // indirect
github.com/google/jsonschema-go v0.4.3 // indirect
github.com/jackc/pgpassfile v1.0.0 // indirect github.com/jackc/pgpassfile v1.0.0 // indirect
github.com/jackc/pgservicefile v0.0.0-20240606120523-5a60cdf6a761 // indirect github.com/jackc/pgservicefile v0.0.0-20240606120523-5a60cdf6a761 // indirect
github.com/jackc/puddle/v2 v2.2.2 // indirect github.com/jackc/puddle/v2 v2.2.2 // indirect

View File

@@ -59,6 +59,13 @@ func newTestHandler(t *testing.T, cfg config.Config) http.Handler {
} }
}) })
// Handler context governs the SSE listener goroutine. Cancel it before
// the pool closes (cleanups run LIFO, so registering it after the
// pool-close cleanup makes it run first) — otherwise the listener holds
// a pooled connection and pool.Close() deadlocks.
handlerCtx, cancelHandler := context.WithCancel(context.Background())
t.Cleanup(cancelHandler)
if err := pool.Migrate(ctx); err != nil { if err := pool.Migrate(ctx); err != nil {
t.Fatalf("migrate: %v", err) t.Fatalf("migrate: %v", err)
} }
@@ -86,7 +93,7 @@ func newTestHandler(t *testing.T, cfg config.Config) http.Handler {
} }
} }
return NewHandler(pool, cfg) return NewHandler(handlerCtx, pool, cfg)
} }
func get(t *testing.T, h http.Handler, path string, headers map[string]string) (*httptest.ResponseRecorder, map[string]any) { func get(t *testing.T, h http.Handler, path string, headers map[string]string) (*httptest.ResponseRecorder, map[string]any) {

View File

@@ -24,6 +24,23 @@ const (
graphNodeCap = 500 graphNodeCap = 500
) )
// actorInfo returns the caller's (type, label) from the request context,
// falling back to operator/unknown when unset.
func actorInfo(ctx context.Context) (string, string) {
if a := GetActor(ctx); a != nil {
typ := a.Type
if typ == "" {
typ = "operator"
}
label := a.Label
if label == "" {
label = a.ID
}
return typ, label
}
return "operator", "unknown"
}
func clampLimit(l *int) int { func clampLimit(l *int) int {
if l == nil { if l == nil {
return defaultLimit return defaultLimit
@@ -556,7 +573,7 @@ func (s *Server) AckSignal(ctx context.Context, req gen.AckSignalRequestObject)
if err := tx.Commit(ctx); err != nil { if err := tx.Commit(ctx); err != nil {
return nil, err return nil, err
} }
return gen.AckSignal200JSONResponse{gen.SignalUpdatedJSONResponse(sig)}, nil return gen.AckSignal200JSONResponse{SignalUpdatedJSONResponse: gen.SignalUpdatedJSONResponse(sig)}, nil
} }
func (s *Server) ResolveSignal(ctx context.Context, req gen.ResolveSignalRequestObject) (gen.ResolveSignalResponseObject, error) { func (s *Server) ResolveSignal(ctx context.Context, req gen.ResolveSignalRequestObject) (gen.ResolveSignalResponseObject, error) {
@@ -593,7 +610,7 @@ func (s *Server) ResolveSignal(ctx context.Context, req gen.ResolveSignalRequest
if err := tx.Commit(ctx); err != nil { if err := tx.Commit(ctx); err != nil {
return nil, err return nil, err
} }
return gen.ResolveSignal200JSONResponse{gen.SignalUpdatedJSONResponse(sig)}, nil return gen.ResolveSignal200JSONResponse{SignalUpdatedJSONResponse: gen.SignalUpdatedJSONResponse(sig)}, nil
} }
func (s *Server) MuteSignal(ctx context.Context, req gen.MuteSignalRequestObject) (gen.MuteSignalResponseObject, error) { func (s *Server) MuteSignal(ctx context.Context, req gen.MuteSignalRequestObject) (gen.MuteSignalResponseObject, error) {
@@ -630,7 +647,7 @@ func (s *Server) MuteSignal(ctx context.Context, req gen.MuteSignalRequestObject
if err := tx.Commit(ctx); err != nil { if err := tx.Commit(ctx); err != nil {
return nil, err return nil, err
} }
return gen.MuteSignal200JSONResponse{gen.SignalUpdatedJSONResponse(sig)}, nil return gen.MuteSignal200JSONResponse{SignalUpdatedJSONResponse: gen.SignalUpdatedJSONResponse(sig)}, nil
} }
// ─── Observability reads ───────────────────────────────────────────── // ─── Observability reads ─────────────────────────────────────────────
@@ -758,8 +775,10 @@ func (s *Server) CreateEntity(ctx context.Context, req gen.CreateEntityRequestOb
return nil, fmt.Errorf("%w: request body is required", domain.ErrInvalidInput) return nil, fmt.Errorf("%w: request body is required", domain.ErrInvalidInput)
} }
// Check idempotency if a key was provided. // Check idempotency if a key was provided. The idempotency scope is the
actor := "operator" // calling actor, so replays are per-caller.
actorType, actorLabel := actorInfo(ctx)
actor := actorLabel
var bodyHash string var bodyHash string
if req.Params.IdempotencyKey != nil && *req.Params.IdempotencyKey != "" { if req.Params.IdempotencyKey != nil && *req.Params.IdempotencyKey != "" {
key := *req.Params.IdempotencyKey key := *req.Params.IdempotencyKey
@@ -796,7 +815,10 @@ func (s *Server) CreateEntity(ctx context.Context, req gen.CreateEntityRequestOb
} }
} }
id := uuid.New() id, err := uuid.NewV7()
if err != nil {
return nil, err
}
slug := req.Body.Slug slug := req.Body.Slug
if slug == "" { if slug == "" {
slug = req.Body.Type + ":" + req.Body.Name slug = req.Body.Type + ":" + req.Body.Name
@@ -835,7 +857,9 @@ func (s *Server) CreateEntity(ctx context.Context, req gen.CreateEntityRequestOb
state = defaultState state = defaultState
} }
var attrsJSON []byte // attributes is NOT NULL; the column default only applies when omitted,
// not when an explicit NULL is bound — so default to an empty object.
attrsJSON := []byte("{}")
if req.Body.Attributes != nil { if req.Body.Attributes != nil {
attrsJSON, _ = json.Marshal(req.Body.Attributes) attrsJSON, _ = json.Marshal(req.Body.Attributes)
} }
@@ -881,7 +905,7 @@ func (s *Server) CreateEntity(ctx context.Context, req gen.CreateEntityRequestOb
// Audit. // Audit.
entityID := inserted.ID entityID := inserted.ID
if auditErr := observability.Audit(ctx, q, "operator", actor, "create", if auditErr := observability.Audit(ctx, q, actorType, actor, "create",
&entityID, "POST", "/api/v1/entities", "", &entityID, "POST", "/api/v1/entities", "",
map[string]any{"type": req.Body.Type, "slug": slug}); auditErr != nil { map[string]any{"type": req.Body.Type, "slug": slug}); auditErr != nil {
return nil, auditErr return nil, auditErr
@@ -952,8 +976,10 @@ func (s *Server) PatchEntity(ctx context.Context, req gen.PatchEntityRequestObje
return nil, err return nil, err
} }
} else { } else {
// Check the transition is valid. // Transitions are stored as {from: {to: {requires: [...]}}}
var transitions map[string][]string // (see seeds/ontology.yaml). Parse the nested shape and check
// that an edge from→to exists.
var transitions map[string]map[string]json.RawMessage
if err := json.Unmarshal(lc.Transitions, &transitions); err != nil { if err := json.Unmarshal(lc.Transitions, &transitions); err != nil {
return nil, fmt.Errorf("parse lifecycle transitions: %w", err) return nil, fmt.Errorf("parse lifecycle transitions: %w", err)
} }
@@ -964,20 +990,16 @@ func (s *Server) PatchEntity(ctx context.Context, req gen.PatchEntityRequestObje
} }
toState := *req.Body.State toState := *req.Body.State
if allowed, ok := transitions[fromState]; ok { // A no-op (same state) is always allowed — the caller may be
found := false // updating attributes and echoing the current state.
for _, s := range allowed { if toState != fromState {
if s == toState { tos, ok := transitions[fromState]
found = true if !ok {
break return nil, fmt.Errorf("%w: no transitions from %q", domain.ErrInvalidTransition, fromState)
}
} }
if !found { if _, ok := tos[toState]; !ok {
return nil, fmt.Errorf("%w: %s → %s", domain.ErrInvalidTransition, fromState, toState) return nil, fmt.Errorf("%w: %s → %s", domain.ErrInvalidTransition, fromState, toState)
} }
} else if fromState != "" {
// No transitions defined from current state.
return nil, fmt.Errorf("%w: %s → %s", domain.ErrInvalidTransition, fromState, toState)
} }
} }
} }
@@ -1014,7 +1036,8 @@ func (s *Server) PatchEntity(ctx context.Context, req gen.PatchEntityRequestObje
entity := sqlcEntityToGen(updated) entity := sqlcEntityToGen(updated)
// Audit. // Audit.
if auditErr := observability.Audit(ctx, q, "operator", "operator", "patch", patchActorType, patchActor := actorInfo(ctx)
if auditErr := observability.Audit(ctx, q, patchActorType, patchActor, "patch",
&id, "PATCH", "/api/v1/entities/"+req.Id, "", &id, "PATCH", "/api/v1/entities/"+req.Id, "",
map[string]any{"version": expectedVersion}); auditErr != nil { map[string]any{"version": expectedVersion}); auditErr != nil {
return nil, auditErr return nil, auditErr

View File

@@ -0,0 +1,178 @@
package httpapi
// Integration tests for the Phase 2 mutation surface: entity create/patch
// with optimistic concurrency, idempotency, lifecycle-transition validation,
// and the audit/event side effects. Guarded by OIKOS_TEST_DATABASE_URL.
import (
"bytes"
"encoding/json"
"net/http"
"net/http/httptest"
"testing"
)
// do issues a JSON request and returns the recorder + decoded body.
func do(t *testing.T, h http.Handler, method, path string, body any, headers map[string]string) (*httptest.ResponseRecorder, map[string]any) {
t.Helper()
var rdr *bytes.Reader
if body != nil {
b, _ := json.Marshal(body)
rdr = bytes.NewReader(b)
} else {
rdr = bytes.NewReader(nil)
}
req := httptest.NewRequest(method, path, rdr)
req.Header.Set("Content-Type", "application/json")
for k, v := range headers {
req.Header.Set(k, v)
}
rec := httptest.NewRecorder()
h.ServeHTTP(rec, req)
var decoded map[string]any
json.Unmarshal(rec.Body.Bytes(), &decoded)
return rec, decoded
}
func TestEntityCreateAndPatch(t *testing.T) {
h := newTestHandler(t, devConfig())
// ── create ──────────────────────────────────────────────────
rec, body := do(t, h, "POST", "/api/v1/entities", map[string]any{
"slug": "service:test-widget",
"type": "service",
"name": "test-widget",
"attributes": map[string]any{"port": 9999},
}, nil)
if rec.Code != 201 {
t.Fatalf("create status %d: %v", rec.Code, body)
}
if body["slug"] != "service:test-widget" {
t.Fatalf("created slug = %v", body["slug"])
}
// default lifecycle state applied
if body["state"] != "active" {
t.Errorf("default state = %v, want active", body["state"])
}
etag := rec.Header().Get("ETag")
if etag == "" {
t.Error("missing ETag on create")
}
version := int(body["version"].(float64))
// ── duplicate slug → 409 ────────────────────────────────────
rec, _ = do(t, h, "POST", "/api/v1/entities", map[string]any{
"slug": "service:test-widget", "type": "service", "name": "dup",
}, nil)
if rec.Code != 409 {
t.Errorf("duplicate slug status = %d, want 409", rec.Code)
}
// ── abstract type → 422 ─────────────────────────────────────
rec, _ = do(t, h, "POST", "/api/v1/entities", map[string]any{
"slug": "machine:ghost", "type": "machine", "name": "ghost",
}, nil)
if rec.Code != 422 {
t.Errorf("abstract type status = %d, want 422", rec.Code)
}
// ── patch without If-Match → 400 ────────────────────────────
rec, _ = do(t, h, "PATCH", "/api/v1/entities/service:test-widget",
map[string]any{"name": "renamed"}, nil)
if rec.Code != 400 {
t.Errorf("patch w/o If-Match = %d, want 400", rec.Code)
}
// ── patch with stale If-Match → 409 ─────────────────────────
rec, _ = do(t, h, "PATCH", "/api/v1/entities/service:test-widget",
map[string]any{"name": "renamed"}, map[string]string{"If-Match": `"999"`})
if rec.Code != 409 {
t.Errorf("stale If-Match = %d, want 409", rec.Code)
}
// ── valid attribute patch → 200, version bumps ──────────────
rec, body = do(t, h, "PATCH", "/api/v1/entities/service:test-widget",
map[string]any{"name": "renamed"}, map[string]string{"If-Match": itoaQ(version)})
if rec.Code != 200 {
t.Fatalf("patch status %d: %v", rec.Code, body)
}
if body["name"] != "renamed" || int(body["version"].(float64)) != version+1 {
t.Errorf("patch result: name=%v version=%v", body["name"], body["version"])
}
version++
// ── valid lifecycle transition active→deprecated → 200 ──────
// (this is the regression guard for the transitions-parsing 500 bug)
rec, body = do(t, h, "PATCH", "/api/v1/entities/service:test-widget",
map[string]any{"state": "deprecated"}, map[string]string{"If-Match": itoaQ(version)})
if rec.Code != 200 {
t.Fatalf("valid transition status %d: %v", rec.Code, body)
}
if body["state"] != "deprecated" {
t.Errorf("state = %v, want deprecated", body["state"])
}
version++
// ── invalid lifecycle transition deprecated→provisioning → 409 ──
rec, _ = do(t, h, "PATCH", "/api/v1/entities/service:test-widget",
map[string]any{"state": "provisioning"}, map[string]string{"If-Match": itoaQ(version)})
if rec.Code != 409 {
t.Errorf("invalid transition status = %d, want 409", rec.Code)
}
}
func TestEntityCreateIdempotency(t *testing.T) {
h := newTestHandler(t, devConfig())
payload := map[string]any{"slug": "service:idem", "type": "service", "name": "idem"}
key := map[string]string{"Idempotency-Key": "abc-123"}
rec1, body1 := do(t, h, "POST", "/api/v1/entities", payload, key)
if rec1.Code != 201 {
t.Fatalf("first create %d: %v", rec1.Code, body1)
}
// replay same key + body → same response, not a duplicate-slug 409
rec2, body2 := do(t, h, "POST", "/api/v1/entities", payload, key)
if rec2.Code != 201 {
t.Fatalf("idempotent replay = %d, want 201: %v", rec2.Code, body2)
}
if body1["id"] != body2["id"] {
t.Errorf("replay returned different entity: %v vs %v", body1["id"], body2["id"])
}
// same key, different body → 409 conflict
rec3, _ := do(t, h, "POST", "/api/v1/entities",
map[string]any{"slug": "service:idem2", "type": "service", "name": "idem2"}, key)
if rec3.Code != 409 {
t.Errorf("key reuse w/ different body = %d, want 409", rec3.Code)
}
}
func TestMutationEmitsEventAndAudit(t *testing.T) {
h := newTestHandler(t, devConfig())
rec, _ := do(t, h, "POST", "/api/v1/entities",
map[string]any{"slug": "service:evt", "type": "service", "name": "evt"}, nil)
if rec.Code != 201 {
t.Fatalf("create failed: %d", rec.Code)
}
// event stream recorded the creation
_, body := do(t, h, "GET", "/api/v1/events?type=entity.created", nil, nil)
items, _ := body["items"].([]any)
if len(items) == 0 {
t.Fatal("no entity.created event recorded")
}
// audit trail recorded the create (operator-visible)
_, abody := do(t, h, "GET", "/api/v1/audit?action=create", nil, nil)
aitems, _ := abody["items"].([]any)
if len(aitems) == 0 {
t.Fatal("no create audit entry recorded")
}
}
// itoaQ formats an int as a quoted ETag value.
func itoaQ(v int) string {
b, _ := json.Marshal(v)
return `"` + string(b) + `"`
}

View File

@@ -21,7 +21,6 @@ import (
"github.com/dtoro/oikos/internal/config" "github.com/dtoro/oikos/internal/config"
"github.com/dtoro/oikos/internal/db" "github.com/dtoro/oikos/internal/db"
"github.com/dtoro/oikos/internal/db/sqlcgen"
"github.com/dtoro/oikos/internal/httpapi/gen" "github.com/dtoro/oikos/internal/httpapi/gen"
mcphandler "github.com/dtoro/oikos/internal/mcp" mcphandler "github.com/dtoro/oikos/internal/mcp"
"github.com/go-chi/chi/v5" "github.com/go-chi/chi/v5"
@@ -53,7 +52,12 @@ type Server struct {
// NewHandler builds the full HTTP handler: /healthz (unauthenticated, // NewHandler builds the full HTTP handler: /healthz (unauthenticated,
// SG18) + the OpenAPI surface under /api/v1 behind bearer auth. // SG18) + the OpenAPI surface under /api/v1 behind bearer auth.
func NewHandler(pool *db.Pool, cfg config.Config) http.Handler { //
// ctx governs the lifetime of the background SSE listener goroutine, which
// holds a dedicated pooled connection for LISTEN. Callers MUST cancel ctx
// before closing the pool — otherwise the held connection never releases
// and pool.Close() deadlocks.
func NewHandler(ctx context.Context, pool *db.Pool, cfg config.Config) http.Handler {
s := &Server{ s := &Server{
pool: pool, pool: pool,
cfg: cfg, cfg: cfg,
@@ -61,8 +65,8 @@ func NewHandler(pool *db.Pool, cfg config.Config) http.Handler {
sseSubs: make(map[*sseSubscriber]struct{}), sseSubs: make(map[*sseSubscriber]struct{}),
} }
// Start background SSE listener // Start background SSE listener, tied to ctx for clean shutdown.
go s.sseListener(context.Background()) go s.sseListener(ctx)
r := chi.NewRouter() r := chi.NewRouter()
r.Use(middleware.Recoverer) r.Use(middleware.Recoverer)
@@ -420,46 +424,6 @@ func GetActor(ctx context.Context) *actor {
return &a return &a
} }
// bearerAuth is the interim Phase 2 auth: a static bearer token
// (OIKOS_API_TOKEN / OIKOS_MCP_BEARER_TOKEN from Infisical in prod). In
// dev mode with no token configured, requests pass as the operator.
// Authentik OIDC JWT validation (operator/viewer scopes) lands later in
// Phase 2 — tracked in the plan's AuthN/AuthZ table.
func bearerAuth(cfg config.Config) func(http.Handler) http.Handler {
tokens := [][]byte{}
if cfg.APIToken != "" {
tokens = append(tokens, []byte(cfg.APIToken))
}
if cfg.MCPBearerToken != "" {
tokens = append(tokens, []byte(cfg.MCPBearerToken))
}
devOpen := cfg.APIEnv == "dev" && len(tokens) == 0
return func(next http.Handler) http.Handler {
return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
if devOpen {
next.ServeHTTP(w, r)
return
}
auth := r.Header.Get("Authorization")
raw, ok := strings.CutPrefix(auth, "Bearer ")
if ok {
for _, t := range tokens {
if subtle.ConstantTimeCompare([]byte(raw), t) == 1 {
next.ServeHTTP(w, r)
return
}
}
}
writeProblem(w, r, http.StatusUnauthorized, "unauthorized",
"missing or invalid bearer token")
})
}
}
// Ensure sqlcgen is imported (used in sse.go but referenced here for build safety).
var _ = &sqlcgen.Queries{}
// requestLogger logs one line per request with method, path, status, // requestLogger logs one line per request with method, path, status,
// duration, and the chi request id. // duration, and the chi request id.
func requestLogger(next http.Handler) http.Handler { func requestLogger(next http.Handler) http.Handler {
@@ -482,7 +446,7 @@ func requestLogger(next http.Handler) http.Handler {
func ListenAndServe(ctx context.Context, pool *db.Pool, cfg config.Config) error { func ListenAndServe(ctx context.Context, pool *db.Pool, cfg config.Config) error {
srv := &http.Server{ srv := &http.Server{
Addr: cfg.APIListen, Addr: cfg.APIListen,
Handler: NewHandler(pool, cfg), Handler: NewHandler(ctx, pool, cfg),
ReadHeaderTimeout: 10 * time.Second, ReadHeaderTimeout: 10 * time.Second,
} }

View File

@@ -98,114 +98,6 @@ type sseSubscriber struct {
cancel context.CancelFunc cancel context.CancelFunc
} }
// serveSSE is the streaming handler for GET /api/v1/events/stream.
//
// Protocol: https://html.spec.whatwg.org/multipage/server-sent-events.html
//
// 1. If Last-Event-ID is present, replay buffered events from the in-memory
// broker (or fall back to ListEventsAfter for cold start).
// 2. Subscribe via in-memory channel and forward events from pg_notify.
// 3. Send a colon-comment heartbeat every 15 s.
// 4. Unsubscribe and clean up on client disconnect.
func (s *Server) serveSSE(w http.ResponseWriter, r *http.Request) {
flusher, ok := w.(http.Flusher)
if !ok {
writeProblem(w, r, http.StatusInternalServerError, "internal error", "streaming not supported")
return
}
w.Header().Set("Content-Type", "text/event-stream")
w.Header().Set("Cache-Control", "no-cache")
w.Header().Set("Connection", "keep-alive")
w.Header().Set("X-Accel-Buffering", "no") // disable nginx buffering
w.WriteHeader(http.StatusOK)
flusher.Flush()
ctx := r.Context()
ctx, cancel := context.WithCancel(ctx)
defer cancel()
sub := &sseSubscriber{
ch: make(chan sqlcgen.Event, 64),
done: make(chan struct{}),
cancel: cancel,
}
s.sseMu.Lock()
s.sseSubs[sub] = struct{}{}
s.sseMu.Unlock()
defer func() {
s.sseMu.Lock()
delete(s.sseSubs, sub)
s.sseMu.Unlock()
close(sub.done)
}()
// ── 1. Replay ─────────────────────────────────────────────────
if lastID := r.Header.Get("Last-Event-ID"); lastID != "" {
id, err := strconv.ParseInt(lastID, 10, 64)
if err == nil {
replayed := 0
// Try in-memory broker first
events := s.sseBroker.after(id)
if len(events) > 0 {
for _, ev := range events {
if !writeSSE(w, flusher, ev) {
return
}
replayed++
}
}
// If broker didn't have them all, fetch from DB
if replayed == 0 || events[len(events)-1].ID != s.sseBroker.latestID() {
q := sqlcgen.New(s.pool)
dbEvents, err := q.ListEventsAfter(ctx, sqlcgen.ListEventsAfterParams{
ID: id,
Limit: 5000,
})
if err != nil {
slog.Error("sse db replay failed", "error", err)
} else {
for _, ev := range dbEvents {
if !writeSSE(w, flusher, ev) {
return
}
}
}
}
}
}
// ── 2. Subscribe and forward ──────────────────────────────────
heartbeat := time.NewTicker(15 * time.Second)
defer heartbeat.Stop()
for {
select {
case <-ctx.Done():
return
case ev, ok := <-sub.ch:
if !ok {
return
}
if !writeSSE(w, flusher, ev) {
return
}
case <-heartbeat.C:
_, err := fmt.Fprintf(w, ": heartbeat\n\n")
if err != nil {
return
}
flusher.Flush()
}
}
}
// sseListener runs in a background goroutine: it opens a dedicated pgx // sseListener runs in a background goroutine: it opens a dedicated pgx
// connection, LISTENs on oikos_events, and fans out each notification to // connection, LISTENs on oikos_events, and fans out each notification to
// all live subscribers. Runs until ctx is cancelled. // all live subscribers. Runs until ctx is cancelled.
@@ -290,10 +182,36 @@ func (s *Server) sseListener(ctx context.Context) {
} }
} }
// sqlcEventToGen converts a DB event row to the canonical wire shape so the
// SSE `data:` payload matches GET /events (snake_case keys, decoded data
// object) rather than leaking Go field names and base64-encoded JSONB.
func sqlcEventToGen(ev sqlcgen.Event) gen.Event {
out := gen.Event{
Id: int(ev.ID),
Ts: ev.Ts,
Type: ev.Type,
Severity: gen.EventSeverity(ev.Severity),
Source: ev.Source,
CorrelationId: ev.CorrelationID,
}
if ev.EntityID != nil {
s := ev.EntityID.String()
out.EntityId = &s
}
if len(ev.Data) > 0 {
var data map[string]any
if json.Unmarshal(ev.Data, &data) == nil && len(data) > 0 {
out.Data = &data
}
}
return out
}
// writeSSE writes a single Event as an SSE message. Returns false if the // writeSSE writes a single Event as an SSE message. Returns false if the
// write failed (client disconnected). // write failed (client disconnected). flusher may be nil (io.Pipe path,
// which has no separate flush step).
func writeSSE(w ioWriter, flusher http.Flusher, ev sqlcgen.Event) bool { func writeSSE(w ioWriter, flusher http.Flusher, ev sqlcgen.Event) bool {
data, err := json.Marshal(ev) data, err := json.Marshal(sqlcEventToGen(ev))
if err != nil { if err != nil {
return true // skip un-serializable events return true // skip un-serializable events
} }
@@ -301,7 +219,9 @@ func writeSSE(w ioWriter, flusher http.Flusher, ev sqlcgen.Event) bool {
if err != nil { if err != nil {
return false return false
} }
flusher.Flush() if flusher != nil {
flusher.Flush()
}
return true return true
} }
@@ -312,28 +232,34 @@ type ioWriter interface {
} }
// StreamEvents implements the OpenAPI interface (SSE event stream). // StreamEvents implements the OpenAPI interface (SSE event stream).
// Uses io.Pipe to bridge the streaming SSE goroutine to the response body. //
// The strict-server model hands us only an io.Reader Body (copied to the
// client via io.Copy in the generated Visit method), not the raw
// ResponseWriter/Flusher — so we bridge with an io.Pipe. ctx is the request
// context (the generated wrapper passes r.Context()); when the client
// disconnects it cancels, the SSE loop returns, and pw.Close() ends the
// io.Copy. Without threading ctx through, each disconnected client would
// leak a goroutine holding a pipe.
//
// Note: io.Copy does not flush per-write, so delivery is chunk-buffered
// rather than strictly real-time. Adequate for the event feed; a raw
// flushing handler is a possible future refinement.
func (s *Server) StreamEvents(ctx context.Context, req gen.StreamEventsRequestObject) (gen.StreamEventsResponseObject, error) { func (s *Server) StreamEvents(ctx context.Context, req gen.StreamEventsRequestObject) (gen.StreamEventsResponseObject, error) {
pr, pw := io.Pipe() pr, pw := io.Pipe()
go func() { go func() {
// Wrap the pipe writer as an http.ResponseWriter-like struct s.serveSSEWriter(ctx, pw, req.Params)
// that implements http.Flusher via calling flush on the pipe
// (which isn't a real flusher — we use the io.Pipe writer directly
// via writeSSE's ioWriter interface).
s.serveSSEWriter(pw, req.Params)
pw.Close() pw.Close()
}() }()
return gen.StreamEvents200TexteventStreamResponse{ return gen.StreamEvents200TexteventStreamResponse{
Body: pr, Body: pr,
ContentLength: -1, // unknown length ContentLength: 0, // unknown/streaming — omit the Content-Length header
}, nil }, nil
} }
// serveSSEWriter runs the SSE loop writing to an io.Writer. // serveSSEWriter runs the SSE loop writing to an io.Writer until the request
func (s *Server) serveSSEWriter(w io.Writer, params gen.StreamEventsParams) { // context is cancelled (client disconnect / server shutdown).
// No explicit flusher for pipe writes — io.Pipe flushes on each Write. func (s *Server) serveSSEWriter(parent context.Context, w io.Writer, params gen.StreamEventsParams) {
ctx := context.Background() ctx, cancel := context.WithCancel(parent)
ctx, cancel := context.WithCancel(ctx)
defer cancel() defer cancel()
sub := &sseSubscriber{ sub := &sseSubscriber{

View File

@@ -11,11 +11,28 @@ import (
"time" "time"
"github.com/dtoro/oikos/internal/db" "github.com/dtoro/oikos/internal/db"
"github.com/google/jsonschema-go/jsonschema"
"github.com/google/uuid" "github.com/google/uuid"
"github.com/jackc/pgx/v5" "github.com/jackc/pgx/v5"
"github.com/modelcontextprotocol/go-sdk/mcp" "github.com/modelcontextprotocol/go-sdk/mcp"
) )
// prop is one input-schema property (name → type + description).
type prop struct {
name, typ, desc string
}
// objSchema builds an "object" JSON Schema from a list of properties. The
// MCP SDK requires every tool to declare an object input schema so tools
// are self-describing to the agent; a nil schema panics at registration.
func objSchema(props ...prop) *jsonschema.Schema {
s := &jsonschema.Schema{Type: "object", Properties: map[string]*jsonschema.Schema{}}
for _, p := range props {
s.Properties[p.name] = &jsonschema.Schema{Type: p.typ, Description: p.desc}
}
return s
}
// NewHandler creates an http.Handler that serves the Oikos MCP server. // NewHandler creates an http.Handler that serves the Oikos MCP server.
func NewHandler(pool *db.Pool, token string) http.Handler { func NewHandler(pool *db.Pool, token string) http.Handler {
s := newServer(pool) s := newServer(pool)
@@ -38,13 +55,21 @@ func newServer(pool *db.Pool) *mcp.Server {
// All tools use the untyped handler (s.AddTool) for simplicity. // All tools use the untyped handler (s.AddTool) for simplicity.
// Arguments are accessed via req.Parameters.Arguments.(map[string]any). // Arguments are accessed via req.Parameters.Arguments.(map[string]any).
s.AddTool(&mcp.Tool{Name: "get_entity", Description: "Get an entity by slug or UUID"}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) { s.AddTool(&mcp.Tool{Name: "get_entity", Description: "Get an entity by slug or UUID",
InputSchema: objSchema(prop{"slug_or_id", "string", "Entity slug (e.g. host:hubris) or UUID"}),
}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) {
args := argsMap(req) args := argsMap(req)
idOrSlug, _ := args["slug_or_id"].(string) idOrSlug, _ := args["slug_or_id"].(string)
return queryEntity(ctx, pool, idOrSlug), nil return queryEntity(ctx, pool, idOrSlug), nil
}) })
s.AddTool(&mcp.Tool{Name: "list_entities", Description: "List entities filtered by type, state, or search"}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) { s.AddTool(&mcp.Tool{Name: "list_entities", Description: "List entities filtered by type, state, or search",
InputSchema: objSchema(
prop{"type", "string", "Filter by entity type"},
prop{"state", "string", "Filter by lifecycle state"},
prop{"q", "string", "Substring match on slug or name"},
prop{"limit", "integer", "Max rows (default 50)"}),
}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) {
args := argsMap(req) args := argsMap(req)
limit := int(getFloat(args, "limit", 50)) limit := int(getFloat(args, "limit", 50))
return queryRows(ctx, pool, ` return queryRows(ctx, pool, `
@@ -57,7 +82,9 @@ func newServer(pool *db.Pool) *mcp.Server {
nStr(args["type"]), nStr(args["state"]), nStr(args["q"]), limit), nil nStr(args["type"]), nStr(args["state"]), nStr(args["q"]), limit), nil
}) })
s.AddTool(&mcp.Tool{Name: "get_relations", Description: "Get relationships for an entity"}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) { s.AddTool(&mcp.Tool{Name: "get_relations", Description: "Get relationships for an entity",
InputSchema: objSchema(prop{"entity_id", "string", "Entity slug"}),
}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) {
args := argsMap(req) args := argsMap(req)
slug, _ := args["entity_id"].(string) slug, _ := args["entity_id"].(string)
return queryRows(ctx, pool, ` return queryRows(ctx, pool, `
@@ -69,7 +96,11 @@ func newServer(pool *db.Pool) *mcp.Server {
ORDER BY r.type`, slug), nil ORDER BY r.type`, slug), nil
}) })
s.AddTool(&mcp.Tool{Name: "get_blast_radius", Description: "Find entities affected if this entity goes down"}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) { s.AddTool(&mcp.Tool{Name: "get_blast_radius", Description: "Find entities affected if this entity goes down",
InputSchema: objSchema(
prop{"entity_id", "string", "Entity slug"},
prop{"depth", "integer", "Traversal depth (default 3)"}),
}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) {
args := argsMap(req) args := argsMap(req)
slug, _ := args["entity_id"].(string) slug, _ := args["entity_id"].(string)
depth := int(getFloat(args, "depth", 3)) depth := int(getFloat(args, "depth", 3))
@@ -78,14 +109,18 @@ func newServer(pool *db.Pool) *mcp.Server {
slug, depth), nil slug, depth), nil
}) })
s.AddTool(&mcp.Tool{Name: "get_health_summary", Description: "Current fleet health summary"}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) { s.AddTool(&mcp.Tool{Name: "get_health_summary", Description: "Current fleet health summary",
InputSchema: objSchema(),
}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) {
return queryRows(ctx, pool, ` return queryRows(ctx, pool, `
SELECT e.slug, e.type, st.health, st.last_check_at SELECT e.slug, e.type, st.health, st.last_check_at
FROM entity_status st JOIN entities e ON e.id = st.entity_id FROM entity_status st JOIN entities e ON e.id = st.entity_id
ORDER BY e.slug`), nil ORDER BY e.slug`), nil
}) })
s.AddTool(&mcp.Tool{Name: "get_audit_trail", Description: "Query the audit log"}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) { s.AddTool(&mcp.Tool{Name: "get_audit_trail", Description: "Query the audit log",
InputSchema: objSchema(prop{"entity_id", "string", "Filter by affected entity UUID"}),
}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) {
args := argsMap(req) args := argsMap(req)
return queryRows(ctx, pool, ` return queryRows(ctx, pool, `
SELECT id, ts, actor_type, action, entity_id::text, method, path, correlation_id SELECT id, ts, actor_type, action, entity_id::text, method, path, correlation_id
@@ -94,7 +129,9 @@ func newServer(pool *db.Pool) *mcp.Server {
ORDER BY ts DESC LIMIT 50`, nStr(args["entity_id"])), nil ORDER BY ts DESC LIMIT 50`, nStr(args["entity_id"])), nil
}) })
s.AddTool(&mcp.Tool{Name: "search_knowledge", Description: "Full-text search across documentation"}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) { s.AddTool(&mcp.Tool{Name: "search_knowledge", Description: "Full-text search across documentation",
InputSchema: objSchema(prop{"query", "string", "Search terms"}),
}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) {
args := argsMap(req) args := argsMap(req)
q, _ := args["query"].(string) q, _ := args["query"].(string)
return queryRows(ctx, pool, ` return queryRows(ctx, pool, `
@@ -104,7 +141,9 @@ func newServer(pool *db.Pool) *mcp.Server {
ORDER BY title LIMIT 20`, q), nil ORDER BY title LIMIT 20`, q), nil
}) })
s.AddTool(&mcp.Tool{Name: "query_metrics", Description: "Query time-series metrics"}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) { s.AddTool(&mcp.Tool{Name: "query_metrics", Description: "Query time-series metrics",
InputSchema: objSchema(prop{"hours", "integer", "Look-back window in hours (default 24)"}),
}, func(ctx context.Context, req *mcp.CallToolRequest) (*mcp.CallToolResult, error) {
args := argsMap(req) args := argsMap(req)
hours := int(getFloat(args, "hours", 24)) hours := int(getFloat(args, "hours", 24))
return queryRows(ctx, pool, ` return queryRows(ctx, pool, `

View File

@@ -0,0 +1,40 @@
package mcp
import (
"testing"
)
// TestNewServerRegistersTools verifies every tool registers with a valid
// input schema. The MCP SDK panics at AddTool if a tool omits its object
// input schema, so merely constructing the server exercises that contract —
// this test would have caught the "missing input schema" panic.
func TestNewServerRegistersTools(t *testing.T) {
defer func() {
if r := recover(); r != nil {
t.Fatalf("newServer panicked (tool schema bug?): %v", r)
}
}()
// pool is only used inside tool handlers (invoked per-call), not at
// registration time, so a nil pool is safe for this construction test.
s := newServer(nil)
if s == nil {
t.Fatal("newServer returned nil")
}
}
func TestObjSchema(t *testing.T) {
s := objSchema(prop{"foo", "string", "a foo"}, prop{"n", "integer", "a number"})
if s.Type != "object" {
t.Errorf("schema type = %q, want object", s.Type)
}
if len(s.Properties) != 2 {
t.Fatalf("got %d properties, want 2", len(s.Properties))
}
if s.Properties["foo"].Type != "string" || s.Properties["n"].Type != "integer" {
t.Errorf("property types wrong: %+v", s.Properties)
}
// empty schema still valid (object with no properties)
if objSchema().Type != "object" {
t.Error("empty objSchema not an object")
}
}