--- phase: 03-event-write-back-pwa-install plan: 04 type: tdd wave: 3 depends_on: ["03-02", "03-03"] files_modified: - apps/api/src/broker/outboxWorker.ts - apps/api/src/index.ts - apps/api/tests/broker/outboxWorker.test.ts autonomous: true requirements: [CAL-04, CAL-05, CAL-06, CAL-07] user_setup: [] must_haves: truths: - "The worker drains pending outbox rows, builds the VEVENT, PUTs/DELETEs via the broker, and triggers a targeted single-calendar re-sync on success (D-06)" - "Transient failures (5xx/network/timeout) back off exponentially within a bounded window; max attempts → dead (D-07)" - "Hard failures (400/401/403) stop immediately as failed (D-07)" - "412 conflicts route OUT of the retry loop into the conflict flow: mark failed, re-sync, no overwrite (D-08)" - "Edit-as-move processes the create row before the linked delete row; create-fail aborts the delete (D-04)" - "The worker is started from index.ts as a sibling to the ctag poller" artifacts: - path: "apps/api/src/broker/outboxWorker.ts" provides: "runOutboxDrain + startOutboxWorker (state machine, retry/backoff, re-sync)" exports: ["runOutboxDrain", "startOutboxWorker"] min_lines: 60 - path: "apps/api/src/index.ts" provides: "startOutboxWorker() wired at startup" contains: "startOutboxWorker" key_links: - from: "apps/api/src/broker/outboxWorker.ts" to: "broker/write.ts" via: "create/update/deleteCalendarEvent" pattern: "(create|update|delete)CalendarEvent" - from: "apps/api/src/broker/outboxWorker.ts" to: "broker/sync.ts syncCalendar" via: "targeted re-sync on confirm (D-06)" pattern: "syncCalendar" - from: "apps/api/src/index.ts" to: "startOutboxWorker" via: "background worker startup" pattern: "startOutboxWorker" --- Build the outbox worker — the load-bearing async engine of D-05/06/07/08. It drains pending `calendar_outbox` rows, builds the VEVENT (Plan 02 `vevent.ts`), writes through the broker (Plan 02 `write.ts`), classifies the response (transient/hard/conflict), and on success triggers a targeted single-calendar re-sync (Plan 03 endpoints filled the queue; existing `sync.ts` re-syncs). Then wire it into `index.ts` beside the ctag poller. Purpose: this closes the create/edit/delete loop end-to-end — after this plan a queued write actually reaches Fastmail and the cache becomes authoritative. Built TDD because the state machine (backoff, dead-letter, 412 routing, edit-as-move ordering) is the highest-risk logic in the phase. Output: `outboxWorker.ts` GREEN against Plan 01's state-machine tests; worker started at boot. @$HOME/.claude/get-shit-done/workflows/execute-plan.md @$HOME/.claude/get-shit-done/templates/summary.md @.planning/phases/03-event-write-back-pwa-install/03-RESEARCH.md @.planning/phases/03-event-write-back-pwa-install/03-PATTERNS.md @apps/api/src/broker/poller.ts @apps/api/src/broker/sync.ts @apps/api/src/index.ts Task 1: GREEN — outbox drain state machine (outboxWorker.ts) apps/api/src/broker/outboxWorker.ts, apps/api/tests/broker/outboxWorker.test.ts - apps/api/tests/broker/outboxWorker.test.ts (RED state-machine stubs from Plan 01 — the contract) - .planning/phases/03-event-write-back-pwa-install/03-RESEARCH.md (§Pattern 4 — full runOutboxDrain reference; status classification sets; §Pitfall 5 edit-as-move; §Pitfall 7 DAVCalendar fetch for re-sync; §Pitfall 4 etag re-fetch) - apps/api/src/broker/poller.ts (analog — runX/startX pair, node-cron schedule, per-item error isolation, decrypt-then-client pattern, Drizzle select/where/limit) - apps/api/src/broker/sync.ts (syncCalendar signature: client, davCal, userId) - apps/api/src/broker/write.ts (create/update/deleteCalendarEvent — from Plan 02) - apps/api/src/broker/vevent.ts (buildVeventString — from Plan 02) - .planning/phases/03-event-write-back-pwa-install/03-PATTERNS.md (§outboxWorker.ts — exact poller-derived patterns) RED → GREEN. With mocked db, write.ts, sync.ts, and Fastmail client, tests assert: - pending row + mock create response 204/201 → status='done' AND triggerTargetedResync called for that calendarUrl (D-06). - mock response 412 → status='failed', re-sync triggered, NO retry, NO overwrite (D-08 conflict flow). - mock response 500 (transient) → status stays 'pending', attemptCount incremented, nextAttemptAt advanced by the backoff schedule (D-07). - transient failures repeated until attemptCount === MAX_ATTEMPTS → status='dead'. - mock response 401/403/400 (hard) → status='failed' immediately, no retry (D-07). - edit-as-move pair (shared groupId): the 'create' row is dispatched before the linked 'delete' row; if create fails, the delete is NOT executed (D-04 — duplicate is recoverable, lost event is not). Implement `runOutboxDrain()` and `startOutboxWorker()` per RESEARCH.md Pattern 4. Constants: `MAX_ATTEMPTS=5`, `BACKOFF_SECONDS=[15,60,300,600,1800]`, `TRANSIENT_STATUSES={408,429,500,502,503,504}`, `HARD_FAIL_STATUSES={400,401,403}`, `CONFLICT_STATUS=412`. Select `WHERE status='pending' AND next_attempt_at <= NOW()` limit 10. For each row: load the owning member's credential+client (decrypt via crypto.js + createFastmailClient like poller.ts), build the VEVENT via `buildVeventString` from the row payload for create/update, call the matching write.ts function, classify the Response status. On success or 412 call `triggerTargetedResync(calendarUrl, userId)` which fetches calendars via `client.fetchCalendars()`, finds the DAVCalendar by url (Pitfall 7), and calls `syncCalendar` — this captures the fresh etag/objectUrl (Pitfall 4). Update outbox status with the Drizzle update pattern. Order edit-as-move: process rows ordered so a row with `operation='create'` and a groupId runs before its sibling `operation='delete'`; on create failure skip the linked delete. Per-row try/catch logs without crashing the loop; never log decrypted passwords (T-03-04). `startOutboxWorker` schedules `runOutboxDrain` every 15s (node-cron `*/15 * * * * *` or setInterval), mirroring `startBrokerPoller`. cd /home/luc/Projects/familysync && pnpm --filter @familysync/api test -- broker/outboxWorker && pnpm --filter @familysync/api exec tsc --noEmit - outboxWorker.test.ts GREEN for all six behaviors (done, 412-conflict, backoff, dead, hard-fail, edit-as-move order). - `grep -q "syncCalendar" apps/api/src/broker/outboxWorker.ts` (D-06 re-sync). - `grep -Eq "412|CONFLICT_STATUS" apps/api/src/broker/outboxWorker.ts` (D-08). - tsc --noEmit passes. The outbox worker drains, writes, classifies, re-syncs, and handles backoff/dead/conflict/edit-as-move exactly per D-04/06/07/08; tests GREEN. Task 2: Wire startOutboxWorker into index.ts beside the ctag poller apps/api/src/index.ts - apps/api/src/index.ts (existing — startBrokerPoller() is called near the bottom; mirror placement/import style) - apps/api/src/broker/outboxWorker.ts (from Task 1 — exports startOutboxWorker) Add `import { startOutboxWorker } from './broker/outboxWorker.js'` next to the existing poller import. Call `startOutboxWorker()` immediately after the existing `startBrokerPoller()` call, with a one-line comment noting it drains the D-05 outbox every 15s. Do not move or alter the poller, route mounts, OIDC guard, or server-start guard. cd /home/luc/Projects/familysync && grep -q "startOutboxWorker()" apps/api/src/index.ts && pnpm --filter @familysync/api exec tsc --noEmit && pnpm --filter @familysync/api test - `grep -c "startOutboxWorker()" apps/api/src/index.ts` ≥1. - Full API test suite GREEN; tsc --noEmit passes. The outbox worker starts at API boot alongside the poller; full API suite green. ## Trust Boundaries | Boundary | Description | |----------|-------------| | worker → Fastmail | The worker is the only component that drains the outbox to Fastmail | | stored payload → VEVENT | Member-supplied payload is reconstructed into an ICS PUT | ## STRIDE Threat Register | Threat ID | Category | Component | Disposition | Mitigation Plan | |-----------|----------|-----------|-------------|-----------------| | T-03-11 | Repudiation | silent last-write-wins on concurrent edit | mitigate | 412 If-Match conflict routes to conflict flow (re-sync + warn), never overwrites (D-08) | | T-03-12 | Denial of Service | a poison row retrying forever | mitigate | MAX_ATTEMPTS=5 then dead-letter; bounded backoff window (~30 min) per D-07 | | T-03-13 | Information Disclosure | logging decrypted app password during dispatch | mitigate | Per-item catch logs `err.message` only; never the credential (poller T-03-04 pattern) | | T-03-14 | Tampering | partial-failure data loss on edit-as-move | mitigate | create-before-delete ordering; create-fail aborts delete; delete-fail surfaces "remove manually" (D-04) | - `pnpm --filter @familysync/api test` full suite GREEN (includes outboxWorker + routes/events from Plan 03). - `grep -c "startOutboxWorker()" apps/api/src/index.ts` ≥1. - No tsdav import outside broker/: worker uses write.ts/client.ts only. - End-to-end backend write loop closed: endpoint → outbox → worker → Fastmail → re-sync → cache authoritative. - D-04/D-06/D-07/D-08 all enforced and tested. Create `.planning/phases/03-event-write-back-pwa-install/03-04-SUMMARY.md` when done.