chore: Fix app

2026-07-14 00:41:05 +02:00
parent 3e090933fd
commit edc4d935d8
98 changed files with 2878 additions and 155 deletions
@@ -0,0 +1,60 @@
+# Voice & WebRTC
+
+> **Status:** Active
+> **Last updated:** 2026-07-05
+
+## Overview
+
+Voice channels, camera, and screen-share use direct **WebRTC** peer connections between clients. The signaling server relays SDP offers/answers/ICE and **voice presence** (`voice_state`); media never flows through the server.
+
+## Responsibilities
+
+| Layer | Owns |
+|-------|------|
+| `infrastructure/realtime/` | WebRTC sessions, negotiation, data channels, RNNoise worklet |
+| `voice-connection` / `voice-session` domains | Facades, workspace UI, settings, multi-device ownership |
+| `screen-share` domain | Source picker, quality presets (Electron) |
+| Signaling server | RTC relay + `voice_state` / `voice_client_takeover` broadcast |
+
+## WebSocket signaling types
+
+| type | Purpose |
+|------|---------|
+| `offer`, `answer`, `ice_candidate` | WebRTC negotiation relay to `targetUserId` |
+| `voice_state` | Voice roster (mute/deafen/speaking, channel id); sets `voiceActive` on one connection per user |
+| `voice_client_takeover` | Notify sibling tabs to yield voice ownership |
+
+Relay rules: RTC messages require shared server membership (except DM-specific types). See [signaling.md](signaling.md).
+
+## Multi-device voice
+
+- Only one connection per `oderId` may be `voiceActive`; RTC offers route to that connection (fallback: any open connection).
+- Other tabs show passive UI and may send `voice_client_takeover`.
+- `clientInstanceId` in `identify` and voice payloads distinguishes tabs.
+
+## Media pipeline (client)
+
+- **Voice:** `getUserMedia` → optional RNNoise AudioWorklet → gain → same-room peer routing only.
+- **Camera:** separate video track; same-room filter.
+- **Screen share:** on-demand via data-channel `SCREEN_SHARE_REQUEST`; platform-specific capture (browser `getDisplayMedia`, Electron picker, Linux PulseAudio routing).
+
+## P2P data channel
+
+Carries voice/screen control messages, chat, attachments, and state sync — not server-relayed. Data-channel failure triggers peer renegotiation or full rebuild (see realtime README).
+
+## Mobile / Capacitor
+
+Background voice uses Android foreground service + iOS audio/CallKit bridges — [mobile-capacitor.md](mobile-capacitor.md). Screen share is limited on mobile WebViews.
+
+## Related
+
+- [signaling.md](signaling.md) — envelope catalog
+- [direct-messaging.md](direct-messaging.md) — private calls share `PeerDeliveryService`
+- [`toju-app/src/app/infrastructure/realtime/README.md`](../../toju-app/src/app/infrastructure/realtime/README.md) — negotiation, recovery, RNNoise
+- Domain READMEs: `voice-connection`, `voice-session`, `screen-share`
+
+## Changelog
+
+| Date | Change |
+|------|--------|
+| 2026-07-05 | Initial cross-context voice/WebRTC contract |