Files
OSGKeyboard/OSGKeyboardShared/Services/FlowSessionKeys.swift
T
rockyandClaude Opus 5 0023741455 feat(app): add crash visibility, memory relief, and clipboard reply work
Squashes the working tree that had accumulated on cloud-agent. Two
strands of work, kept in one commit at the maintainer's request.

Crash and stability (this session):

- Subscribe to MetricKit so crash, hang, CPU, and disk-write diagnostics
  are recorded on device. Keyboard-extension memory kills are the most
  likely way a user loses the keyboard mid-sentence and iOS does not
  classify them as crashes, so they never reach App Store Connect.
- Upload those reports to POST /v1/analytics/diagnostics from internal
  builds only (local Debug and TestFlight), reusing the analytics
  installation identifier and skipping entirely when analytics are off.
  App Store builds keep everything on device.
- Shed the Chinese engine, English lexicon, and in-flight pipeline work
  at the 40 MiB and 48 MiB budget thresholds instead of waiting for a
  system memory warning that jetsam often preempts.
- Install audio taps with the input node's live format through one
  shared adaptive resampler, so an audio-route change mid-recording no
  longer raises an uncatchable format-mismatch exception. Covers the
  dictation preview and the Mac recorder, which still used the pattern
  the Flow capture path had already moved away from.
- Harden the librime bridge: never pass a nil string across a nonnull
  boundary when a user dictionary holds malformed UTF-8, null-check the
  engine API vector, and distrust a candidate count without its array.
- Guard the expanded candidate grid against a list that shrinks while
  the collection view is still laying out against the previous count.
- Resolve localized text without the App Group so the screen shown when
  that container is missing renders its message instead of crashing on
  launch, which is the one situation it exists to handle.
- Gate CI on the App Group and Keychain wiring that the keyboard
  extension hard-depends on, with a self-test proving the check fails.

Clipboard, reply, and semantics (pre-existing working tree):

- Unify the reply center, refresh keyboard AI features, and add native
  event and reminder exporters.
- Expand clipboard semantic routing with authored corpora and a
  product-blind holdout, plus the scripts that build and validate them.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-18 17:31:29 -07:00

173 lines
9.2 KiB
Swift

// FlowSessionKeys.swift
// OSGKeyboard · Shared
//
// App Group keys for TypeWhisper-style Flow sessions between the
// keyboard extension and the host app (Session Owner).
import Foundation
public enum FlowSessionKeys {
public static let flowCommandPayload = "flow.commandPayload.v1"
public static let flowCommandJournalPayload = "flow.commandJournalPayload.v2"
public static let flowResultPayload = "flow.resultPayload.v1"
public static let flowAckPayload = "flow.ackPayload.v1"
public static let flowStartTransactionPayload = "flow.startTransaction.v1"
public static let pendingKeyboardUtteranceId = "flow.pendingKeyboardUtteranceId.v1"
public static let flowReadyPayload = "flow.readyPayload.v1"
public static let flowSessionActive = "flow.flowSessionActive"
public static let flowSessionExpires = "flow.flowSessionExpires"
public static let flowHeartbeat = "flow.flowHeartbeat"
/// Host-published contract: capture + polling idle and able to accept utterances.
public static let flowHostReady = "flow.flowHostReady"
/// Wall-clock timestamp paired with `flowHostReady` (seconds since 1970).
public static let flowHostReadyAt = "flow.flowHostReadyAt"
public static let keyboardRecordingState = "flow.keyboardRecordingState"
public static let transcriptionLanguage = "flow.transcriptionLanguage"
public static let transcriptionResult = "flow.transcriptionResult"
/// Live pipelined ASR partial for the keyboard transcript line.
public static let transcriptionPartial = "flow.transcriptionPartial"
/// Soft warning when polish failed but raw transcript was delivered.
public static let transcriptionPolishWarning = "flow.transcriptionPolishWarning"
public static let transcriptionError = "flow.transcriptionError"
/// Structured kind paired with `transcriptionError` for keyboard UI.
public static let transcriptionErrorKind = "flow.transcriptionErrorKind"
public static let audioLevels = "flow.audioLevels"
/// Bundle id of the app that opened `osgkeyboard://startflow` (scheme D).
public static let pendingHostBundleId = "flow.pendingHostBundleId"
/// Wall-clock of the last keyboard→`startflow` PiP arm attempt (debounce re-jumps).
public static let lastPiPArmAttemptAt = "flow.lastPiPArmAttemptAt.v1"
/// Minimum gap between repeated proactive `startflow` jumps.
public static let pipArmCooldown: TimeInterval = 45
/// Keyboard→host request for a companion Flow diagnostics snapshot. The
/// keyboard is the process that observes "the session never came up", but
/// only the host knows why it never published ready — this asks the host to
/// dump its own breadcrumb window alongside the keyboard's report.
public static let flowDiagnosticsDumpRequest = "flow.diagnosticsDumpRequest.v1"
/// Wall-clock timestamp of the last utterance completion or session start.
public static let lastActivityAt = "flow.lastActivityAt"
/// One-shot token rotated by every host-process launch. State written by
/// a previous generation is void by definition — a fresh launch proves the
/// previous process is dead, whether or not its `applicationWillTerminate`
/// cleanup ever ran (it does NOT run when a suspended app is force-quit).
public static let hostGeneration = "flow.hostGeneration.v1"
/// Host is mid heavy work (Rime/CLM/ASR). Extension should stay on voice
/// and skip typing engine prepare until this clears.
public static let hostHeavy = "flow.hostHeavy.v1"
/// Wall-clock timestamp paired with `hostHeavy` (seconds since 1970).
/// Lets the keyboard ignore a sticky flag left behind when the host died
/// mid-warmup without ever clearing App Group state.
public static let hostHeavyAt = "flow.hostHeavyAt.v1"
/// `hostHeavy` older than this is treated as stale (host likely jetsammed
/// or force-quit before `setHostHeavy(false)`). Rime/CLM/ASR bursts are
/// expected well under this window.
public static let hostHeavyMaxAge: TimeInterval = 120
/// Heartbeat older than this → host is not actively reachable for recording.
public static let heartbeatStaleInterval: TimeInterval = 3
/// `flowHostReadyAt` must be within this window of the latest heartbeat.
public static let hostReadyMaxHeartbeatSkew: TimeInterval = 5
/// Session flag still set but heartbeat older than this → host process is
/// dead (force-quit, reboot). Keyboard / host should clear persisted state.
public static let heartbeatZombieInterval: TimeInterval = 60
/// After mic stop, fail fast when the host heartbeat is gone longer than this.
public static let keyboardHostDisconnectFailFast: TimeInterval = 15
/// Legacy fixed session length — prefer `FlowSessionPolicy.sessionDuration()`.
public static let defaultSessionDuration: TimeInterval = 480
/// Maximum duration for a single keyboard utterance (3.5 minutes).
public static let maxUtteranceDuration: TimeInterval = 210
/// User action → proven audio. Shared by normal dictation and edit mode.
/// Correct for a host that is already alive (warm handoff); a cold-start
/// jump uses the launch budget below instead.
public static let utteranceStartBudget: TimeInterval = 8
/// Cold-start `startflow` jump: soft budget anchored at the jump itself
/// (not the mic press) so it covers host foreground + PiP arm + first ready
/// publish. Anchoring at the press charged app-launch latency against the
/// recording budget and timed out legitimate cold starts.
public static let coldStartHostLaunchBudget: TimeInterval = 12
/// Absolute cap for a cold-start jump, even while the host keeps
/// acknowledging that it is warming. Bounds the wait when the host is stuck
/// in the background and the user never brings it forward.
public static let coldStartHostLaunchHardCap: TimeInterval = 20
/// Each fresh host start-acknowledgement pushes the soft cold-start budget
/// out to `now + this` (capped by the hard cap).
public static let hostStartAckExtension: TimeInterval = 6
/// A ready snapshot whose `heartbeatAt` is within this window counts as a
/// live "host is warming" acknowledgement. Kept short so a stale snapshot
/// from a dead/suspended host cannot keep extending the budget.
public static let hostStartAckFreshInterval: TimeInterval = 4
/// Edit stop → reviewed result delivered to the keyboard.
public static let editLastInputProcessingBudget: TimeInterval = 45
/// Host work budget leaves five seconds for serialization and delivery.
public static let editLastInputHostProcessingBudget: TimeInterval = 40
/// Host polls for pipelined ASR drain after mic stop. Pipelining usually
/// finishes most chunks during recording; this is a soft deadline before
/// blocking on `asrTask.value` (which waits until the pipeline exits).
public static let localASRWaitTimeout: TimeInterval = 8
public static let cloudASRWaitTimeout: TimeInterval = 12
public static let batchASRFallbackTimeout: TimeInterval = 8
/// Hard cap on a single LLM polish request. `PolishingService`'s scaled
/// per-request timeout clamps to this value, so it participates in the
/// keyboard-watchdog budget below.
public static let maxPolishTimeout: TimeInterval = 35
public static let aiQuestionRequestTimeout: TimeInterval = 60
/// Extra slack for result serialization, cross-process propagation, and
/// the host's own polling cadence.
public static let resultDeliveryMargin: TimeInterval = 5
public static func polishTimeout(forCharacterCount count: Int) -> TimeInterval {
if count <= 150 { return 10 }
if count <= 500 { return 20 }
return maxPolishTimeout
}
/// Keyboard watchdog after the user stops recording (not utterance max
/// length). Derived from the host-side budget so it always outlasts the
/// host's worst case (ASR drain wait + polish cap + margin) — hand-tuned
/// constants drifted below the real host maximum, making the keyboard
/// report a timeout for transcriptions that were still going to succeed.
public static func keyboardResultTimeout(engineMode: String) -> TimeInterval {
let asrWait = engineMode == "local" ? localASRWaitTimeout : cloudASRWaitTimeout
return asrWait + batchASRFallbackTimeout + maxPolishTimeout + resultDeliveryMargin
}
public static func keyboardAIResultTimeout(engineMode: String) -> TimeInterval {
let asrWait = engineMode == "local" ? localASRWaitTimeout : cloudASRWaitTimeout
return asrWait
+ batchASRFallbackTimeout
+ aiQuestionRequestTimeout
+ resultDeliveryMargin
}
public enum RecordingState: String, Sendable, Equatable {
case idle
case recording
case stopped
case processing
case aborted
}
/// Structured host → keyboard transcription failure kind.
public enum TranscriptionErrorKind: String, Sendable, Equatable, Codable {
case noSpeech
case recognitionInterrupted
case audioUnavailable
case asrFailed
case generic
/// Short silent tap discarded before ASR — keyboard returns to idle quietly.
case discardedEmpty
}
}