bec36befa2
This is a major rewrite of OpenLessKeyboard, renamed to OSGKeyboard
and rebuilt end-to-end. 59 files changed (+3205/-1550).
Architecture
------------
- Rename project, targets, directories from OpenLess* to OSGKeyboard*
(OpenLess / OpenLessKeyboard / OpenLessShared / OpenLessTests).
- AudioCaptureService rewritten as @unchecked Sendable class with
OSAllocatedUnfairLock instead of an actor, so it survives Swift 6
strict-concurrency checks while still serialising engine + converter
state correctly.
- Single design system (Palette / Spacing / Radius / TypeStyle /
Motion) lifted into OSGKeyboardShared so the host app and the
keyboard extension stay in lock-step.
Push-to-talk — first-principles fix
-----------------------------------
- App Group + audio-input entitlements were stripped by Xcode's
Automatic Signing. They are now declared in project.yml so
'xcodegen generate' re-emits them every time. iOS Developer
Account is untouched; only the App Group capability was added.
- State machine uses a real stored `phase` (was a derived shim
that locked out every press after the first because
recordStream was never nilled after the pipeline finished).
- Microphone permission is requested inside pressBegan (async
Task) so the press flow optimistically enters .recording;
permission denial surfaces a short error and returns to idle.
- Replaced LongPressGesture(0.15s) with a DragGesture +
TapGesture pair separated by pressArmed, so a single tap no
longer fires both onPressBegan and onTap simultaneously.
- Real RMS / peak level meter from the AVAudioEngine tap (was a
pseudo-random walk); the visible waveform is now driven by
actual audio.
- SFSpeechRecognizer(locale:) with selectable ASR locales
(auto / zh-Hans / zh-Hant / en-US / ja-JP / ko-KR) for
first-class Chinese / English / Japanese / Korean dictation,
with on-device recognition when supported.
- AVAudioSession now deactivates on stop so other apps' audio
routing is restored.
Keyboard UI — Typeless-inspired layout
---------------------------------------
- Hero area is 280 pt with a 96 pt record disc, breathing outer
ring, and a 12-bar waveform driven by the real RMS.
- inputView.allowsSelfSizing + a heightAnchor constraint so iOS
no longer crops the keyboard under the Spotlight bar / home
indicator.
- Top bar: mode chip (Off / 转写 / 润色) + locale chip
(Auto / 简体 / 繁體 / EN / 日 / 한) + status badge + ⚙.
- Bottom bar: globe / delete / 空格 / return — all 40 pt and
balanced.
- RecordButton onPressEnded is now safe to fire from a quick
press; pressArmed prevents double-firing.
LLM / Polishing
---------------
- LLMClient: stopped leaking the server response body in errors
(server body is now logged at debug, never surfaced to UI);
added a dedicated .rateLimited case for 429.
- PolishingService timeout 8s → 12s to accommodate slower
domestic LLM providers.
- AppGroupStore.defaultSystemPrompt is now provider-aware
(Chinese for zhipu/moonshot/qwen/deepseek, English otherwise).
Onboarding & Settings
---------------------
- Re-themed OnboardingView / HomeView / SettingsView on the
new design system.
- ProviderPickerSection now shows 6 providers (OpenAI, DeepSeek,
Qwen DashScope, 智谱 GLM, 月之暗面 Moonshot, Custom) with
blurb + selected accent.
- PickerRow for Mode and ASR locale; System Prompt editor with
reset-to-default.
- API settings page "Get an API key" used SwiftUI Link, which
has a hit-test bug on iOS 18 that ate gestures from adjacent
TextFields (manifested as "typing jumps to a website"). It is
now an explicit Button + contentShape + .submitLabel(.done) on
the fields.
Polish & tests
--------------
- LLMClientTests: 4 unit tests passing (ProviderConfig
persistence + OpenAI request/response + HTTP error + missing
key); test App Group renamed to the correct identifier.
- ProviderConfig.apply now captures the previous provider id
*before* mutating, so switching providers actually resets the
system prompt to the new default.
Build
-----
- Swift 6 strict concurrency, iOS 18.0 deployment target.
- Tested on Xcode 26 + iPhone 17 Pro simulator. A real device on
iOS 27 beta aborts with __abort_with_payload (dispatch
library ABI mismatch); use an iOS 18 real device or the
iOS 26 simulator for now.
🤖 Generated with Claude Code
6.2 KiB
6.2 KiB
OSGKeyboard
按住说话,松开即得 AI 润色文字,插入任意 App 的光标处。 一款开源的 iOS 自定义键盘语音输入工具,灵感来自 Typeless 和 OpenLess。
这是什么?
OSGKeyboard 是商业语音输入工具的免费开源替代。它以 iOS 自定义键盘扩展 的形式运行,所以你可以在 任何 App 里使用 —— 微信、备忘录、邮件、ChatGPT、Claude、Cursor,无所不能。
- 长按麦克风键
- 自由说话
- 松开 —— AI 帮你整理成干净的文字,自动插入光标处
音频始终在设备本地转写(iOS 26+ 用 SpeechAnalyzer,iOS 18/19 用 SFSpeechRecognizer),只有润色后的文本 会发到你选择的云端 LLM。音频永不离开你的手机。
特性
- 🎙 按住说话,Typeless 风格的圆形麦克风按钮
- 🧠 端侧 ASR(iOS 26
SpeechAnalyzer+DictationTranscriber;iOS 18 退回SFSpeechRecognizer) - ✍️ AI 润色 —— 自动加结构、补标点、修正语法、可生成列表
- 🔌 自带 API 接入 —— 兼容任何 OpenAI 兼容协议端点(OpenAI / DeepSeek / Qwen DashScope / 自建服务器 ……)
- 🔒 隐私优先 —— 音频不离开设备;只有润色文本会发给你选择的 LLM
- 🎨 原生 SwiftUI —— 暗色主题、毛玻璃、约 2000 行 Swift
- 🪶 零依赖 —— 无 SwiftPM 包、无 CocoaPods、无 Carthage
快速开始
环境要求
- macOS + Xcode 16+(推荐 Xcode 26)
- iPhone 运行 iOS 18.0+(iOS 26+ 体验最佳)
- XcodeGen:
brew install xcodegen - 一个 OpenAI 兼容 API Key(OpenAI / DeepSeek / Qwen DashScope 任一)
编译与运行
git clone https://github.com/<你的用户名>/OSGKeyboard.git
cd OSGKeyboard
xcodegen generate # 生成 OSGKeyboard.xcodeproj
open OSGKeyboard.xcodeproj # 或命令行编译:
xcodebuild -project OSGKeyboard.xcodeproj -scheme OSGKeyboard \
-destination 'generic/platform=iOS Simulator' build
在 iOS 中启用键盘
- 在真机/模拟器上运行 App。
- 按 3 步引导:启用键盘 → 允许完全访问(麦克风 + LLM 调用必须) → 粘贴 API Key。
- 在任意输入框,点 🌐 切换到 OSGKeyboard。
- 长按麦克风键 → 说话 → 松开。✨
"允许完全访问"是必须的。 没有它,iOS 会阻止键盘使用麦克风与网络。我们绝不记录、存储或上传你的击键 —— 见
PrivacyInfo.xcprivacy。
架构
OSGKeyboard/
├── OSGKeyboard/ # 主 iOS App(设置、Onboarding)
│ ├── Views/ # SwiftUI 屏幕
│ ├── OSGKeyboardApp.swift # @main 入口
│ ├── PrivacyInfo.xcprivacy # 隐私清单
│ └── OSGKeyboard.entitlements # App Group 声明
├── OSGKeyboardExt/ # 自定义键盘扩展
│ ├── KeyboardViewController.swift # 主体类
│ ├── Services/
│ │ ├── AudioCaptureService.swift # AVAudioEngine → 16kHz PCM
│ │ ├── ASRService.swift # iOS 26 + iOS 18 ASR
│ │ └── PolishingService.swift # LLM 调用(带超时)
│ └── Views/ # 录音按钮、波形、键盘主视图
├── OSGKeyboardShared/ # 主 App + 键盘共享 framework
│ ├── Models/ # ProviderConfig、LLMRequest、LLMProvider
│ ├── Services/ # LLMClient(OpenAI 兼容)
│ └── Constants/ # App Group ID
├── OSGKeyboardTests/ # XCTest 单元测试
├── project.yml # XcodeGen 工程定义
└── .github/workflows/ci.yml # Lint + 编译 CI
数据流
[长按麦克风] → AudioCaptureService → AudioBufferSnapshot (16kHz mono)
↓
ASRService.transcribe()
↓
ASREvent.final(原始转写文本)
↓
PolishingService.polish()
↓
LLMClient(OpenAI 兼容协议)
↓
textDocumentProxy.insertText(润色后文本)
新增 LLM 提供商
打开 OSGKeyboardShared/Models/LLMProvider.swift,在 presets 数组里追加一条 LLMProvider 即可。默认的 OpenAICompatibleClient 处理任何实现了 POST /chat/completions 的端点。
LLMProvider(
id: "groq",
name: "Groq",
defaultBaseURL: "https://api.groq.com/openai/v1",
defaultModel: "llama-3.1-70b-versatile",
apiKeyURL: URL(string: "https://console.groq.com/keys")
)
仅此而已,无需改动其他代码。
限制
- iOS 沙盒:键盘扩展 ~60 MB 内存上限,必须开完全访问
- 密码框与部分
WKWebView输入框不可用(iOS 限制) - iOS 18 用
SFSpeechRecognizer退化路径;iOS 26 的SpeechAnalyzer更快、支持语种更多
许可
MIT —— 使用、修改、商用均可。无任何担保。
致谢
- 灵感来源:Typeless 与桌面端开源版 OpenLess
- 工程脚手架:XcodeGen
- 端侧 ASR:Apple SpeechAnalyzer / SFSpeechRecognizer
注意:把 <你的用户名> 替换成你的 GitHub 用户名。