rocky/OSGKeyboard
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Compare commits

base: rocky/OSGKeyboard:3033ca5b336a51134c556e956de2b9efd555805a
Branches Tags
rocky/OSGKeyboard:main rocky/OSGKeyboard:cursor/cloud-agent-1787824905651-vxuwc
..
compare: rocky/OSGKeyboard:main
Branches Tags
rocky/OSGKeyboard:cursor/cloud-agent-1787824905651-vxuwc rocky/OSGKeyboard:main

1 Commits
3033ca5b33 .. main

Author SHA1 Message Date
Rocky 6a7fd35362 chore(ml): preserve clipboard semantic training artifacts
CI / Validate manifests (push) Has been cancelled
Details
CI / SwiftLint (push) Has been cancelled
Details
CI / iOS / Extension (push) Has been cancelled
Details
CI / macOS (push) Has been cancelled
Details
2026-08-27 18:03:34 +08:00
295 changed files with 43857 additions and 138810 deletions
Expand all files Collapse all files
.gitignore
-34
View File
@@ -65,25 +65,6 @@ OSGKeyboard/Resources/CustomLanguageModel/v1/compiled/
# Reproducible Create ML candidates (selected models live in Shared resources)
ModelTraining/ClipboardSemantics/Candidates/
# Reproducible open-data corpus artifacts (regenerated from pinned sources)
ModelTraining/ClipboardSemantics/Generated/
ModelTraining/ClipboardSemantics/open-training-corpus.jsonl
ModelTraining/ClipboardSemantics/combined-training-corpus.jsonl
ModelTraining/ClipboardSemantics/v6-boundary-training-supplement.jsonl
ModelTraining/ClipboardSemantics/v6-blind-evaluation-corpus.jsonl
ModelTraining/ClipboardSemantics/Consensus/*.jsonl
ModelTraining/ClipboardSemantics/CorpusRegistry/*.jsonl
ModelTraining/ClipboardSemantics/CorpusRegistry/Labels/
ModelTraining/ClipboardSemantics/CorpusRegistry/*-report.json
ModelTraining/ClipboardSemantics/VerifierCandidates/
ModelTraining/ClipboardSemantics/IterativeResearch/**/rounds.json
ModelTraining/ClipboardSemantics/IterativeResearch/**/final-report.json
# Blind review queues can contain restricted evaluation text and reviewer IDs.
ModelTraining/ClipboardSemantics/BlessingBenchmark/*.jsonl
ModelTraining/ClipboardSemantics/BlessingBenchmark/manifest.json
ModelTraining/ClipboardSemantics/BlessingBenchmark/final-manifest.json
# Python bytecode
__pycache__/
*.pyc
@@ -112,18 +93,3 @@ CHANGES.md
.ai-skills-layout-shots/
.workbuddy-ai/
reports/
# Internal planning / audit docs kept locally only (zero in-repo or
# GitHub-Pages references; never re-add these — they were removed
# in 2026-08 to keep the public docs/ limited to GitHub Pages assets).
/docs/ACCOUNT_MANAGED_GATEWAY_TESTING.md
/docs/APPSTORE_METADATA.md
/docs/STOREKIT_TESTING.md
/docs/TYPING_KEYBOARD_BASELINE.md
/docs/ios-pip-voice-session-plan.md
/docs/keyboard-accuracy-plan.md
/docs/keyboard-memory-budget.md
/docs/local-asr-architecture.md
/docs/mac-parity-audit-2026-08-23.md
/docs/personal-dictionary-icloud-kvs-checklist.md
/docs/screenshots/README.md
CHANGELOG.md
-9
View File
@@ -8,25 +8,16 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
## [Unreleased]
### Added
- **Adaptive personal replies**: learn separate dictation and reply preferences from reviewed evidence, offer ordinary, formal, and playful personalized reply choices from one keyboard action, and keep bounded choice feedback only on the device. / **自适应个人回复**：从经过确认的证据中分别学习听写与回复偏好，通过一个键盘回复操作提供普通、正式和轻松趣味三种个性化候选，并仅在本机限量保留选择反馈。
- **Test-build ASR corpus export**: export the newest complete personal-style examples through the 2,500-character target as a protected ZIP containing versioned JSON from Settings in Debug and TestFlight builds, while still allowing smaller non-empty corpora. / **测试版 ASR 语料导出**：在 Debug 与 TestFlight 版本的设置中，将最新完整个人风格样本累积至 2,500 字符后导出为受保护的 ZIP（内含版本化 JSON），不足 2,500 字符的非空语料也可导出。
- **Flow startup diagnostics**: save a privacy-safe ten-second state trace whenever session startup reaches a terminal failure, with local export and deletion controls in Settings. / **Flow 启动诊断**：会话启动最终失败时保存隐私安全的最近十秒状态轨迹，并在设置中提供本机导出与清除入口。
- **Expanded clipboard semantics**: add fully local bilingual models for schedule negotiation, confirmed decisions, and follow-up reminders, with language-specific confidence thresholds, existing-skill routing, and reproducible random holdout evaluation. / **扩展剪贴板语义**：新增完全本地的中英双语日程协商、确认决策与跟进提醒模型，并加入分语言置信度阈值、现有技能路由及可复现的随机留出评估。
### Changed
- **Smart reply center**: merge invitation, task, blessing, clarification, and empathy actions into Reply; local scene detection now offers three fixed, clearly labeled decisions whenever user intent must not be guessed, while ordinary chats retain optional tone choices. / **智能回复中心**：将邀约、任务、祝福、澄清与共情操作统一到“回复”；本地场景识别会在不可替用户猜测意图时始终提供三种固定且清晰标注的立场，普通聊天则继续使用可选的语气候选。
- **Clipboard intent precision**: specialize the local task and complaint models, add conservative language thresholds, and suppress complaint-only text from task routing unless it contains an explicit assignment. / **剪贴板意图精度**：专项优化本地任务与投诉模型，加入保守的分语言阈值，并在没有明确委派时阻止纯投诉文本进入任务路由。
- **Precision-first semantic routing**: add traceable multi-model consensus labels, local joint intent verifiers, confidence-margin abstention, layered source-isolated evaluation, and privacy-safe shadow disagreement counters while retaining current models until every acceptance gate passes. / **精度优先语义路由**：新增可追溯多模型共识银标、本地联合意图验证器、置信度与差值拒识、按来源隔离的分层评估及隐私安全的影子分歧计数；所有验收门槛通过前继续保留当前模型。
- **Iterative semantic research**: add reproducible twenty-round weakly supervised model selection, high-confidence self-training consensus, per-intent fine-tuning, explicit-evidence experiments, frozen-overlap gates, and macOS replay manifests; retain deployed models when every candidate underperforms release baselines. / **迭代语义研究**：新增可复现的二十轮弱监督模型选择、高置信自训练共识、分意图微调、显式证据实验、冻结集重叠门禁及 macOS 重放清单；所有候选低于发布基线时继续保留现有部署模型。
- **Card depth**: add a faint directional long shadow to card surfaces throughout the iOS app in both light and dark appearances. / **卡片层次**：为 iOS App 内的卡片界面统一加入淡雅的定向长投影，并适配浅色与深色外观。
- **Neutral dialog actions**: use adaptive black or white styling for system alerts, confirmation dialogs, and modal actions instead of inheriting the green brand accent. / **中性弹窗操作色**：系统警告、确认弹窗及模态操作改用自适应黑色或白色，不再继承绿色品牌强调色。
- **Monthly usage calendar**: replace the seven-day Home and Mac Dashboard chart with a full current-month calendar whose date-circle opacity reflects each day's dictation characters, placing the Home calendar between its four metrics and Personal Dictionary. / **月度用量日历**：以完整的当月日历替换首页与 Mac 总览的近七天图表，并通过日期圆形背景透明度表示每天的听写字数；首页日历位于四项统计指标与个性词库之间。
- **Home credits and navigation**: move the credit and invitation card from Settings to Home above the usage metrics, explain free signup and referral rewards before sign-in, and open History or Personal Dictionary directly from their metric cards. / **首页积分与导航**：将积分与邀请卡片从设置迁移到首页统计指标上方，登录前明确说明免费注册与邀请奖励，并支持从听写字数和词库指标卡片直接进入历史记录或个性词库。
- **Personal style threshold**: allow generating a learned speaking style after 2,500 effective dictation characters instead of 5,000. / **专属风格门槛**：生成学习型说话风格所需的有效听写字符由 5,000 降至 2,500。
- **Personal style corpus gate**: replace the test-mode unlimited gate with a 1,250-character minimum while keeping the production 2,500-character gate, and cap the training-corpus export at 5,000 effective characters so the user's full private history never leaves the device in one export. / **个人风格语料门槛**：移除测试版本的「无下限」逻辑，改为 1,250 字符最低门槛，正式版保持 2,500 字符；训练语料导出上限调整为 5,000 字符，避免一次性带出全部听写历史。
### Fixed
- **Personal style generation**: derive every reviewed prompt through two-stage corpus evidence, apply concrete low-confidence ASR tendencies instead of replacing them with a neutral template, recover wrapped model JSON once, keep one provider configuration and a 45-second budget across both stages, and distinguish cancellation from timeout. / **专属风格生成**：每个待审阅 Prompt 均通过两阶段语料证据生成，并在证据较少时仍应用原始 ASR 中具体的低置信度表达倾向，而非替换为中性模板；同时支持一次模型 JSON 包装恢复，在两阶段固定同一服务配置与 45 秒预算，并区分主动取消和请求超时。
- **Durable Apple account sessions**: persist refresh operation identifiers before token rotation, reliably store and validate Apple user identifiers, require one-time reauthentication for unverifiable legacy sessions, and prevent failed Keychain deletion or concurrent account work from restoring a revoked login. / **可靠 Apple 账号会话**：在令牌轮换前持久化刷新操作标识，可靠存储并验证 Apple 用户标识，为无法验证的旧会话执行一次重新认证，并防止 Keychain 删除失败或并发账号操作恢复已撤销的登录态。
- **Account sign-in presentation**: use the concise reward message consistently and keep a uniform app surface beneath translucent Apple authorization sheets. / **账号登录呈现**：统一使用精简的积分奖励文案，并在半透明 Apple 授权弹窗下保持一致的 App 背景。
- **Recommended hotword details**: label Home recommendations by their actual source, render suggestion chips in adaptive monochrome, remove internal usage counts from dictionary rows, and anchor the iPhone confirmation popover to the selected hotword. / **推荐热词详情**：按真实来源标记首页推荐词，以自适应黑白配色显示推荐标签，移除词库列表中的内部使用次数，并让 iPhone 确认弹窗指向所选热词。
ModelTraining/ClipboardSemantics/BlessingBenchmark/README.md
-67
View File
@@ -1,67 +0,0 @@
# Blessing benchmark review
This directory contains a blind, evaluation-only review queue derived from the
frozen comprehensive holdout. It must never be merged into training.
## Review process
1. Give `review-queue.jsonl` and one annotation template to each of two
independent human annotators.
2. Do not give annotators `sealed-provenance.jsonl`, the other annotator's
answers, model predictions, or previous weak labels.
3. Each annotator fills every `label`, `boundaryCategory`, and `confidence`
field in their own JSONL file.
4. Run `finalize_blessing_benchmark.py` with distinct annotator IDs.
5. If annotations disagree, give only `adjudication-needed.jsonl` to a third
reviewer and rerun the finalizer with the adjudication file.
## Label
Set `label` to `true` only when the author directly expresses a good wish,
congratulation, prayer, or hope for a recipient. Third-person and self-directed
wishes count. Requests for a blessing, quoted examples, received thanks,
celebration descriptions, ordinary greetings, reports of someone else's wish,
and sarcasm do not count.
## Boundary categories
Use one of these stable values:
### Positive
- `festival_or_birthday`
- `congratulation`
- `health_or_recovery`
- `travel_or_safety`
- `study_or_career`
- `general_good_wish`
- `third_person_or_group`
- `spiritual_or_prayer`
### Negative
- `meta_request_or_template`
- `received_thanks`
- `quoted_or_documented`
- `celebration_mention`
- `ordinary_greeting`
- `positive_language_only`
- `reported_wish`
- `sarcasm_or_anti_blessing`
- `unrelated`
Use `confidence` values `high`, `medium`, or `low`. Explain genuinely
ambiguous context in `notes`.
## Finalization
```bash
python3 Scripts/clipboard_semantics/finalize_blessing_benchmark.py \
--annotator-a-id reviewer-a \
--annotator-b-id reviewer-b
```
The command refuses incomplete annotation, duplicate IDs, non-boolean labels,
invalid confidence, missing adjudication, or use of the same person as both
annotators. The finalized benchmark is split deterministically into calibration
and test records.
ModelTraining/ClipboardSemantics/Consensus/adjudication-instructions-v1.md
-40
View File
@@ -1,40 +0,0 @@
# Clipboard semantic evidence adjudication v1
Review only the fields listed in `unresolvedFields`. Judge from the text itself;
do not inspect previous model votes, source labels, or another adjudicator.
Return one JSON object per input record:
```json
{
"id": "same id",
"resolutions": {
"task": "true",
"ambiguous": "false"
},
"confidence": {
"task": 0.97,
"ambiguous": 0.94
},
"evidence": {
"task": "send the report",
"ambiguous": "by Friday"
}
}
```
Requirements:
- `resolutions`, `confidence`, and `evidence` must contain exactly the fields in
`unresolvedFields`.
- Intent and flag values are `true`, `false`, or `unknown`.
- Sentiment values are `positive`, `neutral`, `negative`, or `unknown`.
- Evidence must be a short exact quote copied from the input text.
- Use `unknown` when the text alone does not justify a decision.
- Confidence is per field and must be between 0 and 1.
- Do not output explanations, markdown, or additional fields.
Use the boundaries from `labeling-instructions-v2.md`. In particular, distinguish
requests from personal plans, genuine information questions from request-shaped
commands, direct messages from terminal notices, and expressed wishes from
quoted, future, sarcastic, or received blessings.
ModelTraining/ClipboardSemantics/Consensus/adjudication-instructions-v2.md
-56
View File
@@ -1,56 +0,0 @@
# Clipboard semantic evidence adjudication v2
Review only the fields listed in `unresolvedFields`. Judge from the text itself;
do not inspect previous model votes, source labels, or another adjudicator.
Apply the product-approved boundaries from `labeling-instructions-v3.md`.
Return one JSON object per input record:
```json
{
"id": "same id",
"recordDisposition": "keep",
"dispositionConfidence": 0.98,
"dispositionEvidence": "send the report",
"resolutions": {
"task": "true",
"ambiguous": "false"
},
"confidence": {
"task": 0.97,
"ambiguous": 0.94
},
"evidence": {
"task": "send the report",
"ambiguous": "by Friday"
}
}
```
Requirements:
- `recordDisposition` must be `keep` or `exclude-device-command`.
- Use `exclude-device-command` only when the text is clearly addressed to a
device, app, search engine, or virtual assistant. Do not use it for an
ordinary request to another person.
- `dispositionConfidence` must be between 0 and 1.
- `dispositionEvidence` must be a short exact quote copied from the text.
- `resolutions`, `confidence`, and `evidence` must contain exactly the fields in
`unresolvedFields`, even when the record is marked for exclusion.
- Intent and flag values are `true`, `false`, or `unknown`.
- Sentiment values are `positive`, `neutral`, `negative`, or `unknown`.
- Field evidence must be a short exact quote copied from the input text.
- Use `unknown` when the text alone does not justify a decision.
- Confidence is per field and must be between 0 and 1.
- Do not output explanations, markdown, or additional fields.
Critical product decisions:
- An invitation question is `invitation=true`, `question=false`, and normally
`replyableMessage=true`.
- An explicit self-reminder is `followUpReminder=true`, `task=false`.
- A first-person need implying action is `task=true`.
- A problem is not a complaint unless dissatisfaction, criticism, or objection
is explicitly expressed.
- Generic encouragement or happiness is not a blessing; require an explicit
wish, prayer, congratulation, or conventional blessing.
ModelTraining/ClipboardSemantics/Consensus/adjudication-instructions-v3.md
-23
View File
@@ -1,23 +0,0 @@
# Clipboard semantic evidence adjudication v3
Review only the fields listed in `unresolvedFields`. Judge from the text itself;
do not inspect previous model votes, source labels, or another adjudicator.
Apply `labeling-instructions-v4.md`.
Return one JSON object per input record using the exact schema defined in
`adjudication-instructions-v2.md`.
For compatibility, `recordDisposition` remains `keep` or
`exclude-device-command`. In v3, `exclude-device-command` also covers generic
search, system/account queries, and other clearly virtual-assistant-only text.
It does not cover real-world service requests, named-recipient communication
with content, or private/shared-context interpersonal questions.
Requirements:
- Evidence must be a short exact quote copied from the input text.
- `resolutions`, `confidence`, and `evidence` must contain exactly the fields in
`unresolvedFields`.
- Use `unknown` rather than inventing context for low-information fragments.
- Confidence is per field and must be between 0 and 1.
- Do not output explanations, markdown, or additional fields.
ModelTraining/ClipboardSemantics/Consensus/adjudication-instructions-v4.md
-17
View File
@@ -1,17 +0,0 @@
# Clipboard semantic evidence adjudication v4
Review only the fields listed in `unresolvedFields`. Judge from the text itself;
do not inspect human anchor labels, previous model votes, source labels, or
another adjudicator.
Apply `labeling-instructions-v5.md` and every inherited rule from
`labeling-instructions-v4.md`. Return one JSON object per input record using the
exact schema from `adjudication-instructions-v2.md`.
For compatibility, `recordDisposition` remains `keep` or
`exclude-device-command`; the excluded state also covers generic search,
system/account queries, and clearly virtual-assistant-only commands.
Evidence must be an exact text quote. Use `unknown` for every affected intent
when a short fragment lacks enough context. Do not output explanations,
markdown, or additional fields.
ModelTraining/ClipboardSemantics/Consensus/adjudication-instructions-v5.md
-79
View File
@@ -1,79 +0,0 @@
# Clipboard semantic evidence adjudication v5
Review only the fields listed in `unresolvedFields`. Judge from the text itself;
do not inspect source labels, provenance, previous model votes, human anchors,
or another adjudicator.
Apply `labeling-instructions-v6.md`. Return one JSON object per input record
using the evidence schema from `adjudication-instructions-v2.md`:
```json
{
"id": "same id",
"recordDisposition": "keep",
"dispositionConfidence": 0.98,
"dispositionEvidence": "play my workout playlist",
"resolutions": {
"assistantCommand": "true",
"domain": "media"
},
"confidence": {
"assistantCommand": 0.97,
"domain": 0.95
},
"evidence": {
"assistantCommand": "play",
"domain": "workout playlist"
}
}
```
Requirements:
- `recordDisposition` remains `keep` or `exclude-device-command` for file-format
compatibility. Under v6, assistant commands, information queries, and system
notifications are taxonomy records and must be `keep`.
- Use `exclude-device-command` only when replaying a queue explicitly frozen
under v4/v5 exclusion policy. Do not use it in a new v6 queue.
- `dispositionConfidence` and every per-field confidence must be between 0 and
1.
- `dispositionEvidence` and field evidence must be short exact quotes copied
from the input text.
- `resolutions`, `confidence`, and `evidence` must contain exactly the fields in
`unresolvedFields`, even if a legacy replay record is excluded.
- Intent and flag values are `true`, `false`, or `unknown`.
- `domain` is `finance`, `travel`, `calendar`, `communication`, `media`,
`smartHome`, `shopping`, `dining`, `health`, `weather`, `accountService`,
`generalKnowledge`, or `unknown`.
- `sentiment` is `positive`, `neutral`, `negative`, or `unknown`.
- Use `unknown` when the text alone does not justify a stable decision. A
low-information fragment must not be forced to `false` or into
`generalKnowledge`.
- Do not output explanations, markdown, comments, or additional fields.
Critical boundary checks:
- Resolve clearly device-, app-, or assistant-directed direct digital
operations as `assistantCommand=true`; resolve generic lookups as
`informationQuery=true`; resolve machine-authored alerts and status messages
as `systemNotification=true`.
- A request for a real-world service that naturally needs confirmation, such as
booking a taxi, restaurant, hotel, or ticket, remains `task=true` rather than
`assistantCommand=true`.
- Do not infer `task`, `question`, or `replyableMessage` from those records
unless the text independently contains an interpersonal act.
- A named-recipient communication request with actual content is an
interpersonal replyable task. A bare “call Mark” remains unknown for affected
fields when the addressee is unclear.
- Invitation questions are `invitation=true`, `question=false`; explicit
self-reminders are `followUpReminder=true`, `task=false`; first-person needs
implying personal action remain tasks.
- Complaints require explicit dissatisfaction, and blessings require an
explicit wish, prayer, congratulation, or conventional blessing.
- Choose one domain from the operation target. If no primary target can be
established, resolve `domain` as `unknown`.
`knownLabels` is corpus metadata and must not appear in adjudicator output.
Downstream merging may add an adjudicated field to `knownLabels` only when both
the field value and its evidence pass the configured acceptance gate and the
value is not `unknown`.
ModelTraining/ClipboardSemantics/Consensus/consensus-conflicts.jsonl
+47
View File
@@ -0,0 +1,47 @@
{"ambiguousVotes": 1, "fullAgreement": false, "id": "open-clinc150-11661", "knownLabels": ["followUpReminder", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.7, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "eea33b2b6779236a92fe4f330968368a6fd7d3624e4a8201db37e0d47b6eddbf", "cursor-grok-4.6-xhigh": "df9c47f371f039270b0ca937e5592cdb2958f269fde471394a08fd0c4c84fc82", "gpt-5.6-luna-medium": "12d5720b3da63257ea95e6f158c5ce577b5ccaef339c0bfb1e4e4c26683f3aed"}, "labelerVotes": {"question": 1, "replyableMessage": 1, "task": 2}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "i want to see the golden gate bridge and i'm walking on 5th street right now"}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-clinc150-4205", "knownLabels": ["followUpReminder", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "68c5380caeb0b439ebec4ec8a03327113719f0db98e1ae1ddcfc8600a3b1ee35", "cursor-grok-4.6-xhigh": "59d00606623b2b176daf1a7bc285b3227128edcb91e141197428f080d4c0159a", "gpt-5.6-luna-medium": "f76a925006eebc0f8900ffbd223749176ed8fb7d17011ccc82cba44de9a8fcfd"}, "labelerVotes": {"complaint": 2, "replyableMessage": 2}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "it seems my luggage was lost"}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-clinc150-6", "knownLabels": ["followUpReminder", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c6a65c8de0ca86ad6285047838d2fd5bbfb10e689b34ed05db2ce447da9de57b", "cursor-grok-4.6-xhigh": "bf94b46badfbc53b8530e57ae2fe96729d0216b248cbf827d04991e37f0240e6", "gpt-5.6-luna-medium": "42d8b87c07170e954784c21044f9f3edf95be6552b3b7f79448409c44ece085e"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "quotedOrMetaVotes": 2, "rejectedReason": "quoted-or-meta-intent", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "i need you to translate the sentence, 'we will be there soon' into portuguese"}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-ed0miwo", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "63447a8ce598d3496c518e9eddb6197a4cedaace304a96af91f6a224be542dcf", "cursor-grok-4.6-xhigh": "e9cf1010c79673afbda106ad6b831d67347dc36c02b5b00e48cbfbabce6ef02e", "gpt-5.6-luna-medium": "c08a712989f280665ab6efa1f3d7d62c2103f2557851a9032603a6a4646b8bc8"}, "labelerVotes": {"replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L6572", "text": "I low-key love his YT channel, he's genuinely an interesting and good person"}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-ed1at3i", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b6b4230c950f22468eff57a8c6e660637e26038a0560ab590b676ec451412f0a", "cursor-grok-4.6-xhigh": "b8cc32cdb2a3edeee663cfc1402e9e9482b9d86e36e6466e7d9951e1f39561d6", "gpt-5.6-luna-medium": "27aa978c1ece897cbb2beb01bb374fbde3eb719bc7ae4e912298a9259f4217ea"}, "labelerVotes": {"question": 1, "replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L26134", "text": "There are no male versions of feminists. Men live in a different social reality than women."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-ed783v1", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "24f0fc566dd6c3d338d82fdc6097917cb5dfc223684781ff1f91367735cead5f", "cursor-grok-4.6-xhigh": "fb68e56ef4cca194acbaefd5e4d0d68c9109e47867c605527caba845a53e056e", "gpt-5.6-luna-medium": "9b577b045cb11a205f887aea999f5d14f0fed0954a512999c2e778c4111133b4"}, "labelerVotes": {"replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L19103", "text": "[NAME] reinforces the pessimistic world view, I've been there and at least it was cancerous for me."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-edciwc1", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.82, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f1e8d2f80ddda46de47da31dd854cf53b0a04ae0158b67fc20121af05bc9e02c", "cursor-grok-4.6-xhigh": "a7d302a259e4a7568dd23566a4c8006d9796bb50ad421b9c29562c1715fe18c3", "gpt-5.6-luna-medium": "05c12228f6e474547f623334fa2fca4fae5c68d9b1284aaeaca1cbb57b2d8bd3"}, "labelerVotes": {"question": 1, "replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L16468", "text": "I had a nightmare about something similar, the combination of high walls and water is truly scary"}
{"ambiguousVotes": 1, "fullAgreement": false, "id": "open-goemotions-eddd68m", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.55, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b7417a9a6373cb42dcd42c215985c3090d53dd14e6df586b4581bac01204cd80", "cursor-grok-4.6-xhigh": "f775fa837b87290cc66c83bb61a88a4e5943ba22eb2db8244336bac6f2e39c28", "gpt-5.6-luna-medium": "76e25837a1eed023838c0d0fa7cf7f4c99e5070453ec7efe7aa0aed94c531204"}, "labelerVotes": {"invitation": 1, "replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L18316", "text": "Go to the movies with people not related to me."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-edf80ua", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "48496324da361768c52bbf4ea1b4d57a3c684b8c76ceae5300aad91af5f87c61", "cursor-grok-4.6-xhigh": "bb27eaeeb1667e1a9685a3099dce67f4b0ce50f6f1ea1f21e76334cb939ef28a", "gpt-5.6-luna-medium": "5d445a3a90cf1e0f4e79ebcfc013baa851438951ef57bb3881d4e080392634c9"}, "labelerVotes": {"question": 1, "replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L3033", "text": "There is irony in what you guys are saying."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-edi79i8", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ca4b7c0708741dd753632926fd348d8c96bf7f7ec920bb7563ae13a3ddaed88c", "cursor-grok-4.6-xhigh": "2958562dd78b9aebaf42edac023d51075caad9841ea3e9b619df11e61c6e7ab0", "gpt-5.6-luna-medium": "de7afa7f2a38d59754de56499e70637b2ab1e13645b0b13b763f12241c4cbbce"}, "labelerVotes": {"complaint": 1, "question": 1, "replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L3366", "text": "This is painfully fake"}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-edlfmm3", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e08ddc2568c31fc6c7af11379918f3fb164db7b51d1ac2d5a0386dde13ecc6aa", "cursor-grok-4.6-xhigh": "94022a97904e0b497dfd4d2d973413faf462678905993708115f2c6231a24b4d", "gpt-5.6-luna-medium": "58a60b66ed33fe9566800d34ea880b2b711967184430e3e10655803ba33c015f"}, "labelerVotes": {"question": 1, "replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L21551", "text": "None of it will happen Just wait for them to yank it away"}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-edloxw1", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.86, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "c4e0242c828ea8130093a2b1e6a02aee3286eacbad81c67559132889c583f52a", "cursor-grok-4.6-xhigh": "eed9b33de2c2f40e01a6b4fae4b2e1c39d893f8b7d980205aa292bf50f72649e", "gpt-5.6-luna-medium": "5d6bf99d5b8563d7b785f0541e7aa8cd64c3e44eb9ae360b79b301153f3f3955"}, "labelerVotes": {"replyableMessage": 2}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L26398", "text": "she usually sits below the bathroom sink like a fuckin weirdo between 9-11 pm but she'll be free after."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-edlqvvo", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c541f77130277966d9f1f67b0fb907d0012e208b5849da079f50eac83b912c12", "cursor-grok-4.6-xhigh": "ea5a9ba46b724b161f9f88bfe218e51e6ecb74927293f2ab2d6ee1bf16971d48", "gpt-5.6-luna-medium": "0cdd06f44e3b015d6ac93a3378d02fcab07476e96db711ee69fa605e6df512fc"}, "labelerVotes": {"complaint": 2, "question": 1, "replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 1, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L2500", "text": "This post is a waste of time and doesn't belong here."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-edm0fy9", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.89, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "1c5842a299cc9da2f65c6d8bf8fad2c8b80ebbc22e8ca4197cae8039f7aee407", "cursor-grok-4.6-xhigh": "2411bb09479d3d660aa9f7a2fcd65c9f0e37d0267b7e3861560ce77f51f804ce", "gpt-5.6-luna-medium": "7d42151e9adc80ab94aa58dcdda04200d69b236d04c23f51e066d75321605938"}, "labelerVotes": {"replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L41964", "text": "Imagine being upset by this"}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-eds3oe6", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.87, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "5b51df66f029f74334169624901c422e5fd34edca3dc70999ef64dbf9144a032", "cursor-grok-4.6-xhigh": "3bb0f86831771413a04876711ae28131af510c9ac187cc3e226e36ba08b2227d", "gpt-5.6-luna-medium": "beecc5dfc59172707b4c0e8c39f37d375a08f563bca93806167cafc05b0dc3eb"}, "labelerVotes": {"replyableMessage": 2, "task": 2}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L25072", "text": "You're 105 years out of date. Please update your beliefs to the current version of the Constitution."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-edumqtx", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a9530da10ac4f198d53a0938fcb44684818b971342f5c4792dd9a103917ed53a", "cursor-grok-4.6-xhigh": "a9530da10ac4f198d53a0938fcb44684818b971342f5c4792dd9a103917ed53a", "gpt-5.6-luna-medium": "6f078b1206aa3b22d73680ad27ad450b16007055a72ce1e7f37d785c088c3dcd"}, "labelerVotes": {"complaint": 1, "replyableMessage": 2}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L5809", "text": "You're a horrible person."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-eduvcvy", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "5034353902ef92de422664ba63861b9568da28568ead0bfa96f23b12783b8d08", "cursor-grok-4.6-xhigh": "f25b00fef68e04cb9d9cb92c39baf89aabee97c1d517c57eb46877a6bedf19b3", "gpt-5.6-luna-medium": "e96371ac1b42afdf41f37643b2cc6f57938f8edfd33af3cb23cc3ba2d2c9128c"}, "labelerVotes": {"question": 1, "replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L6071", "text": "We have not been a Constitutional Republic for a long long time. The Constitution is just a nice idea at this point."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-edw419k", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "70a2a7243356f0870573b153191feb082f2362c99284968b98f2a48897736bb8", "cursor-grok-4.6-xhigh": "b9ac3e42ae23ba98575674f0b62426f4342ba72f23198d85f3924d34bc2313a0", "gpt-5.6-luna-medium": "820d086bcdf9879afc86262d5e44152dd2c6834686af6885b1a2d7298248b3f9"}, "labelerVotes": {"replyableMessage": 1, "task": 1}, "language": "en", "quotedOrMetaVotes": 3, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L21850", "text": "\"we have a \"\"righty\"\" complaining about \"\"lefties\"\" making up BS, while they make up BS... sad.\""}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-edw9jvd", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.86, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "ce5f86578e53935c09c820f2fd2c450f278ef6b9d17967d5d70b7035529794e9", "cursor-grok-4.6-xhigh": "8f96148febeb7a48bb4210ed758e659666c0f9ac8e2252550fbc2adfdaabfa03", "gpt-5.6-luna-medium": "f615992e842c79960b6b429ea54c38f6b8d7381efc28f12d271bf9c2e627f6d9"}, "labelerVotes": {"complaint": 1, "replyableMessage": 2}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L22678", "text": "Real nice, swearing up a storm right in front of your kids."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-ee2kfxs", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.89, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d277b8297df0693b274ccfeccd95784ba4dfd601ebe4bddb2e460fe033dbc272", "cursor-grok-4.6-xhigh": "96105b7ec54b55e962e387e8d2c6dcf3a72d89007855c9276fc4673da24ebd06", "gpt-5.6-luna-medium": "9f2d8001955314ad4344df3c5e956790bed67df20ff4609b906d68a61c8fc2b5"}, "labelerVotes": {"confirmationDecision": 1, "question": 1, "replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L12876", "text": "Agreed 100%, Governor [NAME] will have some say in this, they broke Wisconsin law, plain and simple !"}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-ee3h6wr", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e4113cc34bb096408541d351f3b44bd5a6444db5ec1b92093ccf6ac1696a579d", "cursor-grok-4.6-xhigh": "eed8634dd1640636cef77f37d2dfc4a94abce484616bfe24794b872e9a42028b", "gpt-5.6-luna-medium": "c0c2d044bd562cb691a44a41330a45115b3d51e434037d5f72710c71f3b111b9"}, "labelerVotes": {"replyableMessage": 2}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L17694", "text": "Hmmm, mildly interesting :)"}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-eeamw5i", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "9e085b09002cbb3928827d15be79cc1d0bdf8008b8c6ed37ae3e51b776bce01c", "cursor-grok-4.6-xhigh": "6a20af3bb830a7be94af118e7c88d2be2dffbf0941b365ea81ccd640db052d88", "gpt-5.6-luna-medium": "227d86a1d637fdccd9706db5873d6901978d0fad3ccd0d89c75372a93595c443"}, "labelerVotes": {"replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L27443", "text": "I don’t think that tells us any moralising lesson on the practice of incest."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-eefzuzt", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.87, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "66518631334b020d94bfa8b3a878e97a1f6fbd2a2edab95d3cda584f1117c9d9", "cursor-grok-4.6-xhigh": "d4d8561f115151f7be81eabf81d5ef75e461e02afbfca492851202acc44b01a4", "gpt-5.6-luna-medium": "b9176cf439fbdfb31554f3737e65490e47997aa72354a8a44ca0dd9ef697096f"}, "labelerVotes": {"complaint": 1, "replyableMessage": 2}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L13081", "text": "[NAME], that fucking sucks."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-eegulbi", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.86, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "64782471526a985e2699fb7f01b136ff264e8798fd692991ae3ac2766fda335a", "cursor-grok-4.6-xhigh": "0103da3f5e37faa7d463e157db81d3402d76225242666c1aab115b6a0159b5ce", "gpt-5.6-luna-medium": "1963a1a0adf9fa80a54291e6fc38e545d786b1ac68455f1c28dcf790a061e989"}, "labelerVotes": {"replyableMessage": 2}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L35840", "text": "Yah, I'm a bad girl. In fact I'm bad at everything."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-eelsbey", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.89, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f9f712b6e48011b5e4d9ae566ae5f54f94ed10aa878ac2ad7d80899590eebe89", "cursor-grok-4.6-xhigh": "b9193bc998bdb25409cb395f103fb5771727d92e1af3f3437016704c674dd8ed", "gpt-5.6-luna-medium": "8c732a8bacc0ff016d55e776e9d50814670d031b7f691b0c3e1677cfd57ad7eb"}, "labelerVotes": {"question": 1, "replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L27429", "text": "Makes it even better that a multi millionaire successful pro athlete is shitting on him [NAME] damn I love me some sweet twitter roasting"}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-eer68if", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.87, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9f6810c2c72ff9929c9196a1035ee97be81456059ad93f956e6b2a607851ed09", "cursor-grok-4.6-xhigh": "82ba9e2736db0fe74928214e1e1f0733d0cd6b9aa6abe5439a6562cda1f7bab4", "gpt-5.6-luna-medium": "3ea15d05ffae2763c2643c7fb303b963326f25a58b6c6a77204302059a3a89a0"}, "labelerVotes": {"question": 1, "replyableMessage": 2}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L9951", "text": "He's so far into his fantasy land he can't let anyone say a fact to his face, it would destroy his dreams. Poor little snowflake u/chabanais"}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-eey0znf", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "844b8f6f79e15b183a8e8fca6f1159eea2e98b8d380f01344f303ebec6eabe3d", "cursor-grok-4.6-xhigh": "756955e411174ad9c946fa7ccd3686a32dbac58f5310800da005dd29c25e3edd", "gpt-5.6-luna-medium": "688d4183e7a047ff9b4a4293124b14ec3a5dcf3569bd7745cb3d9fa4b948fe78"}, "labelerVotes": {"confirmationDecision": 1, "question": 1, "replyableMessage": 2}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L15733", "text": "Short answer: No. Long answer: Nooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-ef9kela", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "db9e197b8bcf47de59bb4e3e9845e3aaf40d5262c83da38c8378bb9180595fcd", "cursor-grok-4.6-xhigh": "4e66e7996ff48c2047251600f8aaba3f942a1bb85a366e4ca600db43bcf24cf3", "gpt-5.6-luna-medium": "3e6d65fc7103e8ccb813eed511941949b29729bb8c89f0e3aed335854fbfdd15"}, "labelerVotes": {"replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L15900", "text": "Someone has a story."}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-efdaasf", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.86, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "23640df241147116f622afcf7da3c302364f81453c676553ddd2759ff5eca8c9", "cursor-grok-4.6-xhigh": "1a18a14594a4f532b6a8e6285ab999159f5e4610a22e71445fb04b821d155631", "gpt-5.6-luna-medium": "c17d31475a6e24e873556d0b4717c0cee51b7310221bdb31d611c21488fa4cd7"}, "labelerVotes": {"blessing": 1, "question": 1, "replyableMessage": 2}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L29366", "text": "Your name is amazing"}
{"ambiguousVotes": 1, "fullAgreement": false, "id": "open-goemotions-efdnw2c", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.82, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b715d8dec385068ae1298936b676a4c1c71896fb52bb3ee6fe45912f68c7b567", "cursor-grok-4.6-xhigh": "b7304cba4e33913e4105b945558713ad7caf48fff0f3c74a1035dd2217e6ab82", "gpt-5.6-luna-medium": "a70e639fffd283c0c4fcb4e6f641cf92b45dc3e2a8673ffc44ccdaa3b17f543b"}, "labelerVotes": {"blessing": 1, "question": 1, "replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 3, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L31525", "text": "\"Here's another message \"\"You're a good mom. Your boy is lucky to have you.\"\"\""}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-eff5j9u", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "dab2b7450f313c751c898660ebea2798b4c03d3f52f518a1f2df59c98e521e07", "cursor-grok-4.6-xhigh": "d12b394ba411a5e13153eca0595d24cad39a3f4caa38388bf3de011e7d71d667", "gpt-5.6-luna-medium": "66b9cb685130f04ad854ceab011f2ae8dfe7bafdeb885e416917b0ecc993e71f"}, "labelerVotes": {"complaint": 2, "question": 1, "replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L32483", "text": "But something is extremely wrong if people are getting sick. Might not be a sonic wave, but it definitely is *something*"}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-goemotions-efgtipz", "knownLabels": ["sentiment"], "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.7, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "aaa4bc1d2bba4e721e15b8b4f844429bc3d513283c20fffd888ebd06f5d29f81", "cursor-grok-4.6-xhigh": "d84a7c0d117d1e408c793a246f62870db4127444cf6841430ea1c0eaf1e31811", "gpt-5.6-luna-medium": "2c65207dc326e22526d337defbf6b8fccb2808bc4e5cd9da90a1d23f92de5ce4"}, "labelerVotes": {"question": 2, "replyableMessage": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L33128", "text": "In biblical Hebrew they're called [NAME], soos meaning horse and yaor meaning the Nile, in modern Hebrew they are called hipototam"}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-massive-en-US-1092", "knownLabels": ["followUpReminder", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "44d92c6ccfc4e31a24a76500c8771d9607f6d561702fdbed43d6af81a4a86d91", "cursor-grok-4.6-xhigh": "b1acc2249d1ea5136c1d1e9326e0d13298b8877cad7728e8b9e49a2128cac173", "gpt-5.6-luna-medium": "78e4b51e43c68fb0e33be27bbbb2bb7d178d7d664e69deff80af97d8e98d69d9"}, "labelerVotes": {"task": 2}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "go to nytimes dot com"}
{"ambiguousVotes": 0, "fullAgreement": false, "id": "open-massive-en-US-7265", "knownLabels": ["followUpReminder", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "151bb5a397172019d1385ca2591db7749c9ae3a797c67e98e94fd55c4108a287", "cursor-grok-4.6-xhigh": "c01928cf60ea42d1666819c946ff0d7f191a0c4840ba96aa6afb126f9d602c36", "gpt-5.6-luna-medium": "131a6e20951d4db90cd792d1f15273b4e23a5f9f5f8071b0865d405bff3a4fbf"}, "labelerVotes": {"question": 1, "task": 2}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "bring up my agenda"}
{"ambiguousVotes": 2, "fullAgreement": false, "id": "open-massive-zh-CN-10918", "knownLabels": ["followUpReminder", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "a4bb2a1f54f12ab4a3398f732598d19beb9c6a1c56e6ce2e783267a9b378c506", "cursor-grok-4.6-xhigh": "e832c24ab281b051af511718b795974c470d4e4202501b705c90213cd6686e4e", "gpt-5.6-luna-medium": "3665b06484be5b674f8c8840309f6752c3df01414f4e0475dae9e949a5186eee"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "quotedOrMetaVotes": 0, "rejectedReason": "ambiguous-majority", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "我想删除中间的列表"}
{"ambiguousVotes": 3, "fullAgreement": true, "id": "open-massive-zh-CN-11249", "knownLabels": ["followUpReminder", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.78, "cursor-grok-4.6-xhigh": 0.7, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "401fd15f6a6a37853aaa74d64362a13b7c100ab0d40e16fa9abc12679da801a9", "cursor-grok-4.6-xhigh": "9b2caa460b3d5d3ad1d259ac005fc5212b69815dac357e6126300a6486236296", "gpt-5.6-luna-medium": "236732a1d791af3c717a549d81c131df64c3e035d8629e1be37d6cfa2ca56668"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "quotedOrMetaVotes": 0, "rejectedReason": "ambiguous-majority", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "加入这个"}
{"ambiguousVotes": 2, "fullAgreement": false, "id": "open-massive-zh-CN-15222", "knownLabels": ["followUpReminder", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "152372af8eb15f93b0324611aa1cc871ac21678569ae216847e755109ad59fee", "cursor-grok-4.6-xhigh": "5d0cf5b60329290929a21389d193d64cfd0983761c1bb50b81c932cdcd8567cd", "gpt-5.6-luna-medium": "5e15aa6b7551ca1214e8d641057bfead23a0131632f52c490c213c06f8cc6ac7"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "quotedOrMetaVotes": 0, "rejectedReason": "ambiguous-majority", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "在微博上发表评论"}
{"ambiguousVotes": 2, "fullAgreement": false, "id": "open-massive-zh-CN-15390", "knownLabels": ["followUpReminder", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.75, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "9b4cbf450db97c92e0cec8e4a70c236f3423f0c6e7f3931c163c05f807fdae94", "cursor-grok-4.6-xhigh": "bc04279ff96a244b12a7b12db23197bdef2de36f310d24d43d5e397680416dea", "gpt-5.6-luna-medium": "66db848d7848edec45a73e76188241f5fc55866017136266d255515134447727"}, "labelerVotes": {"task": 2}, "language": "zh-Hans", "quotedOrMetaVotes": 0, "rejectedReason": "ambiguous-majority", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "管理微博状态"}
{"ambiguousVotes": 2, "fullAgreement": false, "id": "open-massive-zh-CN-15682", "knownLabels": ["followUpReminder", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.84, "cursor-grok-4.6-xhigh": 0.7, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "d4a0490b8a1f3eed7849741f5085c85115f8aad4fe02b92ee1a6acfaaa08a002", "cursor-grok-4.6-xhigh": "0214ba35f6337ce6a081659c39c4aa463cae8c1f5474af7783f1c02a632f3594", "gpt-5.6-luna-medium": "9be75d8b1a15f4e224005334bdbb3a7b8765135537b4d5f4d2a20cee3571d0ca"}, "labelerVotes": {"question": 3, "replyableMessage": 2}, "language": "zh-Hans", "quotedOrMetaVotes": 1, "rejectedReason": "ambiguous-majority", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "这是康卡斯特的一条微博如果我有你的中国电信和电话服务我怎么联系你"}
{"ambiguousVotes": 2, "fullAgreement": false, "id": "open-massive-zh-CN-16204", "knownLabels": ["followUpReminder", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "b43186c7c35d89d475ec79a51625056f4e90e9bbe167934f1b2783e5405d6c7f", "cursor-grok-4.6-xhigh": "fb9b1085c82a8418a8441afbcd88b74e905474a86a423f35c7d6cbe775e7916d", "gpt-5.6-luna-medium": "e4fea9fe7ce25c3ea32f8c1325eaacc122c4356b85931343af00440cf26572c9"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "quotedOrMetaVotes": 1, "rejectedReason": "ambiguous-majority", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "发送这条信息给家庭组"}
{"ambiguousVotes": 2, "fullAgreement": false, "id": "open-massive-zh-CN-2990", "knownLabels": ["followUpReminder", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.7, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "4ddf513d246b975402a69759de19edff3e42f7a99b9012378f71304393855076", "cursor-grok-4.6-xhigh": "8e4f47927d3a513bde4ca9f613815117bb8d01f67838b07e61d5370d83cce18d", "gpt-5.6-luna-medium": "177dac0a2623d9dd5fda49079d4314cd3f1265d35a7229f94acd0b4a46b0a962"}, "labelerVotes": {"question": 1, "replyableMessage": 1, "task": 2}, "language": "zh-Hans", "quotedOrMetaVotes": 0, "rejectedReason": "ambiguous-majority", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "新的科技新闻"}
{"ambiguousVotes": 2, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>c1fd4c09-fcc8-4a9d-812f-97cc14b71f5c<TURN>12", "knownLabels": ["confirmationDecision", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.75, "cursor-grok-4.6-xhigh": 0.4, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "33fd8a2538612bd179944b174ddb635cd0ec59fed86deb46037e21c9543be004", "cursor-grok-4.6-xhigh": "9e9c8ce4f8af1b2b4088dd5ab3c7cfd38b0acbdafe083d24cbb561616c4d18f8", "gpt-5.6-luna-medium": "22994018e94cc19f6c526e09c4c4348221b1d657b5720ebb0975a993f38d6dca"}, "labelerVotes": {"replyableMessage": 2, "task": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "ambiguous-majority", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L12279", "text": "please have your time"}
{"ambiguousVotes": 2, "fullAgreement": false, "id": "open-multidogo-fastfood-<CONV>1617bf7b-043e-49f5-a2b0-b194ab173a8c<TURN>5", "knownLabels": ["confirmationDecision", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.65, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "f7268a69bb56ee104c4c70c3c3e092355e3613c5008d62285b0486bbba62873e", "cursor-grok-4.6-xhigh": "0a38b32051db4346cfde490f73c392551eaf3f9dc0f36221a59bc1fabe225f73", "gpt-5.6-luna-medium": "fb00affc8c063651769b6d2b2b03d3bf185a2e72a356bce3709b5dbf8487bbd2"}, "labelerVotes": {"confirmationDecision": 1, "task": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "ambiguous-majority", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L8522", "text": "chocolate mikeshake"}
{"ambiguousVotes": 1, "fullAgreement": false, "id": "open-multidogo-fastfood-<CONV>787f5a4d-271c-4671-9134-53cb3d0572a2<TURN>5", "knownLabels": ["confirmationDecision", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.65, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "4f0391ff55bd42327254daddbf91770e1e1322ae2d37acb91b320e6df540c883", "cursor-grok-4.6-xhigh": "2053acf911c4d2d5f12336213355ad199b2770dd36f9d0cfb0d704b4d7cb230c", "gpt-5.6-luna-medium": "36a3916022f5030860091e009a0e6480c927d31ec9bd727fee2557f17b914284"}, "labelerVotes": {"confirmationDecision": 1, "task": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L7820", "text": "southwest buttermilk crispy chicken salad"}
{"ambiguousVotes": 2, "fullAgreement": false, "id": "open-multidogo-media-<CONV>7b50d813-22d4-47c5-a466-fda86fbe69b7<TURN>3", "knownLabels": ["confirmationDecision", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.8, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1664289b0eb650dd0ed43ee460931103a19afc1149caddda251143862babe535", "cursor-grok-4.6-xhigh": "8f1a3771c6d3baa2f3e47452fbf242954aefddb13ee60f96741628cc0647d174", "gpt-5.6-luna-medium": "aa5f6e61e3f3e2a7f3afcef242a0e85f09a1c1e153cc528efe64c6851e8cd454"}, "labelerVotes": {"confirmationDecision": 3, "replyableMessage": 2, "task": 3}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "ambiguous-majority", "sourceDataset": "MultiDoGO", "sourceLabels": ["confirmationDecision", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L297", "text": "yes please help me"}
{"ambiguousVotes": 3, "fullAgreement": false, "id": "open-multidogo-software-<CONV>86eaf2de-044b-43de-8b2c-cd5ebf6d2c51<TURN>9", "knownLabels": ["confirmationDecision", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.82, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "d4f9a2f2ce1dc9075a73016843af9aa1d6d3c977c460401532a281b37dad9475", "cursor-grok-4.6-xhigh": "9014c49c0df3e25f967b1c71829a393237106a9b1e78338acc3039d8e8ae5e45", "gpt-5.6-luna-medium": "1f7a837f871a6ad8fd54a1c35637c9ff6b733e0eb021e3cd50694c0f6b6eb5b2"}, "labelerVotes": {"confirmationDecision": 3, "replyableMessage": 2, "task": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "ambiguous-majority", "sourceDataset": "MultiDoGO", "sourceLabels": ["confirmationDecision", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/software/train.tsv#L7106", "text": "yes please"}
{"ambiguousVotes": 1, "fullAgreement": false, "id": "open-multidogo-software-<CONV>db0edc0f-4148-45ba-ab7b-94dc09020618<TURN>4", "knownLabels": ["confirmationDecision", "question", "task"], "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.6, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "fd9c40db50d84b2b1cfc5ba44d26663b8d33796f791ed723f5c30686a8dd58d3", "cursor-grok-4.6-xhigh": "7c15986fa4d95e280bbf85f44b18bf4c0dae84c2c0885b86ba00a8d10a6bb1a2", "gpt-5.6-luna-medium": "0fbc03a7606990325ba0360c82552f5b23968b5bbc3d0b95d8a83685192778f7"}, "labelerVotes": {"replyableMessage": 1, "task": 1}, "language": "en", "quotedOrMetaVotes": 0, "rejectedReason": "no-supported-consensus", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/software/train.tsv#L10514", "text": "i have a 220 rental car expense 850 for the hotel and 100 for gasoline"}
ModelTraining/ClipboardSemantics/Consensus/consensus-report.json
-65
View File
@@ -1,65 +0,0 @@
{
"acceptedCount": 313,
"actionLabelCounts": {
"both": 1,
"complaintOnly": 80,
"neither": 9,
"questionRequest": 87,
"taskOnly": 136
},
"conflictCount": 47,
"conflictRate": 0.1306,
"coordinationLabelCounts": {
"confirmationDecision": 15,
"followUpReminder": 6,
"neither": 287,
"scheduleNegotiation": 5
},
"duplicateTextRate": 0.0,
"fleissKappa": 0.5942,
"fullAgreementCount": 26,
"intentPositiveCounts": {
"blessing": 3,
"complaint": 81,
"confirmationDecision": 15,
"followUpReminder": 6,
"invitation": 0,
"question": 163,
"replyableMessage": 7,
"scheduleNegotiation": 5,
"task": 137
},
"labelers": [
"cursor-grok-4.6-xhigh",
"gpt-5.6-luna-medium",
"composer-2.5-fast"
],
"languageCounts": {
"en": 200,
"zh-Hans": 113
},
"overlapChecks": {
"exactTextAcrossSplits": 0,
"nearDuplicateClusterAcrossSplits": 0
},
"promptSHA256": "4bd3dbc01202f2a0c69c77ee30c66904889a31485fed3bc1944b286f9ab74cff",
"promptVersion": "clipboard-consensus-v1",
"queueCount": 360,
"schemaVersion": 1,
"sourceCounts": {
"AmazonScience/MASSIVE en-US": 38,
"AmazonScience/MASSIVE zh-CN": 33,
"CFPB via hpe-ai/customer-complaints": 40,
"CLINC150 UCI": 37,
"CrossWOZ": 40,
"Google Research GoEmotions": 11,
"Google Taskmaster-1": 40,
"Meituan-Dianping/ASAP": 40,
"MultiDoGO": 34
},
"splitCounts": {
"silverAcceptance": 40,
"silverCalibration": 50,
"silverTrain": 223
}
}
ModelTraining/ClipboardSemantics/Consensus/consensus-silver.jsonl
+313
View File
@@ -0,0 +1,313 @@
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-10502", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "70fd1d1a036fe5dd38151f828d88172bba69b33cee52f331239a15975a9bb43e", "cursor-grok-4.6-xhigh": "181f026a10cf8f489bd3b15c417b9dcb58113e436a10d6d5b71a6cad7314577f", "gpt-5.6-luna-medium": "39c2ceb730d16a0df204050b169ac658645d923715b28c9f96f5cfeb5893327a"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-10502", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-10502", "split": "silverCalibration", "task": false, "text": "去年来吃过感觉还不错。今天又来吃,太黑太坑哪,再也不敢来了!最坑爹的是拆骨肉拌黄瓜,正常人看菜名会觉得拆骨肉有肉吧?25元的菜上来以后,就是一盘筋拌黄瓜,有的还咬不动。老板说了,牛后腿上拆下来的就是筋,和猪不一样。牛后腿没有肉?我书念的少你可不要骗我啊?!敢问你把肉弄哪里去了?没有肉,你菜名整什么拆骨肉,你叫拆蹄筋呗!欺骗消费者!早知道没肉我还不如点个拌牛肉才28。吃了一会听到他店里还有道菜叫拌蹄筋,我想知道和我点的拆骨肉有没有关系?是不是没有肉了,拿蹄筋顶替呢?欺负我一个小姑娘?***!牛肉汤也不如以前了,15元的大的,牛肉片,豆腐皮,粉丝这些都比以前少了很多,越做越不行了。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-11380", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "eb812c57cd3dda3a62b32a127d09f492e0ef4f319d8302597df2778738646efc", "cursor-grok-4.6-xhigh": "b72b9331ab2daabb64b0383b336320793c26bc2d7c14a055d0b8bad4bb09bd53", "gpt-5.6-luna-medium": "20f2d25cd09db8c927203f42b902065283766accf3739773f2dc59b56277dd79"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-11380", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-11380", "split": "silverAcceptance", "task": false, "text": "口味:菜上了之后就很失望,色面就很普通,味道也是很普通,每道菜都是很普通,都没有一道是满意的,木瓜酥难吃,虾饺像速冻的一样,金钱肚不入味,凤爪点错了,也是难吃,炒饭就和外面福建沙县里的炒饭的味道一样。\\\\n环境:开在公园里,至少开了10年的店,白天进来发现装修已经落后了,不过有一点好,就是人少,安静,但是!有一个大缺点就是地毯,地毯看得出很脏,空气中还弥漫了一股臭味。\\\\n服务:上个苏打水,拿了半天没来,上菜速度倒是可以,服务员一点精神都没有。\\\\n上次晚上来包房和家人聚餐时对这家店留下的印象还挺好,味道,服务,环境都不错,两年后来吃中饭,这里的点心真是让人失望,还是唐宫好吃"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-11481", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "dd55564b3d1f51e8ded6beb666b0b11d7a5eab5532e3433b11beda2e1f5469dd", "cursor-grok-4.6-xhigh": "04ab47fe8a444cca6a18492951e3cfdfd22e362ce09aeab29cb5fd2c15492b9b", "gpt-5.6-luna-medium": "7cf5912ec32dee02cf764d55e0d6854978c701f26ef9b2ee74f90945bfc87874"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-11481", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-11481", "split": "silverTrain", "task": false, "text": "只能说这家店懂得网络营销,盲目的看大众点评真的是人云亦云,看点评来的,榆钱48,以为是本地特色才这个价钱3个人花了270,驴肉黄面特别渣,面软绵绵,菜茄辣西什么的也不好吃而且菜码特小,第二天包车去西线跟好心师傅唠一道,说我们被骗了,沙洲夜市就是糊弄外地人的,本地人都吃顺张,黄面12、3块特好吃,说本地的炒榆钱也就10来块钱,吃手把羊肉也就是本地白条就去靖远,烧烤就董记和老陆。本来还想看点评去老马,师傅说沙洲夜市那些都刷的又贵口味也不正宗。还推荐去腐败一条街的庙街党河边去吃烧烤,说那边好吃不贵,希望能帮到后来的朋友,今天敦煌最后一天了,决定再吃顿靖远或去董记和老陆选一家结束敦煌愉快的旅行!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-1596", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f5abb864790b661573c8a310fb2fafcbfe2dc1aed197c1533be90d5a8df63c68", "cursor-grok-4.6-xhigh": "b52df4010d47d06a26dc0e7b9ff8a1acd55dc984715a8df5e177ceb116dc6014", "gpt-5.6-luna-medium": "3ba710882e8c5b236f40114c0ab871c52de0e4796b5c873da92179ac4e9dc5da"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-1596", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-1596", "split": "silverTrain", "task": false, "text": "一般餐厅里吃北京烤鸭,鸭肉都会被厨师或店家偷挖掉一些来给他们自己加菜或炒别的菜卖,这个应该是大家都知道的,但是你们有听过一条小小的鲈鱼也要被偷肉的吗?点了一份沸腾鱼,看到他们家有活的鲈鱼就要求把冰鲜鱼换成活鱼,他们说换活鱼要贵一点这也是理所当然的啊,后来当着我面捞了一条鲈鱼进厨房,我心里还在想这餐厅应该还是挺靠谱的,没想到菜端出来一吃,全是鱼鳞就算了,里面所有的鱼肉都是带着骨头在骨头边上一点点的肉,要不然就是鱼旗和鱼尾巴,里面就没有一片正常没有带骨头的鱼肉,鱼头也不知道跑那去了,这跟他们反应他们也不会承认的,肯定就说鱼头怕不卫生帮你拿掉了等这种坑爹借口!后来买单的时候还看到他们员工开始要准备吃饭了,这不用猜都知道肯定有鱼吃了!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-2210", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e9b87c25ad1733220e22b8a5f5a56eff8b349759178f4a9b653098b5cffeed53", "cursor-grok-4.6-xhigh": "a0634f2c21aa2147520cb2eadece155e58c9496a53629a6c7a7026849094ea1c", "gpt-5.6-luna-medium": "45035da72933b0d8972b17ad766b2077b6db997abbccc61cd96164172f2a4306"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-2210", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-2210", "split": "silverTrain", "task": false, "text": "下了火车,直奔这里,味道不算多好,跟北京差不多的店味道没有太大差异!汤,味道一般,中规中矩!肉,不太好吃,有点腥味!面,不够劲道,非常一般!辣椒油,还可以,但谈不上多惊艳!鸡蛋,非常不新鲜了,这个可以吃来!如果你没吃过正宗的牛肉面,这里可能会把你唬住!但如果,你后来在当地多吃了几家,你真会觉得这家很一般!服务态度,很恶劣,不跟你解释面条粗细的差异,也不想跟你多说,怎么取餐!可能人家在火车站旁边,根本不愁生意!总之,如果,你跟我一样是个吃货,在意食物,这家不太推荐!如果,你想吃饱,随便吃吃,还可以接受!只是服务不好!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-22337", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4575c967d4ced986d15bc22229a6401339201cd3cc3345532d19bf47156df533", "cursor-grok-4.6-xhigh": "9b8cddd7feabe03b46aa9f92af4169359510112ef7742ebcba4eeeb06c27d062", "gpt-5.6-luna-medium": "b12950d508fe7404d9272eb7a238e9dd6835fc06e80f1b08789bd5604b2ea18c"}, "labelerVotes": {"complaint": 3, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-22337", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-22337", "split": "silverAcceptance", "task": false, "text": "总体来说,是不会再去第二次的消费地点。价格超级无敌的贵,菜品卖相很不好,很不精致,黑乎乎咸乎乎的,口味很差。专门去吃口味蛇,但是特别失望。口味蛇纯粹是被辣椒熬出来的,辣得无法张口,根本无法下咽。餐厅有一股霉味道,拥挤得很,还要收包厢服务费。。。餐前水果都变味了,变质了,放冰箱太久了。七个人花了1100多,真心不值这个价钱,建议大家千万不要去。之前有好多网上的好评论,可能都是他们花的钱,请的托,大家不要上当。。。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-23523", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e51b613ca882692432217d7a2d179ce7bca44158d8c7546c8860075df10d911a", "cursor-grok-4.6-xhigh": "049e12f43f8230290035b1155d487df08977f424aa4a0d7e26ef11dbc36159ea", "gpt-5.6-luna-medium": "c4906eab024da93e6cf0039642798673719ac65bb1ed8bb20ee411725190ae86"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-23523", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-23523", "split": "silverTrain", "task": false, "text": "我实在不明白那些说好吃的人是怎么想的 说说我个人的看法 前餐 面包所谓好吃的面包 其实也是咸的要死 硬又难吃 !沙拉不用说也是咸 牛排更是咸 我本身是一个会吃咸的人还是完全不能接受 只有那个看起来很炫酷的大虾正常点 但也是非常一般的味道 我问了服务员是不是都那么咸 他自己也说本身就是满咸的 如果有中国人说这里东西好吃话!恭喜你是装逼高手!东西吃了一口勉强第二第三口就实在没办法再下口了 奉劝国人三思而行 !! 刚吃完怀着愤怒的心情点评"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-23652", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a1d76837fc1bd0e6bb731543b09b050e301984270c22427bf11738a859fec869", "cursor-grok-4.6-xhigh": "a1d76837fc1bd0e6bb731543b09b050e301984270c22427bf11738a859fec869", "gpt-5.6-luna-medium": "e29bc559ce97ee7c0903a6ac885d76ace7661f566939794f07711e22d28a4807"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-23652", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-23652", "split": "silverAcceptance", "task": false, "text": "我是抽奖抽到一个海鲜锅。之前去过他家光华村那家店感觉很好,所以这次非常高兴的就前往了。结果感觉非常不好。首先这个海鲜锅并没有宣传照片上那么华丽,端上来直接就是一锅开水煮白菜放了几个虾、2个蛏子,搂底能看到下面有些虾皮和墨鱼仔须须。汤的味道并没有任何海鲜本来的味道,基本全是靠调味品勾兑的。感觉有点欺骗消费者不说,连起码的一点卖相都没有。不知道是这一家店是这样还是其他几家店都这样?让我对这家泰国鱼翅馆现在的阿诺泰仅存的好感荡然无存。此外,其他菜品的价位感觉都比正常价位贵一倍或者1/3。价格不亲民,东西没卖相。。。不知道以前泰国领事馆为啥还要推荐。。。而且,团购券折扣力度微乎其微周末还无法使用,让本来就很不实惠的消费更加不实惠。所以我只能给2星。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-23742", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7a7603a2cc1b981a27f4e1f52fa30dd98aa901f9838b5b6b6b8d1b5b600a5c38", "cursor-grok-4.6-xhigh": "203460a63b6385fc2dfa35c53c5edea1ebfc3b3001a87d0d00c36572406c9afb", "gpt-5.6-luna-medium": "186cd44a18277a8f50a1c4ac9db96a7b388fdcb1e6d99752ee81e1973048476c"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-23742", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-23742", "split": "silverTrain", "task": false, "text": "我真心觉得这个地方不好吃,就给两颗星吧。多一颗也不想给了。看了菜单是火锅和西餐的融合,我们都点了西餐那边就点的炸肌肉的丸子那种类型裹着面糊就是油炸类的小食,还点了意面跟番茄打卤面差不多了。说说火锅吧我们点的两个咖喱锅两个鲜虾锅,鲜虾锅里的鲜虾很鲜美很好吃汤煮到最后喝了一口还是不错的,咖喱锅没什么特色,觉得菜量一般般点了很多都放进了锅里吃吃就没了。四个人花了三百多用了优惠买单。是一个一般的餐馆不会再来这个点评也是时隔很久才来评价的我们吃完出去的时候外面居然还在排队,服务一般吧觉得服务员有点懵懵懂懂的感觉都是带孩子来吃的环境也是乱糟糟的一个一个锅子那种像呷哺火锅一样,一般般吧。不想再来了。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-23758", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1103d57a407068db094ea808aa06c1887ef1b2c67ca5cf3659ef905269c8678d", "cursor-grok-4.6-xhigh": "1103d57a407068db094ea808aa06c1887ef1b2c67ca5cf3659ef905269c8678d", "gpt-5.6-luna-medium": "0922d1a275896434ad42616f9cf1b261b320b4b7e399d3247b3fb79294eddbd8"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-23758", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-23758", "split": "silverCalibration", "task": false, "text": "我第一次来这里,没就在星巴克旁边,离东山口地铁站口超近,交通便利。看评论说得很不错似的。只是吃完后感觉很差劲,不知道为什么那么多好评,不知道是不是点的东西不同还是什么原因了,反正印象太差,不会来第二次。\\\\n首先,这里的服务态度不佳,特别前台那个收银员,一点也不热情,问问题都不想答的模样,一副爱理不理的样子,反正我作为顾客很不爽。\\\\n说到点的东西,我点的是红豆薏仁黑豆花和黄金鸡翅,实在太无语了。首先两个卖相都不好,感觉很糟糕,自己煮都不会煮出这种卖相,至于味道吧,豆花一般,就是豆腐的味道的确很不错,其他很一般,而且份量不多,还有那个鸡翅,有4块,十分糟糕。不知道是用什么油来弄的,那种酱油味让人很反胃,自己做的鸡翅都比它好吃。这样一碗豆花15元,一碟鸡翅18元。太糟糕了,难吃。坑爹。。。。\\\\n虽然环境还算可以,比较静,又近电影院,但是应该没有下次。希望店家能改善一下出品质量。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-26227", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9a10c6860306c28931a7bf83ba2e6bc727a1b09481fbc2a7203a76f226da85b5", "cursor-grok-4.6-xhigh": "7b527171532f8fcd6a073c9958b1353bda32dfa6364e65201d6fe5e30dd4661c", "gpt-5.6-luna-medium": "8bad10636a09ccf986dfb9bd897c4dcdbe62756538952da37b8267bb0a8be7e9"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-26227", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-26227", "split": "silverTrain", "task": false, "text": "最糟糕的一次团购经历。券上写明是提前2小时预约,10点打电话,说好12点到,到了之后店家居然说没听我们预约过,而我打电话的时候第一句话就说是预约498团购,虽然5分钟后店家收回了他们的说法,说是忙昏头忘了,好吧,一开始吃饭的气氛就被破坏了,后面还能好吗?然后就是漫长的等待,从12点等到2点,团购的菜也没上齐,一条鱼是足足等了2个小时才上,大家已经完全没胃口了,最后还是剩盐水鹅和时蔬没上,给孩子单点了一份蛋炒饭,也是快两个小时,经过无数次催促才胡乱炒了一份送上来。螃蟹偏小,吃口不好,其它菜也只能说是马马虎虎,完全不值一提,唯一好一点的还算店家道歉比较积。严重怀疑店家有自己刷榜的嫌疑,这个环境,口味,服务能力(怀疑烧菜厨师数量严重不足,造成上菜时间奇长),说是口碑是附近吃蟹店第一名,简直奇了怪了。最后还有件堵心的事,离店时店家不主动提供停车卡(在这里吃饭停车要店家给停车卡,否则路口要收停车费),害的我只能掉头回去又要了一次。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-27234", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6a586e1817791a36db00349f5621ddaf834e2ab9c90b5bc3fee2cee5c4748a39", "cursor-grok-4.6-xhigh": "7ddf123133cc2e0b6bab4cf9a11a9683c43ad2cdfd2406488ca36189556eb2af", "gpt-5.6-luna-medium": "cf47e161763c10c44f48eaab10d2cb60906fe16bcfa99f21d6668ddf0b05e2a7"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "question": 1, "replyableMessage": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-27234", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-27234", "split": "silverTrain", "task": false, "text": "服务冷淡没激情!周末不可以用团购和各种优惠活动!!面包诱惑,冰淇淋很小,面包烤的焦黑,里面的方块面包都塌陷了!冰镇咕咾肉,招牌菜,菠萝被水泡久了没有味道,咕咾肉和糖醋里脊一样的味道,口感硬,冰块太多,菜品太少!清蒸鲈鱼,鱼非常小,而且酱油味道好重,偏咸!!唯一能吃的是那个炒笋,拿来下饭了!!唯一好的事下单19分钟内没上的菜免单!可能也是因为这个所以后来上的面包诱惑清蒸鲈鱼很难吃!!!即便是送的,也应该对得起你们老板的口号和品质吧?!!最后,如果说一家店你是在卖情怀,卖诚意,那么麻烦把饭菜品质提上去,要不很难有回头客!!一家装修有格调,但是很烂的店"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-29777", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "778ecf0f0dda7e681d6db71429a68371d480c90b48cebbbbc73d37ccc8fdf395", "cursor-grok-4.6-xhigh": "9cf8aa0eabb5837d4ee9501121bd60d52b22eca464ed633c909944be1e560286", "gpt-5.6-luna-medium": "cee15ffc6b38fc58198fa4fd43c44552ffeaf5d7f5767e3a1edb20d722a40a2f"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-29777", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-29777", "split": "silverCalibration", "task": false, "text": "火炉火芝士助排火锅之前已经和朋友们在爱琴海那家店吃过很多次了,感觉都不错才敢推荐同事来中关村这家店吃因为离上班很近!结果失望透顶,感觉都不会再吃了,完全颠覆以前的美好体验!\\\\n首先这家店很小,桌与桌间隔巨小,进出很不方便,聊天更不方便!我们四个人要了两个火锅套餐,结果桌子根本就放不下摆的乱七八糟的,都没地方下手!其次服务太差!因为食物完全没味道要点酱而已,结果被告知没有单独给的简直无语!他家冰沙是巨小一碗的,很多桌都希望吃完再上,结果他家完全不顾顾客感受非得统一时间每桌都上!\\\\n最最失望是食物本身,味道特别难吃跟爱琴海那家没得比!尤其是金枪鱼紫菜包饭,完全没味道!金枪鱼少的可怜,一盆里就看到一块而已!米饭也不新鲜,感觉就是在吃没有味道的很油的大米饭而已!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-30376", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "57e14860067c48b545a85a0cfa120424acc712f91989938623576f83650de19b", "cursor-grok-4.6-xhigh": "57e14860067c48b545a85a0cfa120424acc712f91989938623576f83650de19b", "gpt-5.6-luna-medium": "0b68291ba159b008cbc55d57735d4c1f985fef6c1b02ace3b9ae88887088dd51"}, "labelerVotes": {"complaint": 2, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-30376", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-30376", "split": "silverTrain", "task": false, "text": "猜丁壳位于沙河地铁站附近, 在点评上看到好评很多,慕名而来 !晚上六点来的 ,店里没什么人 ,装修风格还可以,很复古的感觉!本来想团那个套餐的 ,服务员说需要提前两个小时预约!我们点的一个正常的小锅,微辣!还点了几个青菜,腐竹,豆皮,味道一般,特别咸,量很大,而且还不能要半份,这不是浪费么!再来说说主食吧 ,习惯了吃米饭,结果上来的米饭很硬,跟生的差不多,而且还是凉的,没办法,无奈之下又要了一份泡饼!服务也一般,叫半天也没人!这么大的店就一个服务员!总之很不愉快的体验!东西不是很干净,吃完肚子不是很舒服!不想再来这吃饭了! 不推荐这儿! 一颗星都给多了!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-31166", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "69d0b5a899480e512cff56623bfbee7c77e317bcd501f5ad80c47aba2e5b1bde", "cursor-grok-4.6-xhigh": "292383b495f51a5412a6cb7288fdc30ea25af51ebda6209c1e12fbf4dc656929", "gpt-5.6-luna-medium": "9b6ae2c49219422ab7cc5c45650f2034e6799235126d3a72f3de34f28fada286"}, "labelerVotes": {"complaint": 2, "confirmationDecision": 1, "question": 1, "replyableMessage": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-31166", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-31166", "split": "silverAcceptance", "task": false, "text": "用了大众点评活动~九折~要了一个薯条~不评论不过不失~先说好的~服务还可以~看样子卫生不错~ 服务和卫生对于一个吃货来说固然重要~~~然而味道更重要~~本着大众点评是用作各位吃货的公平公正的平台~我觉得真实评价很重要!!!!炸鸡是重点~因为我第一次在广州吃韩国炸鸡是在西城都会那家~从此我爱上这个东东~~~我见很多网友评论这家分数这么高~本着西城都会那家对广州版韩国炸鸡的标准对这家点抱有好大的希望~~~结果~~味道好不好见仁见智~我觉得像超市十块钱一整只香辣炸鸡加了酱料在表面一样~~~这里要88一只全鸡~~我是双拼了两个口味所以有两盘~~~我有个疑惑~全鸡不是应该是一整只鸡的意思吗?我上桌的全鸡是没有臂膀的~~颠覆了我的认知~是因为我用了优惠活动吗?只是有一只鸡腿在一堆碎鸡(四分之一手掌大)上面~~请问其他小伙伴你们吃的是这样的吗?在广州我觉得食物始终是店铺持久经营的灵魂~~~"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-31609", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c2b88b0d7a82d405466b877b46175f7c1df8ec0f488315d1633d2c95e6aa7352", "cursor-grok-4.6-xhigh": "02701b8993f02391083eb810a1f8b52af3714daa5033aac0414525269267f093", "gpt-5.6-luna-medium": "495b67ebf92992852f05361c99b0ff159b7d6bdf6076d76a02e966ca24c9a99e"}, "labelerVotes": {"complaint": 2, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-31609", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-31609", "split": "silverTrain", "task": false, "text": "看到如皋市丁堰镇新开出的这家九门寨石锅鱼忍不住带家人去尝试了一下,结果颠覆了我的整个人生观,图为七斤鱼的量,不新鲜先不说,来说说这个店员素质,在未吃完先买单的情况下,服务员收走了我桌上的手机,在目击证人未出面的情况下,老板拒不承认拿了我的手机,各种调监控啊什么的。然后目击证人华丽丽的出场了,老板娘甩出一句:谁要你的破手机,然后以忙着给人家结账为由说你的手机待会再处理,再三催促下,老板娘又甩出一句:你的手机重要还是老板做生意重要[发呆],又过了若干久,从手底下拿出我的手机,让我若干验证,证明我的手机是我的手机[发呆],今天我彻底被如皋丁堰镇这家九门寨石锅鱼打败了。你腻害[强]"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-31889", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2efec461e8e28c8d63cf3320d59d22865947be48771b7aab8a055cbf22b39af4", "cursor-grok-4.6-xhigh": "6cc3f023f6fb6c1a02dc359f670a2a308e1a699d8f464b14d3edcea50c9aa2b2", "gpt-5.6-luna-medium": "ff60878349ca7bfe6e21a79d7b37331d41c5eaadd84951410a4243c8a9830243"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-31889", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-31889", "split": "silverTrain", "task": false, "text": "真不知道那么多好评都是哪儿来的 一个星都不想给 简直难吃的要死了 点的114元的套餐 里面有年糕火锅 金枪鱼饭团还有半份炸鸡 先说饭团吧 一股酸了的味儿 炸鸡都不如路边摊的炸鸡柳好吃 配的那个酱能不能长点儿心 根本就是李锦记的蒜辣酱 年糕火锅我真的不想吐槽了 吃到最后都没吃出什么味儿 一点儿味道都没有 原来在五道口那边上班 和火炉火比起来简直一个是天上 他们家是地下还下两层 老板倒是会在价格上赚钱 团购有101的 有炸鸡和年糕火锅 到店里服务员就推荐直接点店里的套餐 也就是我们点的114元的 这样既省去了给团购软件的钱又能多卖一份饭 总之永远不会再来了 都不如包装马车好吃!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-31943", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a17bdee47abe18a911b09dbbee881d7b7d3cf483556770cd24a685338c269c3f", "cursor-grok-4.6-xhigh": "7552836c0fe84187518b9656ed9a19b5c4348605957f98c28d67c0c768cb3c2b", "gpt-5.6-luna-medium": "9dd32ad0eec6bc142f1c350e5abc0c4d2d2da0335937be6dda7784aa4e858d43"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-31943", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-31943", "split": "silverTrain", "task": false, "text": "真心是不想再去的店铺。先说排班,开门后每桌只能一个人进去,等位子找好了统一放人进去。简直搞不懂这是为啥!第二,服务员每个都是张臭脸,完全没有服务的感觉。我们居然还被清洁大妈教训,说我们拿多了。请问我四个人拿了五盘菜哪点多了?汤锅直到快吃完了都没烧开锅,找服务员来,人家说你们自己坐的位子不对。我*,还是我们的错!!第三,菜品,只想说没吃到一个新鲜的菜。海鲜就那几样,完全不新鲜。牛排将就,不过有点切不动。没啥好说的了!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-34345", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ef10e5a04e4bc69727b912db279782001d5b44d57ad8687269e1f6dbbcc85b36", "cursor-grok-4.6-xhigh": "db157bfbf04455222fc02b4d48af2ab1455383b7be6ec32fe5e67cc0358628e4", "gpt-5.6-luna-medium": "e1ee9970a4c836932c88c1ccef48e978e46b2e97d88e307fd82944c682dad62a"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-34345", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-34345", "split": "silverAcceptance", "task": false, "text": "绝对的差评!!本来看了大众上点评不好,还抱着试一试的心理去了,没想到真的不该来!首先桌子旁的点菜台,服务员自己就不怎么会用,我们觉得放的太高,看着不方便,就拿下来,结果服务员看到就厉声说“这个不可以拿下来,我们有监控的!”你说不可以拿下来我理解,但是TMD后面一句我们有监控的什么意思??!!然后每个人都要强迫收茶位费,我们每人点了一份饮料之后就开始点主食,结果点炒饭的时候,里面又包含了一杯饮料,我们就问服务员怎么回事,她回答说这个饮料是送你们的......那我们就很不解,你都有饮料为什么还要强迫每人都点饮料,这不是霸王条款么?!......吃饭期间有隔壁桌顾客愤然离席~可想而知服务有多差,菜品味道也很糟糕,饭又硬,牛肉吃着像猪肉,杯子没洗干净,粘糊糊的......各种不愉快......这家店不好好培训下员工我看迟早要完蛋!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-34705", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9e39d1405ee8611e795b780362a2a2240e143ac5dab08c516481517c80414256", "cursor-grok-4.6-xhigh": "7bcfedfaaebf1cc7e5849a94557efc1080a967e5c908847408662c154b8c670e", "gpt-5.6-luna-medium": "05328e17d9702fc3d549191170f8c5ab12d025525bd55d9a52df1bb9bb108076"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-34705", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-34705", "split": "silverTrain", "task": false, "text": "老实说真心不值得。价格不是很贵可是种类比其他自助餐少。连生蚝跟老虎虾都没有,只有便宜的越南虾。熟食选择很少,味道也一般。唯一好的就是蛋糕种类还算多。\\\\n7点半去,基本上一半客人都走了,可是八成的脏桌子都没收,我还要在外面等了15分钟等服务员收桌子。这种服务也说好的真心醉了。而且自助餐应该是送一杯饮料的,可是你要是不问,服务员绝对不提。\\\\n至於环境嘛,畢竟開在威尼斯人,差不了。可问题就是收桌子速度太慢,附近都是脏碟子一大堆,影响食欲。\\\\n大老远来一次澳门还不如多加一两百去吃别的自助餐。这家简直就是浪费了我一餐饭!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-34899", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "52449a34a6fb4dade486fb0ec359f49a726e2ea43b903b3ad0c95897843af692", "cursor-grok-4.6-xhigh": "81ea27061e1f8ae70502212f8bcb11d84b3b131a8c17deffc5cb94993e721346", "gpt-5.6-luna-medium": "d89498c879731c7a30c640ef4b6a88a127feba7bb90cc38f8dca1f63e6b4af6f"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-34899", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-34899", "split": "silverTrain", "task": false, "text": "考完试我老公非要吃这家,我本来要去海底捞的。事实证明他又上当受骗了。不只一次了,人还是不要贪小便宜的好,对于这种喜欢团购的人我只能说无语,不过还好今天吃完这餐他自己说出了他保证这辈子以后再也不团购了。因为什么?因为实在是太难吃了,点评好评的都是托儿。这家日料食材差,报价虚高,然后再折扣。非良心食品,关东煮跟7/11的好炖似的,刺身雪藏的我一口没吃怕拉肚子,寿司姜都是差质量的,寿司长的跟蔫茄子似的。而且团购价也不便宜298/2人,你刚买完团购券服务员就问你要什么饮料啊,有柚子茶etc,记住千万别点因为是另收费的秋后算帐。总之我今晚吃了一碗面算是填饱了我的肚皮,我肯定不会再去,而且我保留投诉大众点评商家自己刷好评的权利。这哪里是诚信社会,这是坑蒙拐骗的社会!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-35453", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "81b228af35eef3ead2d47c5c4bf9a0fca900729c91c1efbfa739045f0afd21cf", "cursor-grok-4.6-xhigh": "482c8212c104dd3aadb2a8c7bd98b3b352de852ddf28d136d7a8c0d29b733b9a", "gpt-5.6-luna-medium": "033a2e773e78a41e6adcb96f220dd46a4927f2b16bf516e704608efd9d0724e4"}, "labelerVotes": {"complaint": 2, "confirmationDecision": 1, "question": 1, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-35453", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-35453", "split": "silverAcceptance", "task": false, "text": "菜品真的不想说太多,不知道网上那些那么多的好评怎么来的,水军真的太多,真的是济南最好的自助餐厅嘛?看了下网上的菜单品种很多,今天去了海鲜只有三种!煮熟的蛤蛎、煮熟的海星触角、煮熟的的扇贝、唯一生的就是三文鱼片!三文鱼限量供应,薄如纸片...扇贝太老、网上看的照片有烤牛舌、有鹅肝、有煎牛排、有西瓜汁、牛排、烤鸭卷、焗番薯,这些都没有看到,大部分感觉和早餐差不多。本来想用团购,因为我是住店顾客,说是138元,网上团购是128元。相差10元也无所谓,三文鱼真的太薄了,第一次吃到这样的厚度,限量供应,每次每人7片左右。不过客房服务还是挺好的。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-asap-35476", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "248d1ec1283488f58bd6370956f0c3d3cddfc81e7267ab3f96d926928f806d4c", "cursor-grok-4.6-xhigh": "db9d079c04b2d05559eb0a7fef1c367c662f2c03f5ea8832ec5e77ed59cdeb32", "gpt-5.6-luna-medium": "269bd0a6ae5dccd67b29b194e47ad44771bb1adef10669ab27866d2430d7f7d7"}, "labelerVotes": {"complaint": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-35476", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-35476", "split": "silverTrain", "task": false, "text": "菜品还好但是老板和她弟弟都是凶悍的人,随时可能冲上来和你干架。吓的我都直接报警了,那女老板还叫嚣着你们两个人吃90块还要报警,你这女的真是连90都不值 各种骂人的话。另外这家说和大众点评没有合作,优惠只有美团,和大众点评沟通的时候老板弟弟把手机丢给我,我给放回柜台上后来就被赖着说是我把他手机摔坏了。还有她家端上来的东西你要是没点可就小心了,有的是免费有的不是,她家就靠这个坑钱的。建议要去她家吃的带上几个壮汉,妹子们千万别单独去,去了挨骂是小,挨打就亏了。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-35553", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "cb4831eae0e8183f2a38da117c74ea29b3c0a6b13a104a61fae02b8199203b0a", "cursor-grok-4.6-xhigh": "9865149344e4c70f0307e77443617b8bbd80a04febcd383f90e410c420d5b1de", "gpt-5.6-luna-medium": "02842f45a5caa891687fd01b88797bb12266abeca5f966e0690e574e29e09128"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "question": 1, "replyableMessage": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-35553", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-35553", "split": "silverTrain", "task": false, "text": "菜真的不是新疆口味,当然本人也没去过新疆,但和在别处吃过的新疆人做的比差距还是很大的。茄子这道菜感觉说的过去,茄子有点老,味道还可以。红柳串还行,但价位算高的。烤羊腰里面的筋没剔干净,不能咬断,影响口感。馕丁炒卷心菜太甜,甚至有糖还没有化。奶茶明显不是熬出来的,感觉就是红茶泡好兑上奶,而且兑的奶比例还不够。烤包子都差不多。炒片儿和我吃过的所以炒法都不一样,番茄酱好像没放一样,反正我不喜欢。小油馕是我感觉最好的,像小点心一样,可以给个赞。最后说下大菜烤羊排,真是太失望了,本想大吃一顿,以为要了整个的会吃不了,可菜上来发现块真小,更没辙的是肉还明显是被剔过的,肉少就少点吧味道还不好,烤的都干了,刷油不够,我觉得肉煨的应该也不好。总之这次午餐是很失望的。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-38143", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1f2f504c51b073c310ccbfb108e0afe078a717820b78f2e575354df47acf34be", "cursor-grok-4.6-xhigh": "1d95f885fc915dea1a11225a08db7b48d337addb5aee3dd26d1238f5b3480cf6", "gpt-5.6-luna-medium": "40df4beb009dc46dd275a1e2983278218d84755c8666a50280bd00a0e2d90972"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-38143", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-38143", "split": "silverTrain", "task": false, "text": "这家店在一个不知道什么湖边,超级不好找!老板开始会非常热情,在路边等客人,等我们都坐下后,一会一个电话,根本没有心思帮你搞螃蟹,菜就是普通的家常菜,一个高淳豆腐30元,炒鸡头梗20元,清炒菱角20元,韭菜涨蛋20元总之一句话就是素菜价格不是20元就是30元,价格高也就算了,关键是难吃级了,没有水平麻烦不要开饭店,载你没有商量。一个鱼汤58元,菜品份量很少。螃蟹也普通,90元一对,比较失望,因为很失望,照片我也是难得拍照了,反应下这家宰客现象太突出,请有关部门可以介入调查。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-38238", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2c0816127e1b4e18b47c42c897255ffe8775321130deb25e2b9eb611a0ad99de", "cursor-grok-4.6-xhigh": "2c0816127e1b4e18b47c42c897255ffe8775321130deb25e2b9eb611a0ad99de", "gpt-5.6-luna-medium": "8317a445b48841e8932c2dff85a269ce3a70abf8b00aa82bbfb7a0d942b6fa6a"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-38238", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-38238", "split": "silverTrain", "task": false, "text": "这家店在枫蓝国际的二层 店面很有创意 餐厅整体风格都很复古 很嘻哈 很多都是老旧东西 充满小时候的回忆 进店后服务也很热情 第一印象感觉不错 之后开始点餐 二个人点了七个菜一个酸梅汤 菜量很小 估计一份菜二个人夹不了几筷子就没了 但我们剩下很多 是因为简直太难吃了 可以说我还没吃过这么难吃的餐厅 但这要看个人口味 反正我觉得不好吃 点了杭州酱鸭 很油腻 还有些咸 不好吃 首尔烤肉 特别特别柴 一点肉香味没有 不好吃 葱香大排 就是饭盒装的一块猪排 有关是炖的 没什么味道 不好吃 笨鸡蛋炒虾仁 就是摊鸡蛋弄碎放了几个人指甲盖大的水发虾仁 不好吃 干锅有机菜花 下面一层油 不好吃 开胃肥牛锅仔 这是最难吃的了 肥牛又柴又加生 里面的番茄金针菇就是白水煮出来的味道 不好吃 鲜蘑芝士卷 这个算是里面相对好吃点的了 本来看了大众点评五星过来的 但可能每人口味不一样 我只能给二星了"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-38674", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1c530cc3cc1fda8537c2a5f8fa42522e96639ab641efc1431271e454a507cf90", "cursor-grok-4.6-xhigh": "50d11bb3db390bf7210d9d7c3ff13f1f9b7619a19b5ea44946b24d5dad3f404c", "gpt-5.6-luna-medium": "65282eb8c66c948ebdcbc7bba06cdb718fd641e457fc4e8a57964fbd0b2585de"}, "labelerVotes": {"complaint": 2, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-38674", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-38674", "split": "silverTrain", "task": false, "text": "这家店的菜总体来说还可以,牛蛙和麻辣香锅味道还行,烤鱼实在很一般。但我想说服务实在太差了!!!!!!!非常气氛!!!!!!!服务员的素质极低!!!!!我家娃十个月大,一家人带着娃吃饭,好不容易哄睡了,在我身边的推车里。结果一个女服务员收拾另外桌时把一个大盘子打碎了,声音非常大,宝宝突然被吓着了,盘子不小心掉了就掉了我们不说什么,结果她又双脚踩在盘子上很张狂的蹦了几下,再次制造几声巨响,我们说有婴儿睡觉麻烦轻一点,另外一个男服务员一边收拾桌子一边说难道还要我垫海绵?!你说又这样的一群服务员,别说服务,连起码的公德都没有,这样的店能好吗?总之这样的店千万别去,不够生气的,服务不好还不让说,小心再在菜里放点啥。。。。。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-asap-39659", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6347431ab4db661300cecb2bb684f27880b6972c393d9b5dde334dc4217ed938", "cursor-grok-4.6-xhigh": "c553e2bd6af059406864095c18173da243120f04e0673706e3eeacd761bf5297", "gpt-5.6-luna-medium": "f87c96ba799d28f98fe57094d4c1b11e2bd9626025722742516a036c0e356c98"}, "labelerVotes": {"complaint": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-39659", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-39659", "split": "silverTrain", "task": false, "text": "这次去天津玩,为了图方便就住在了火车站附近,早上起来到火车站广场看看有啥好吃的,无意中看到了庆丰包子铺,当时就想到了***来吃过,所以也就进去看看了。里面吃饭的人还是很多的,排队买早点,各类早点都很齐全,就是真心贵啊,包子是按两卖的~~~俩菜包加一碗稀饭居然5块钱,包子也很小,稀饭的碗也很小,都没敢敞开肚皮吃,敞开了吃估计一个人要十几块钱吧,这要在我们家乡开店早倒闭了,我们那早上一大碗牛肉汤一个馍馍才7块钱。贵就算了,问题是味道也一般啊,还没家里老妈包的包子好吃,不要说穷吃不起,就算吃得起也不会去吃的。难怪以前看***在这吃包子的新闻,好多人下面都回帖吃不起,真TMD贵。反正以后是不会去吃了,就图个新鲜吧。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-40660", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "425c01877569e0d05ef8f0ef87fc38391afefda01848009ff7aa6e53b2efec33", "cursor-grok-4.6-xhigh": "bc7179d9610de46a55f10a98892acba578faa48024421b4322d59333eeb0da3d", "gpt-5.6-luna-medium": "b404ec9386a8a457aa1fd88681f8edce5b1d10f1ed887f8bafc127557c2fdc08"}, "labelerVotes": {"complaint": 2, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-40660", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-40660", "split": "silverAcceptance", "task": false, "text": "针对这家的价位而言:设施不全没有本店自己的洗手间;口感差:其中一道酸辣汤辣的我们不轻,打包时碗底还沉着那么多胡椒粉,回家添了两碗水加了菜和面片还辣的大家出汗。另外的菜油性大,口感一般。炸菇的辣椒都发苦。菜量小。土豆丝18一份,36元的茄子没多少,因为极辣,带回家也没吃完一半。餐纸自费,打包盒自费。整体来讲没有以前的清心莲高雅周到但价位高;没有新开的自然林的品种多;也没有卫校对面那家素包子铺和乐天原来15元的自助亲民实惠;更没有雨花斋的感恩氛围。对于一个吃素食的人来讲,这顿饭没吃好,似乎不知它定位在哪里。第一次让我有了下次不来了的感觉。只是最后结账时的那个男孩一直很温和,体贴,很是受安慰。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-40694", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "51181cdf13367c16fabf60283f8dd33a6312c5769dd7f3e1f7187b10bc1f3634", "cursor-grok-4.6-xhigh": "51181cdf13367c16fabf60283f8dd33a6312c5769dd7f3e1f7187b10bc1f3634", "gpt-5.6-luna-medium": "20c19f32f97f1d059edfb7b4258563833716be8806527fc5d85af134f655f35f"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-40694", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-40694", "split": "silverCalibration", "task": false, "text": "银河里的餐厅都吃过了只差这家没吃过,前几天去尝尝简直失望死......三杯鸡嚼不烂,黑椒牛柳粒不是应该用黄油么?烤玉米就是水煮玉米稍微烤一下既没有奶香味也没有刷其他的料汁调味......烤鸡翅火候不够里面还带血丝......水煮牛肉咸的要命......结账之前问服务员团购的代金券能不能用明确的说可以,结果结账时大堂经理又说不能用要提前一天预约,应答口径都不一样就不能好好培训一下么......旁边桌三个男孩点了三个菜三碗米饭吃了没十分钟就走了,菜基本没动米饭只吃不到一半......看来不止我一人觉得不好吃"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-41080", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d73915a60b1dad4d07cb8573883ca761b6d8e56eff7045bcb65bb9b6b69a7d79", "cursor-grok-4.6-xhigh": "64b3d23d7bae99cf9eb1f5b96ef0f31f808966068112b2f89f642eee7828c8b3", "gpt-5.6-luna-medium": "51b11d3020965e39852f3563cab282f946c15183a75f4ee71d640338e1d53b62"}, "labelerVotes": {"complaint": 2, "confirmationDecision": 1, "question": 1, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-41080", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-41080", "split": "silverTrain", "task": false, "text": "隔三差五跑去吃,算常客了!但是这服务态度真是一次比一次差!今天坐无烟区,这态度我也是醉了!碰到个女的中年妇女,之前让她催单,后来让她过来结账,刚想开口,她就超级冲的开口「不是催过了吗」这说话口气差,服务态度差!过了会又跑来个男的也态度很不好的问干什么!好像来干架一样!真的搞不懂我们到底谁是客人谁是服务员!必点菜油爆虾的数量也是越来越少了!同样的老板,还是隔壁的全牛捞态度好!真是一颗老鼠屎(服务员)坏了一锅粥!现在这种讲究服务的社会,这样的店真是迟早没戏!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-41822", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "55e067f27ba1b013aa24827b28544a51f91c6f7a4264df2fe0f5054bfd8069de", "cursor-grok-4.6-xhigh": "719cef4257eb34795252c9b62e4072a5926f1fae67c3a323e6914bff32b80683", "gpt-5.6-luna-medium": "417d9c1555781bde2ab241deff14340fc412e7c8b44e7fd2592eb5a6b9f2a03a"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-41822", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-41822", "split": "silverTrain", "task": false, "text": "食物的卖相是挺好的 味道一般 但价钱好贵又不是特别好吃 人均125 而且并没有吃很饱 店里特色的寿司雪糕 不太懂欣赏 个人觉得不好吃 熟扇贝味道不错 感觉很新鲜 三文鱼塔塔一般般 其他的都没什么特别 上菜慢 下单一小时后 才上一份寿司 当时店里面客人也不是特别多 厨师就有十多个 真正在做寿司的只有两三个 其他的都在嬉皮笑脸的聊天 ...... 感觉很没有诚意!!! 这家店不会有下次了!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-44699", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "13d7e6307f533cc495c7d96f5bdac19b29b2478f4bcc060c51898af9d0d6265e", "cursor-grok-4.6-xhigh": "b59d4aaed223aa2ed16b4bcc0fc6ccd15f504818261e5f530f7e1314ddf7ea37", "gpt-5.6-luna-medium": "0a785018f041aa7b0f153b872fdc48868ca5bfe6c493f1305602bef3dd743d24"}, "labelerVotes": {"complaint": 2, "confirmationDecision": 1, "question": 1, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-44699", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-44699", "split": "silverAcceptance", "task": false, "text": "地址:人民公园西门向被300米路西......走到一看店家门面活动价也是一元一个鸭头......有些人会觉得门面现金价和团购价一样都是一元一个鸭头,会有一些心理落差!其实我觉得还好,一元能买到一个鸭头,不管了门面活动价还是团购价都很值......一个帐号最多买六个~~服务还挺好的,走到说是大众点评团购的,说了一个验证码就可以连续把六个都验证了,很方便!环境一般,就是一般的门头,所有卖的东西都是外带的。没有餐桌,只能打包带回家吃!回到家一看鸭头上面很多毛都没清理干净,看着就浑身起鸡皮疙瘩......顿时胃口全无!挑了一个没怎么有鸭毛的尝了尝,说实话口味还是可以的,麻辣口味的!就试吃了这一个,剩下的五个都扔了!看着鸭头上的鸭毛实在吃不下去!希望商家要注意,以后一定要把鸭毛清理干净......"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-45138", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a60c9ef9a6c6b7dec753114520f05e73400c25b7673eb426575f349af2a85ab5", "cursor-grok-4.6-xhigh": "cfa3983a6f0fdc7f7a51ed37e8288a1c2b45870b331ef9601e624f1146d82153", "gpt-5.6-luna-medium": "fca9056b8ae9db8e7f5b63ffbe37f1a6fa54ad8ef25c40ad6355b18312eb82f3"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "question": 1, "replyableMessage": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-45138", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-45138", "split": "silverTrain", "task": false, "text": "差评!差评!差评!我不清楚这些好的评论是真的还是假的。作为一群七零年代的人,这个饭店的吸引力非常大,所以把同学聚会安排在这里觉得非常有意义。提前一天预订了,结果到店已经被人坐了。交涉后最后确定订座,但是座位不够没人加,餐具不够没人加,叫了半天服务员给了我们一堆碗筷,叫我们自己分,!点了八个冷菜,十二个热菜,一共七百二十。人均70,不算便宜。主要问题是菜。熏鱼是死鱼做的,海蜇是人造的,猪油饭是微波炉叮出来的,硬无味。柠檬虾都是死虾。鱼头也是死鱼,泥味。三鲜汤肉丸鱼丸全是渣。悠咄鲜更是无语。一桌菜居然没有一个菜是好吃的。也是从来没有过的。这样的饭店居然有这么多的好评,不知道是公关还是真的好吃?对于一个吃货来说还是真实的告诉大家,希望大家都有个判断。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-453", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "99fe3e9a8fde3acda5075711856811275eb831b13d7c8a9069e9b1e92f52e852", "cursor-grok-4.6-xhigh": "3e5e37c10edff705a3ce456f5ff5409c4e79ff541ebc8c3f1e1d4837eb4a8c2f", "gpt-5.6-luna-medium": "164c2656d59174f9971993043987939cb01f21d2f6a5f86a8d65eea28c7522df"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-453", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-453", "split": "silverCalibration", "task": false, "text": "9月23日陪老婆去金源mall玩在购物中心一层吃的金鼎轩,天气不错坐在外面吃的,首先,服务真心烂,一大堆服务员在那里傻站着,叫了半天才动,动,竟然先上主食!我去nmlgb,最后反复催菜才吧主菜上了,尼玛我都吃饱了!而且叫了两杯水,到最后走人了都没上!再说食物真心不好吃,其实就是一个大排档,菜品几乎可以和成都小吃类似,招牌的味道真心垃圾,也就鸡爪比较烂,味道还可以,我也是瞎了,在金源5层大排档吃你家那个鸡爪还觉得可以才去一层又吃了一次,金鼎轩名字不错,真心可惜这名字了!唯一推荐的就是鸡爪,本身菜单上菜品就少,还特么弄了4个菜单(一个水单,一个菜单,一个防霾菜单,一个素菜单),你特么逗比吗?一打开才尼玛几个菜品?弄这么多菜单你们真特么有闲工夫,这个也就是推荐吃吃小吃,不建议朋友聚会去吃,因为菜品种类太少了,几乎没有选择!kqnnamduohaoping,nimenchiguodongximei?meiqizi。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-46343", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.82, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "45571811d910c479f411e34a2886cc56f48f054c1ad37e5269b8269bec9ac8dd", "cursor-grok-4.6-xhigh": "241688d1a9fd1d4a975ccd55ece9b0eddabe1c7e0088ac87109a4bb7fc88a688", "gpt-5.6-luna-medium": "5ffe2d63aaacc4525c03736d5c8d636d92f0c43a28a829b4bd517bd80bac674a"}, "labelerVotes": {"complaint": 3, "invitation": 1, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-46343", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-46343", "split": "silverTrain", "task": false, "text": "环境靠河边,还真的不错,微风凉凉,口味一般般,分量小,比浏阳蒸菜的分量少多了。价格不是一般的贵,晚上点了一个口味虾,一个清蒸虾,一份皮蛋,一份海蜇皮,一份毛豆,还有一份土豆丝,十碗猪油拌饭,一共400多,猪油拌饭,男孩子吃,应该差不多5口,份量少的可怜,味道还可以咯,只是味道跟价格不成正比,再说服务,服务本人觉得是可以,但是一起去的朋友觉得很差,去试试口味的,还可以选择,要是注重口味的,还是不用去了。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-5022", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "65a2e998191604b655d8a8c43522348408f6ee2ba26b9e00ff6322a8ff2bfa9f", "cursor-grok-4.6-xhigh": "ad66153083311e55490107de6a4ebd3c28a8e61aa34b947b67dd5adfc62fd981", "gpt-5.6-luna-medium": "6c953390e477d386fc7e958bb9fdb45efd0a561f6640b702e415807242e9b591"}, "labelerVotes": {"complaint": 3, "question": 1, "scheduleNegotiation": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-5022", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-5022", "split": "silverCalibration", "task": false, "text": "什么玩意儿,东西贵不说环境也乱哄哄的,看菜单一盘麻豆腐要26,服务员也爱答不理的,你东西再好我也不会再去了。等了50多分钟肉饼,中间问了服务员两回肉饼什么时候上,服务员哪也没去谁也没问就说快了快了,快你大爷。最后肉饼出了竟然给刚到的几桌先上了,你妈啊,真的是什么心情都没了。所幸不吃了结账,还说肉饼排号,排你大爷,我先到的旁边翻2桌了,给刚到的人先上这叫排号排单子,总共一瓶啤酒两个肉串还能给我算错帐,真的想他妈骂人摔东西了,操!真他妈给北京人丢脸。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-6345", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f63b13a67480d744c7332bd007f5474ca8e8ffea0b79859750a2dfcac3d87a78", "cursor-grok-4.6-xhigh": "72a869aa23e37c2dbd869aa02c83e8dd338484f5518bc06b4875c6254e1ab407", "gpt-5.6-luna-medium": "c511bb094bdf586d4052e1a4dcc07e5e1f5c4ffce13597f71c568cf84a4c0ce0"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-6345", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-6345", "split": "silverTrain", "task": false, "text": "以前去过两次感觉还可以,昨天简直太失望了,朋友过生日定的唯一一个单间,低消600,三个人先去的点了十二个菜,四百多,告诉先做,别的朋友来再点,服务员说什么也不给下单子,说必须点到六百才给做,最后点了十六个菜,七百多,又要的白酒,让服务员打酒,服务员说不会打,我们说不会打就退了吧,服务员态度恶劣,真怕把弯弯鸡的汤扣谁脑袋上,九个人十六个菜,菜量太小了,没怎么吃就没有了,羊排肥腻的没有办法吃,香辣虾也就八九个虾,鱼头土腥味很重,总之是一次很扫兴的聚会"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-7730", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "8057eff005ddd00cd1e9c2166845f0013a4bce2461752b1bab0b3bf1bce4a75f", "cursor-grok-4.6-xhigh": "885fab5249664fac9601f3f23ab1cc86f37d5f49633b2f33b18c2fe4d8d9eec2", "gpt-5.6-luna-medium": "a2f5f3558866178692eb08ab4eb5571f8c9ff0a19c6ef491fd560b0f8472287e"}, "labelerVotes": {"complaint": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-7730", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-7730", "split": "silverTrain", "task": false, "text": "住六建30多年不在五棵松路口吃饭、因为离301医院太近。阅兵日单位没早餐,图干净特意上二楼宏状元、没几个人,点了一碗南瓜粥、玻璃保温箱里夹了两根细长软塌榻的油条、一碟小菜(碟子就巴掌大),付款时说19元,我蒙了几秒 为了确定自己没听错又问了一下单价!服务员很淡定: 粥10元、油条3元 剩下那小菜肯定也是3元...没吃!把托盘放桌上我直接退出来了。守着301医院、连餐厅都黑!心疼那些外地来看病的。。。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-asap-9336", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0784d9e7cbb93d2a5af90323b3c3194f90370dc2f2da9930b6c8de77cc5f037b", "cursor-grok-4.6-xhigh": "0784d9e7cbb93d2a5af90323b3c3194f90370dc2f2da9930b6c8de77cc5f037b", "gpt-5.6-luna-medium": "f7486e096343bf649988df5bb63d126209e2b2644760341534757c2c16b3a329"}, "labelerVotes": {"complaint": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-9336", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-9336", "split": "silverTrain", "task": false, "text": "到广州旅游,去了广州塔,饿到九点半晚饭还没吃,原本以为是个夜宵好去处,看了下菜式以海鲜为准,谁知道价格贵点不算竟然还有隐形消费加工费,另外茶水费说是广州习俗也就算了,两人点了两个大懒尿虾,花螺,蛤蜊,生蚝,原本想点番茄炒蛋谁知道炒个番茄要58加蛋要68,毛血旺才63,这素菜赚到手软了吧,海鲜只能说新鲜点但是味道烧的都一般,但是毛血旺实在让人作恶,咸到醉了,厨师你以为在淹咸蛋啊,叫了经理,让他尝试了下,连她都觉得确实咸,哎 换了一盆上来总感觉已经有阴影而且味道也不入味色面也不好,尝了两口就放弃了,这些菜850,实在性价比不高啊,服务态度也觉得一般,只能斩斩外地游客!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-1777502", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a1159d5f2226423cf64e133728dc64ee0f72946e4d6b03c012468b2d2e5c3558", "cursor-grok-4.6-xhigh": "a33f0010896e1dcea33c1300e008cddcfab3246ee5d5dbf2efb6ce21f99f748f", "gpt-5.6-luna-medium": "ffdc70d7bb66b4dfb15c9a1ec776e73bcc13c0a243580a795576aaa207c90cc8"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-1777502", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/1777502", "split": "silverTrain", "task": false, "text": "took out a {$5000.00} cash advance on my bank account 115.00 % rate could not pay the high cost cash advances is not legal in the state of Arkansas XXXX is reporting these accounts for cash call XXXX XXXX collections"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-2555962", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "3262c3712d2d02404660bedda6e1b0268df94192baa61058f3c164d7afa05196", "cursor-grok-4.6-xhigh": "4f4526f6b5d8a85a452cff783b3a494776700d82477863a48772c276c71ecdf9", "gpt-5.6-luna-medium": "140b439a2e6aaad7da46d62a46c8ad5440db7189068f8f789c90d04ae16f49c3"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-2555962", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2555962", "split": "silverTrain", "task": false, "text": "I am a victim of identity theft and have been a victim of identity theft for well over 11 years. I have an unauthorized and fraudulent account listed on my XXXX XXXX, Equifax and XXXX credit report that 's fraudulent. The following account is fraudulent : XXXX XXXX XXXX account : XXXX. Please permanently delete this fraudulent account from my credit report."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-2701144", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e93175f38c63bce9f9c6dc0344a3bcc7f85477b3ef7808f45e7890c4ec5c1b46", "cursor-grok-4.6-xhigh": "297d060165b803513457331e7d51344be608cbb59a35f481837c91954fcfd2b8", "gpt-5.6-luna-medium": "9f32dfe794c2cc9aff489cbb018305445681e530208ab52c67654b7ae6021561"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-2701144", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2701144", "split": "silverTrain", "task": false, "text": "There is an account on my credit report from GC Services with XXXX. For balance it says XXXX and for high balance it says XXXX the information is incorrect. This account was also removed from my credit report and keeps reappearing. It was removed because of the amount being incorrect."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-2986864", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ddd4b63938d885c4b0b435c76b78149158917f3e0475a8c0898659bb324ef72f", "cursor-grok-4.6-xhigh": "ca3a273dd5a5b67021945e965903d9cb330864e431a9e471b452f2296dfc3218", "gpt-5.6-luna-medium": "3b13b62eb1adf52976467d53f3d3e4e00e89f9af60a820311006001b14cf874f"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-2986864", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2986864", "split": "silverTrain", "task": false, "text": "On XX/XX/XXXX and XX/XX/2017 I received a hard inquiry from XXXX, which I did not authorize. I DID not request to obtain directly or through third party any loan or line of credit or charge card from XXXX in connection with this request ( as I already have one and do not desire anymore at this current time. )"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3001841", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c42e9acbbb4fe7e282e6fb1e93b52d7c5c77e864a023e45aa4a760800a9f6bfa", "cursor-grok-4.6-xhigh": "c42e9acbbb4fe7e282e6fb1e93b52d7c5c77e864a023e45aa4a760800a9f6bfa", "gpt-5.6-luna-medium": "2852b8e2fda6a116f3702dddeddf4796c71cd017adb3720e5ac2872611f888f9"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3001841", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3001841", "split": "silverTrain", "task": false, "text": "I have disputed an error for an account that I had with XXXX XXXX credit card with XXXX, experian & XXXX. I have provided a copy of the check that I paid the account in full to both the credit bureau agencies as well as XXXX directly several times and yet this account is still being reported as late and not paid. Legally they are obligated to correctly report the right information and they refuse to."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3073568", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a4c85c251d4c8770a54ccac7102d06230f9915539e594b2d050f5befef7de8d4", "cursor-grok-4.6-xhigh": "a70f660577cdbf4c1ce3a8a4f78fbca079163985f328b302a25a5a62887111b1", "gpt-5.6-luna-medium": "b95dc58ecfbb8025cebb6f9fff4efd1136b824ff30548f149950acb8c9144bc6"}, "labelerVotes": {"complaint": 2, "confirmationDecision": 1, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3073568", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3073568", "split": "silverTrain", "task": false, "text": "XXXX has been non-compliant with removing the unverified account BANK OF AMERICA which has been deleted by XXXX and XXXX. XXXX and XXXX have both completed their research and determined that BANK OF AMERICA was not established by myself but XXXX keeps verifying this accounts. Also, when I called the company they responded that XXXX did not send them all of the verifying evidence to confirm each account is unverified."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3169526", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "77b4000c814fc73b76ca60a5bbc85be627fe5a0b47c05cd4603489f7983a09cc", "cursor-grok-4.6-xhigh": "cf06553d7a35c561a890082da7087f68e4aebf603bedaca106f65b34008ebfae", "gpt-5.6-luna-medium": "7daa25e09d312e08169c8d4f6ba360065f846f7a0b21d76a01937002900bf583"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3169526", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3169526", "split": "silverTrain", "task": false, "text": "CMRE contacted my sister about my debt XX/XX/XXXX @ XXXX expressing to her that they were going to report the debt to my credit report and they would next garnish my wages she explained that I was not home but the rep insisted that she was in fact me I then called them and they said they were sorry the last rep did that but would I like to set up payments I explained to them this isnt correct and they needed to verify this incorrect bill"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3258718", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "863191672da4845a927d8422fae76054c940228c323d0d91005a7ae9135e3721", "cursor-grok-4.6-xhigh": "863191672da4845a927d8422fae76054c940228c323d0d91005a7ae9135e3721", "gpt-5.6-luna-medium": "171579db3dc52abd9bae9c615c36959c30eaed93575820c5db5940c8a7b24911"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3258718", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3258718", "split": "silverTrain", "task": false, "text": "They would call repeatedly and not say a word. Then they called me once cursing and using offensive language. I told them you have the wrong number and they dont care, they keep calling."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3315833", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "19b346cfd342cd46e546b556ee880547962508729b80b3ec01421328c1769822", "cursor-grok-4.6-xhigh": "a9cd654b33c8e9c9f6a6ab2f0480aac2759d854c0798195f21b6a9802b2fa809", "gpt-5.6-luna-medium": "35080cd9334a7ec73888092273988d38069f72d333289d9f2364149fea159445"}, "labelerVotes": {"complaint": 2, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3315833", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3315833", "split": "silverTrain", "task": false, "text": "CEASE COMMUNICATIONS AND REMOVE ALL CREDIT REPORTING OR BE SUED. FOR XXXX XXXX AND MYSELF."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3431365", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "72c54f5294a36d393cc23ac8c253e975c3137c1c2c09aa79b86e1f11e3cf5aa9", "cursor-grok-4.6-xhigh": "4d07ee22ac085d9e55a59214191d0564da09c83ae3285bb00865876541ad5ea0", "gpt-5.6-luna-medium": "c6fad98753918ad51c0f210cd70667fea5dbde9a7265b9dbab1e6ef066d37360"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3431365", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3431365", "split": "silverCalibration", "task": false, "text": "I sent a letter to evergreen professional asking to remove the collections account. I never received a response I have been making monthly payments ( direct withdrawal ) they take {$50.00} a month from me. It should be paid in full"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3558426", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c1afa033c51c8ad069f60e34b5b778cce26a4b939c21c62652137f742fa93969", "cursor-grok-4.6-xhigh": "9f06ea02db77ff0a6060bbfe13255966e22dfe7b13843b4938926c2bdb70ebaa", "gpt-5.6-luna-medium": "9a1d5011fd04816f4ebeab78366417113e43d7da1a23c50cddea9a32516c797b"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3558426", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3558426", "split": "silverTrain", "task": false, "text": "The billing address is incorrect on the billing statement I never stay at the address shown on the bill the account is not mines. I never received notice of any bill due for any service"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3577388", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "fe7c9154dc552c012d7f6616fe10130f17fee8a48496cba729c9447f5be93a68", "cursor-grok-4.6-xhigh": "ec3352cc5ec79f63c4be7b496628a6e5141b2c165ff65a934de80bd8f8d22d87", "gpt-5.6-luna-medium": "71a0dccf1813cff5167bf1453588173d6ef90f9741abdbde5fd6cf53dd9d1137"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3577388", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3577388", "split": "silverCalibration", "task": false, "text": "Hello, Both accounts are passed the 7 year mark to be removed from my credit history. Accounts XXXX and XXXX The last payments made on these accounts were in XX/XX/XXXX. Today 's date is XX/XX/XXXX it been a full 7 years. please remove these accounts fully from my credit reports. As i have written proof from date of last payment for both of these zombie debts.Thank you"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3747030", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "54a2c4545d8820afc5f92939bd158512baf0c52edf2ad1b00dc94d6c4ac40442", "cursor-grok-4.6-xhigh": "005c4c24b9c43c2f34d685d949343d747252091f1ef9a7838182db9cb48362a5", "gpt-5.6-luna-medium": "94f0e690c84ab99fe458f85458e88ed636976295f3d9585aada9d499a9871741"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3747030", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3747030", "split": "silverTrain", "task": false, "text": "I was shocked when reviewing my credit report and found late payments on the dates below : 30 days late as of XX/XX/2020 XXXX all 3 bureaus ) 60 days late as of XX/XX/2020 XXXX all 3 bureaus ) I am not sure how this happened. I believe I made my payment to you when I received my statement. My only thought is that my statement did not get to me"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3828096", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d1e067e6d44bdbd8ce738292f97539410cf0d2029effa850ac6b30af4fb66a83", "cursor-grok-4.6-xhigh": "d1e067e6d44bdbd8ce738292f97539410cf0d2029effa850ac6b30af4fb66a83", "gpt-5.6-luna-medium": "99b3f617bc53cb4cf3ae3750a5cd3709405bd4647e9c351948a2e1becc10cb02"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3828096", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3828096", "split": "silverTrain", "task": false, "text": "I have disputed this account and have reached out to the company/creditors MANY times but failed. This account is being reported inaccurately and incorrectly on my credit report."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3858080", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "80f4ea168734b908c1574e75c9e61486acae6f002a504c0bd571a7b9dd383be6", "cursor-grok-4.6-xhigh": "84c053e162fb570f54a265dbce507294cc6bb4bccc60564ae9fa3dae87dfeeb0", "gpt-5.6-luna-medium": "ce848d22b279e633011be47325295184558c4d024034ab73e09a66081129e9b5"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "question": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3858080", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3858080", "split": "silverTrain", "task": false, "text": "This is the second request..I had asked you to remove accounts that I do not recognize that includes addresses, and my name is incorrect. Additionally, there are a ton of inquiries in which I did not approve. Please delete them immediately. Thank you."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3919922", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0b7984b5fae18ac3a9f8e922e667296c1d6acd904a19c3adc59ca21df76f4c24", "cursor-grok-4.6-xhigh": "44d0ff80f18b20d245559b2355557bab0ab1b6faa2a3694db1cfdf1c60b2fcd3", "gpt-5.6-luna-medium": "69164f596e4a44592bf1b96b1538ea43662bd3a11d8d8093cfacbd0c819ed3bd"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3919922", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3919922", "split": "silverTrain", "task": false, "text": "Experian is in violation of the fair credit. My understanding is they have 4 days to block the fraudulent items on my credit report. They have failed to do so in that time frame."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-cfpb-4063938", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "bcc0d85af837508fd1da2eab5d3bcb09535a327582cf50c69b2835499b1276d7", "cursor-grok-4.6-xhigh": "bcc0d85af837508fd1da2eab5d3bcb09535a327582cf50c69b2835499b1276d7", "gpt-5.6-luna-medium": "0e09aa2e1621ca0f421b3e78870394a31f742729b537b40fa80e9612d2b6cbe7"}, "labelerVotes": {"complaint": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-4063938", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4063938", "split": "silverCalibration", "task": false, "text": "Bank of America continues to report that I have a delinquent account with an outstanding balance on a closed account. I never received a bill and it was sent to collections even though I made payments in XXXX and XXXX. I spoke with the company via phone during both years and it now still appears as a derogatory account on my account and no one has helped me. I have disputed the companies claims because they sent me to collections and refused to hear my plea during going through a divorce."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-4075299", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6d58d8847675a333fee7d980c40a9a52e1aadc1279f8b07e4969574e35a04b6b", "cursor-grok-4.6-xhigh": "6d58d8847675a333fee7d980c40a9a52e1aadc1279f8b07e4969574e35a04b6b", "gpt-5.6-luna-medium": "1ca8c2d79542f62786ae38c87d4bb19b40e1ea06bf45ffd678e0067adc37f1e5"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-4075299", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4075299", "split": "silverTrain", "task": false, "text": "This account is not accurate CONVERGENT OUTSOURCING # XXXX. My bill was PAID IN FULL XX/XX/2021 directly to XXXX XXXX. I do not have any contracts with CONVERGENT OUTSOURCING. This account has no business being on my credit file."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-cfpb-4140786", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f1f22d3522ea83573c115a6e4689077e482033573daff46d2692c29241cf3708", "cursor-grok-4.6-xhigh": "fa5a8f6673498d66613fb970762d1b15f61b1c07919858012c92d97949dfe75d", "gpt-5.6-luna-medium": "fa5a8f6673498d66613fb970762d1b15f61b1c07919858012c92d97949dfe75d"}, "labelerVotes": {"complaint": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-4140786", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4140786", "split": "silverCalibration", "task": false, "text": "I have filed a dispute in regards to the incorrect items on my credit report. It has been well over 30 days and I have not received any investigation results."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-cfpb-4232485", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0137b667f8f4eceb4edb4f068cdac6042c9ec7f23b8300440a9fa8711fee6759", "cursor-grok-4.6-xhigh": "87b8ae3373e445824916d10245315a6327f11805c2fcb97cc14108b97aebc958", "gpt-5.6-luna-medium": "87b8ae3373e445824916d10245315a6327f11805c2fcb97cc14108b97aebc958"}, "labelerVotes": {"complaint": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-4232485", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4232485", "split": "silverCalibration", "task": false, "text": "I have filed a dispute in regards to the incorrect items on my credit report .It has been well over 30 days and I havent reviewed any investigation results."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-4386529", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4a75cac49834b3d0b8951b67e55590d6f2312c71df1cb64e88d92488f9b7757f", "cursor-grok-4.6-xhigh": "0989038d071b4b462052a7567e8ed79c5bf6be54c88c2a3a2f95b7b78e7faf0a", "gpt-5.6-luna-medium": "04749dc3afd74eeb5c16328649c1a19f3b34829939b62a572358c4151d72c2fe"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-4386529", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4386529", "split": "silverTrain", "task": false, "text": "I have disputed the items circled in my attached report and they have failed to address these items in a timely manner. These items are unknown and need to be deleted from my credit file immediately."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-4613745", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "3803575f17446d1ce0ca26dde3c07b5f922e29240fef912804bd2894b0ec10f2", "cursor-grok-4.6-xhigh": "842cc6ad6ef0dc3fb21fae6d45a483329593f9e91a0ade7eda5f7513eb6c37e6", "gpt-5.6-luna-medium": "67938b39f246b1de472a117a7764c95757d4338a85d4203f9a390c2e1898ee61"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-4613745", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4613745", "split": "silverTrain", "task": false, "text": "I am filing this complaint because Credit Bureaus have ignored my request to provide me with the documents that their company has on file that was used to verify the accounts I disputed. Being that they have gone past the 30 day mark and can not verify these accounts under Section 611 ( 5 ) ( A ) of the FCRA - they are required to. Promptly delete all information which can not be verified. Please resolve this manner as soon as possible thank you"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-4758252", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1124f2a8898e63fd93fd6cce710ad2127412921c54b15e7e2d3eade7b802b050", "cursor-grok-4.6-xhigh": "de6ed86e2949d9226ac048fc6e3375a463d32597d1500f0c3d731c149cf3e341", "gpt-5.6-luna-medium": "be464a3430f4a28486c15647320c89c65617a1b6b3d6e2a640a70a830d3ac806"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-4758252", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4758252", "split": "silverTrain", "task": false, "text": "Received a letter on XX/XX/XXXX from American Coradius International LLC claiming I owe XXXX, XXXX {$9400.00}. This is not my account and XXXX shows a XXXX balance for my account."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-5094833", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f5b7a8484d4a553bcb05a51fa2cec15300ec79103553484747512c0598ab03f9", "cursor-grok-4.6-xhigh": "1846a8efd93a17e935abd0042587458fc9302b98afd442a5046f74fe33d6937e", "gpt-5.6-luna-medium": "990fb9ac5e57c92eb9c2d310f7f41d81ada0dff3fe7bba4ed2c4965a8d7b17ad"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5094833", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5094833", "split": "silverCalibration", "task": false, "text": "I'm not swayed that Bureaus efficiently pleased the principles of the Fair Credit Reporting Act in completing their investigation. The Bureaus are reporting inaccurate information on XXXX XXXX. Per FCRA, reporting must be 100 % accurate or the information must be deleted. If this type of information can not be equipped, make sure to erase the item in question immediately."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-5123759", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "80d1201490fd77217d78c55ea78390df3980d3871c33a055cdfc3eb033df3d4f", "cursor-grok-4.6-xhigh": "80d1201490fd77217d78c55ea78390df3980d3871c33a055cdfc3eb033df3d4f", "gpt-5.6-luna-medium": "6aa8f5e033268a28f38aa127738ae8f3dcb1ee6ed73ee3a559100531f6ab0741"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5123759", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5123759", "split": "silverTrain", "task": false, "text": "I have paid off the balance to my credit card back in XX/XX/2021 and the credit card company is not reporting correctly to the credit bureaus the balance should be XXXX they are reporting i have a balance of XXXX dollars also they reported the card closed when it shouldn't be closed this has caused me stress time from my job to keep calling and getting refused an apartment"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-5296904", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "581dd8bb7c842a0baf52e15a4700defe74c0bdb790e9e760971dca26ad85ddf3", "cursor-grok-4.6-xhigh": "af1dee871eeae280da3ecfc74b1554bcf250c1b68d58b5b800bef8eba9680892", "gpt-5.6-luna-medium": "ee1721d92a51f1d12d5e0bfc1cd68122b72b2deba348ea9f7c4af23f1664a29c"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5296904", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5296904", "split": "silverTrain", "task": false, "text": "I received a demand letter from Perdue Brandon Fielder Collins & Mott LLP dated XX/XX/XXXX. In XXXX I had an arrest with a restitution. Since that time I have been paying XXXX XXXX XXXX XXXX directly. The letter the \" law firm '' threatened my arrest and or license suspension. Neither of which, according to the courthouse and my used to be probation officer, can happen. Not only claiming I owe them, they are also claiming I owe {$420.00} more than I owe."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-cfpb-5342499", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d1b3826af9d2243e67ca9f6fe4e4935e7503c2f7d172624a8c1b024ed003dc9a", "cursor-grok-4.6-xhigh": "27fd2aca7f5ba67ae3877a0dc088af7657731d1b5567c918f5fe3295bdc136bb", "gpt-5.6-luna-medium": "27fd2aca7f5ba67ae3877a0dc088af7657731d1b5567c918f5fe3295bdc136bb"}, "labelerVotes": {"complaint": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5342499", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5342499", "split": "silverTrain", "task": false, "text": "I have filed a dispute in regards to incorrect items on my credit report. It has been well over 30 days and I haven't received any investigation results."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-5430594", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "aa1c21d6c3b8c741e3e4db69947d2cf292254197c278277f995c715e986c4010", "cursor-grok-4.6-xhigh": "b0d8f2695ab1b133d32719805bcb4b6192fcc44f1d5bd90b5bf951d57b66c3b7", "gpt-5.6-luna-medium": "9e932c2c493d0b1fd4d9d1fce773a88b806535ae2494a36407437e46f0bda3bb"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5430594", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5430594", "split": "silverTrain", "task": false, "text": "XXXX XXXX XXXX {$29.00} Date XX/XX/2018 acct endin XXXX In accordance with the Fair Credit Reporting act XXXX Account # XXXX, has violated my rights. 15 U.S.C 1681 section 602 A. States I have the right to privacy. 15 U.S.C 1681 Section 604 A Section 2 : It also states a consumer reporting agency can not furnish a account without my written instructions"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-5546899", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7f969051c7761a16ad0cd6ddff4a65c446c820d74488274325a76e1a1c2720d1", "cursor-grok-4.6-xhigh": "1f210dcb0222a906a5aa233ab36352e1f0af8dc86d3eee994e6091a24245d736", "gpt-5.6-luna-medium": "f51c1451ebd4e2c9f280c7b7e7f779129d8acde2498f004356be4b08404f7559"}, "labelerVotes": {"complaint": 3, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5546899", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5546899", "split": "silverTrain", "task": false, "text": "Someone opened a XXXX XXXX XXXX account in my name, with my documents, and for years I've submitted an identity theft report to ALL of the major credit bureaus AND the creditor. Each company fails to remove the account from my credit report and fails to acknowledge the identity theft, even though I've submitted a police report and a report from identitytheft.gov"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-5594585", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f595e9a9adeade6bf787fb7a132ad59b732d366d4b29e05891ad3db58b16ea2f", "cursor-grok-4.6-xhigh": "f36f31320148c03ac57a9f673377e0dbc5bec81143d7c46e7188edc9654ad542", "gpt-5.6-luna-medium": "03615dd7c2df6198cc3ab93d20cbe6a05797cce91914efc96b1e23b7461c0770"}, "labelerVotes": {"complaint": 3, "question": 2, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5594585", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5594585", "split": "silverTrain", "task": false, "text": "How did you get my personal information? Who and what gave you the rights to violate my rights to privacy as a federally protected consumer? And Are you aware of the laws youre in violation of by getting an federally protected consumer personal information without consent? Now Im giving you this one opportunity Firstsource Advantage LLC to explain yourself and answer every question mentioned above. Failure to comply will result in fines. Best regards! And the best of luck!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-5843160", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7fdb72e25adb0ac88932e1d69d978f946f305068561ce475eb0fb21b3ed6508d", "cursor-grok-4.6-xhigh": "889ee367c40521ddf9f2a578eea9fd1f20127fc310e616e1862c3aa121a355a1", "gpt-5.6-luna-medium": "0f4ca08a023a6e109cdf579b56e27cb44077eddb69cbd27ea0e4e55ea7a5cf21"}, "labelerVotes": {"complaint": 3, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5843160", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5843160", "split": "silverTrain", "task": false, "text": "I want to report Identity Theft that has been going on for years. I never knew much about credit or cared to use it until recently. Now that I'm looking to build my credit I've noticed several things on my report that I have never opened. I've sent dispute letters in the past and have been having a hard time getting everything removed."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-6061472", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "88d1e0044c184fd2d0c5b838e8039a925fbd46d3ce07d02ac2b9e8db155bb39c", "cursor-grok-4.6-xhigh": "9fb3cea47961506d03d48488110b36498555d7bceec007b87f7a390eb515cbff", "gpt-5.6-luna-medium": "06e44755d193ab99a9a302d01a3131d5c81c505a337cfe54406a7329cfcf13a9"}, "labelerVotes": {"complaint": 2, "question": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-6061472", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6061472", "split": "silverTrain", "task": false, "text": "To : Consumer Financial Protection Bureau, XXXX is continuously violating the Federal Law made by the Congress and keep violating my rights as consumer of this Federal Corporation. As the Credit Reporting Boss please I request you to stop them with their misinterpretation of my consumer report. Thank you"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-6122130", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a2650519f7c1fe3caf7aa1bdd7184084310747a79ece633c4ed3d4f79ae749ef", "cursor-grok-4.6-xhigh": "19a3cfd6bf4336e5f644b096f9e94f69c4efd6cbd5e2a6c6fd85a2718cf7d7e8", "gpt-5.6-luna-medium": "d77dd32fbdeb482607440bd331d160bb4458447afe808bd0ede970a870f0d935"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-6122130", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6122130", "split": "silverCalibration", "task": false, "text": "n accordance with the Fair Credit Reporting act XXXX Account # XXXX, has violated my rights. 15 U.S.C 1681 section 602 A. States I have the right to privacy. 15 U.S.C 1681 Section 604 A Section 2 : It also states a consumer reporting agency can not furnish a account without my written instructions"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-6461018", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c3eb99576b75fc64133863d7d24f3dfeadba64b1d7c1c78097ba48bf98c9baab", "cursor-grok-4.6-xhigh": "c3eb99576b75fc64133863d7d24f3dfeadba64b1d7c1c78097ba48bf98c9baab", "gpt-5.6-luna-medium": "8c32008e5483c34ca3d8fdaa0c9c55d30d1bf8ae5e7f31141ad0a381469dae3c"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-6461018", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6461018", "split": "silverTrain", "task": false, "text": "I was scammed by a sophisticated pseudo scam thru XXXX and I disputed 17 charges for which they only claim to do an investigation of which they didn't do and then turn around and agreed with XXXX that it was ok for me to be scam of over 90 thousand dollars."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-6684695", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "231e49f864a20c391457bc5291539be94247be7352ea98e98cebb1af84fe5179", "cursor-grok-4.6-xhigh": "e3756a3450bea3435c1c912b0cffb2b03f7366bde0c183c198e38ba297c01c14", "gpt-5.6-luna-medium": "0a735593c7df607f4e58c2c3d4ea1a014fa384381ccd7aa036484e688bdcf7b4"}, "labelerVotes": {"complaint": 3, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-6684695", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6684695", "split": "silverTrain", "task": false, "text": "Unable to open a new bank account with pnc bank, XXXX, XXXX XXXX XXXX due to accounts being opened fraudulently under my name in the past"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-6854260", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "464aef7707db8a7a43a7b7d85e68dd7a9d612aa7186572323fdf5957d02002fd", "cursor-grok-4.6-xhigh": "0a7b8b13bd46b1f23ef4bad5b1d5ee218770e57a21067b90bf42e9713f9202b3", "gpt-5.6-luna-medium": "cc02250df86bbd528060fe00d2f56154b6335493fcca9080f7cece05c3495941"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-6854260", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6854260", "split": "silverAcceptance", "task": false, "text": "The account in question is not mine, as I stated in my initial complaint. Despite the fact that it says this account has been validated, the information is still incorrect. This account has to be immediately deleted from my credit record, as requested."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-6977335", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "22f5d40b29c280ad1a80580959ac233d03be538f436fb2475dc070dae70821b0", "cursor-grok-4.6-xhigh": "9ef62b5a57d6e47b253ba60d29c46a09b62ae2f912265528e64a660a0d40813e", "gpt-5.6-luna-medium": "88a63ce7af7bfe7e1e1e69f5e1a5c3256fc5a40355d0c56e25cfa076407e63f3"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-6977335", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6977335", "split": "silverTrain", "task": false, "text": "I did not consent for these consumer reporting agencies to furnish any information disclosed in my FTC report to any person."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 1, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-7054229", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.6, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d9882ed0ba300ae9d6d40d62d40356ea76170f8cb153fdc7f6a983ef73d112c6", "cursor-grok-4.6-xhigh": "f47f8e963b233f211e4fb93c77a277fc66529788638fa9e66ad3cf268cbf4b1c", "gpt-5.6-luna-medium": "7f399f04483bad913c8f51f6fc9ed6623fcb7ca2bbce352bb61622b80ff56195"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-7054229", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7054229", "split": "silverTrain", "task": false, "text": "Multiple inquiries when applying for vehicle multiple inquiries on XXXX credit card and multiple inquiries by mortgage companies"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-7352245", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "3bbd2db35983df825c0d61d53834b8e853e13dd042c84fc721fefb1c9ccf0901", "cursor-grok-4.6-xhigh": "0685199894bb98c14afdeee911055d89d1f9dde1e22cfb18c1ae6533a912a614", "gpt-5.6-luna-medium": "419dbb7715ad7ebffc30c0a6c5cf63ecef305893260efbbfb996f0da9dfa7fff"}, "labelerVotes": {"complaint": 3, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-7352245", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7352245", "split": "silverTrain", "task": false, "text": "I submitted a credit repair request to a company, but they failed to respond within the 30-day timeframe required by law. This failure to respond has negatively impacted my credit and caused difficulties for me. I am now considering submitting a complaint to the Consumer Financial Protection Bureau ( CFPB ), in order to address the situation and protect my rights as a consumer."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-7415516", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "18ed7516f7f5e91918a612f1d3f2541e490259fb8d618abb2e6196da35058af3", "cursor-grok-4.6-xhigh": "0546aa66ba6ab8b6beafad8766b71e965c4510ceede6bcceaff5921604f09c75", "gpt-5.6-luna-medium": "b51ab9a43250b67af1e7759c00a2e0e8d471a12a5c6e6bd9fe3dce4795c517c6"}, "labelerVotes": {"complaint": 3, "question": 1, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-7415516", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7415516", "split": "silverTrain", "task": false, "text": "I am a victim of identity theft. I am writing to request that you block the following fraudulent information from my credit report. I have no idea how the theft took place. I also have no knowledge of any suspects. I did not receive any money, goods, or services as a result of identity theft. Please let me know if you need any other information from me to block this information from my credit report. Thank XXXX XXXX XXXX XXXX XXXX"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-10654", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "36f79a91344d3dc439eb138fbcbc3fa7c34bef1c5df3bc000cad3e5b91b921b8", "cursor-grok-4.6-xhigh": "02e1042d36fd90ddf60727883315aff8c94fd2af21bf9909cd8f36c68ed4a43d", "gpt-5.6-luna-medium": "36f79a91344d3dc439eb138fbcbc3fa7c34bef1c5df3bc000cad3e5b91b921b8"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-10654", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": true, "text": "please find me a hotel room for 4 people from monday to wednesday in lakewood"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-10760", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d048a39cebcd2aad510978f9d8bd56c8e087280778f13cc2d44de75c5da83b98", "cursor-grok-4.6-xhigh": "7f7a364cbdd5fa8d8607c9bfcc7d328a0f7df4274fb14002928220addc14af92", "gpt-5.6-luna-medium": "b5411289d25fefa0035bae2defc1cf4a62cccb57ac1f8fe24ca7313209dbbaa9"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-10760", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": false, "text": "i am in need of my location"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-11032", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ea2b5f11d6f9d6957c0d9ba9ddcbf65d454f89de59650fed637ff37815dfc0f9", "cursor-grok-4.6-xhigh": "1b180c9743ce862107597f0513cfcd38821628f583caaf479d7769d257a611a6", "gpt-5.6-luna-medium": "3082c60cece145a1f3d7a693e2d64b4b59abff1b0dfad330ad45b9662d0f6563"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-11032", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "tell me my electric bill minimum payment"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-clinc150-11158", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "455b55470d1abb95730af92f2b2804076b46b1f6ea37a848cf9229fe2f73b022", "cursor-grok-4.6-xhigh": "fb1b044b9e4da18e8ed3d0388717008fcddef1bbbceed7d1478f345efc1ad6a7", "gpt-5.6-luna-medium": "455b55470d1abb95730af92f2b2804076b46b1f6ea37a848cf9229fe2f73b022"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-11158", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": true, "text": "i want you to use whisper voice now"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-11549", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "cf6705c44d47c7cb7a048bd779f32a7b691f5d25045f136c0d536a477372c22a", "cursor-grok-4.6-xhigh": "ddbdca3410163da413411b24e64ddf80f5922de39acbcdd522aed3da7f763624", "gpt-5.6-luna-medium": "1dd1d4d936abac093c079b7b563bee1397086721f99e906bf4f4ab253915f9c8"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-11549", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": false, "text": "check days of pto"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-11599", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c3505b53f66bf64aedc9f3b97a1008bf990b96377e178dfc61b72fd757917b8b", "cursor-grok-4.6-xhigh": "438717f9153d106c647ad274fd074480b501b9938a5b19e7378ea86107543d79", "gpt-5.6-luna-medium": "d1075c8fd3a7739634e4b3cff1dcb7169216a198972b4efe251119cdacb8ca07"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-11599", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "let me know my vacation time"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-12331", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "602fd91dda771368abc490a738de5b6d63c9beef683a04f6831d5539ebe41c51", "cursor-grok-4.6-xhigh": "e97c3ee9b424b194f34b5f8ed310cd0cc1d89e39c38188f9927d2cc31c93cd08", "gpt-5.6-luna-medium": "58e21c7cf3f27233386a9b0016ff09345e9717706c29abdbd1f82f6ae73825ce"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-12331", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": true, "text": "can you increase my credit limit"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-12431", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "024db1a9c925155f12c52472d30662bc8e85f3449f95f9cdbb10ae029d043964", "cursor-grok-4.6-xhigh": "63ed58b1c0965671d080e81c17d11380e26dba8b791b91e090e8b2985656263a", "gpt-5.6-luna-medium": "7e1efe1bd2915cda13540d8a8ce082d778f808aeb0c4418abc70a9d881ebd34c"}, "labelerVotes": {"question": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-12431", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "what sorts of things do you do to have a good time"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-12583", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "74253bd1504f3d2f9fd0d30234eb038b758ea363eefb7adddb4cc83f86d713df", "cursor-grok-4.6-xhigh": "ee83296afcc4113d688860eeed17ce8e2da9ae5546e252222b04270512cf4ae1", "gpt-5.6-luna-medium": "05356a96c06c66f87e04f7641c44ab6015e59e5439005f286cb32683a2616c58"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-12583", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": true, "text": "show me roundtrip flights from dallas to houston for march 7 and march 10"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-12742", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.75, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "09d8dee726377e877988d0735cbca7bd1355a09b77f295ecd666d2ebae1d244d", "cursor-grok-4.6-xhigh": "bb71dcd10a55648d59bc46e157b4ca8ab8bba2923870edd69057779b0af606d3", "gpt-5.6-luna-medium": "9806fd06281fc0bee335bb3aa48a460fa672384efc4d50c2b5c9ab32f288a098"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-12742", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": true, "text": "send a text message for me"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-12891", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a669763921607fe4ea0e2aee191acf5381e8b1255f11036ccf524c5492d8a7c3", "cursor-grok-4.6-xhigh": "eb5050ec0336e691674b340e59d71b94638369ea887102bc2eb551cc45014538", "gpt-5.6-luna-medium": "0e4e02946e43130ef7d8e215acb9e4eb194607ff15ac5fe0389670f8526075a5"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-12891", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "how much do i have on credit card bill"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-clinc150-13091", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0acd6a00003a8c8651739f2a9d6c7bdd17d01ec65f1727128a24e51a01ef42a5", "cursor-grok-4.6-xhigh": "9e290606b9911c36354b5534ff22f6cf9000d8c02dcbbb43ed6d51f7f11a2d5d", "gpt-5.6-luna-medium": "0acd6a00003a8c8651739f2a9d6c7bdd17d01ec65f1727128a24e51a01ef42a5"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-13091", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": true, "text": "transfer my cash reward balance to my bank"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-14078", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "626bf18265903a70f1f0f616010384e29d85a1c53e9b73fba0a61a25bad7c3cb", "cursor-grok-4.6-xhigh": "65cec108297aa26a8e3f72a79d798a232ff58052c74588eaa73ab87c310cea73", "gpt-5.6-luna-medium": "61b2c5895120fb94469bf9e7b0290662cd1e372baedbd955cc6caf7d3ced531b"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-14078", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "on what day and date of what year were you born"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-14311", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "288ed23f081d2277d402ba29d770dd6e2589e2f528f40c60f75a5ff955c6e09a", "cursor-grok-4.6-xhigh": "04808ba68f63a87ce488dde9b2e1ddb421829aa7067b66ee4bda90f4f7e84595", "gpt-5.6-luna-medium": "6de72fbeca563ecb4eb7151e496711d0001a2f00fe86ab5b513ce45ba8ebd217"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-14311", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "can you give me a thai meal suggestion"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-14562", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "613c6a7f1474b0e3724732a81ed52d1baf5b79ee6cbdf377e58318fd6d8b27e7", "cursor-grok-4.6-xhigh": "cd4e96a6e0b038b7bf617c3c64329aa2f9c53fc2db4ea48f7220950f0e05e587", "gpt-5.6-luna-medium": "58841a3a8c287ed145e523e44620cb169cfe0cbb5d0bd1e236a75559e197ad10"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-14562", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "what is my current gross salary"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-16", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b0201fea4f9f646ff7f372dd1b0b1fa688af21f428c5d4dd19eb4c050bdfceea", "cursor-grok-4.6-xhigh": "2cbcbd4dc1be6a4350f8a4e4c3676c788f83d5bf3dadc29246f58e10f053946e", "gpt-5.6-luna-medium": "7d7cee41a7878538ff60f69c866c6aa1b7112323feb02ca045799e36bab0e502"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-16", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "if i were english how would i say subway"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-1680", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "3f7e83ac9649499276bba4f3892309f24635a72e3afac5a47976c4a8476fd3c0", "cursor-grok-4.6-xhigh": "4d2ed87e5081e2a0bebc40c1db69aac5bffb5475c4abf36a93adcdd3004c353d", "gpt-5.6-luna-medium": "647cca734c35a30a9603bc1e57b6cd26e1676e447e5e4e227a8396ae57e86b7c"}, "labelerVotes": {"followUpReminder": 2, "question": 2, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-1680", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverCalibration", "task": false, "text": "please inform me when my flight scheduled to board"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-1839", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d2f701825e64b47279946e6380427d5158edc16892405d2a57d1142c174de2c6", "cursor-grok-4.6-xhigh": "6817320466fca407f2926a77dcac49b99d4f7141beb42487eb62dd4f22fefb30", "gpt-5.6-luna-medium": "adecb1b44e8a2b2f166b922f2cdb080cad812a70b06755b041e63f35b66b642c"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-1839", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": true, "text": "can you just start calling me sir"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-clinc150-1890", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "aa117edfc950264e7acf510cd40d891926f06280208c771245ede1a78da45dbe", "cursor-grok-4.6-xhigh": "2ef314d41cce6e27842456324d595e736cd54f8e3b2927262746af8c2f3c06b1", "gpt-5.6-luna-medium": "8700bf3684481d28556a73b7fb88733cd133b99c4a8b0b9ae55f7d6ee9ac109c"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-1890", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": true, "text": "i want you to call me lord"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-2341", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "85d143535f9713a2cc2821d0da752c658d7b88fd2186303f3f50046a5ddb0ce7", "cursor-grok-4.6-xhigh": "9f7c4437a425327f09dac8c5876d6a5bd884c8d61691a896b051801e05a5b51f", "gpt-5.6-luna-medium": "a233fd78f72d0f006daccf85910739f1423caf62d6486f3da576e4ec93218e0e"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-2341", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": false, "text": "i want manual on how to change oil"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-3", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7be0992056eb397236ac235178b6b511e92fda824d5ebba2a788566ece87d8d2", "cursor-grok-4.6-xhigh": "71dc447c4022e63a8a128d067ea68616113673c8126dc2e4c8d2012052ccf5f2", "gpt-5.6-luna-medium": "1e2f19fe83cb947e635fd23b8b8d697e116ca97dba3f2dee7e1fd93864f268cf"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-3", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": true, "text": "tell me how to say, 'it is a beautiful morning' in italian"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-3087", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "bb8dd568400efa08a962c2a9a649c4b24a7a771471951af6362ec3eb08aca6c1", "cursor-grok-4.6-xhigh": "a5494c0fb9339969ea37fc70f7fef29fefbe0ad0e86f7fa871daced90b172bee", "gpt-5.6-luna-medium": "30aec17b09850259bde3bff7d059f53d8e68aabdd4b4f409ceb829ca20347e8e"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-3087", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "how long will it take to get to long beach terminal from long beach airport"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-3124", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e3fa78491dedcc550d55664f69f7ad4c23cff7ab63b6e92948d41c2b25847345", "cursor-grok-4.6-xhigh": "093d0478eaa692593cd2f4f49a0f6bc8f18f304708eb4ab35ba4958332799f26", "gpt-5.6-luna-medium": "2495a0565a75f4fd279cab810beb833cc9abcf8d32796fb9cc222f749e864eeb"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-3124", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": false, "text": "what will you call me"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-3198", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "fd1d8f94a073453657e2c3aab6bee6294252b63d2e711944b509b35691300dc7", "cursor-grok-4.6-xhigh": "9b65748ce42038bcab4c6e4ea6f70f9f2de810cc5f532998486c4411bdee8769", "gpt-5.6-luna-medium": "7318bd624c12219570e8ca9c5860646f97ec9d66aa39714180262eaee408ea76"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-3198", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverCalibration", "task": false, "text": "so what name do you have for me"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-4465", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "616e5bfa2946b6a280509fe6c8afedec7d1f4d49a91a74ac6b12ef17b94f6dad", "cursor-grok-4.6-xhigh": "aa37de7eadedd37f54c956aef45a13ebf661eb07e4c83a07c68f93aaa6394ebc", "gpt-5.6-luna-medium": "2d007c08a78375ca70991b08d8350aee9f7d148f9ce7cda2e93a39499b50dc72"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-4465", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "how good is the fuel usage for this vehicle"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-4518", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "340824d630a80b6c02c2ba4bf8125ad7f7cb14139eacf43f2095682ec709ae1f", "cursor-grok-4.6-xhigh": "62839e17ea8acf9a3e6f94f1b7176e0943da4e0d90c46d8bb9aa2365a6e46d1f", "gpt-5.6-luna-medium": "d4db6061232f1a171999243c912fdca11de44905d213f707b68cbcd9d79ff0c9"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-4518", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "when do i need to change the oil again"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-4707", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1880870ea663ebf3ef6ed164ff5b8b3aefeffcd220ead099d380a1d563f6b30b", "cursor-grok-4.6-xhigh": "a2ee63488ff2f827fcb95639cf472dbfa305969dda5e880e08836057bf17bbe0", "gpt-5.6-luna-medium": "a61928fa8941cbd2a9039cc2fa20c93519ca7940c787753aeaa6fecaf6afbfb5"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-4707", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "what sites are there to see when in evans"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-4832", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7eba90cfac3e526e3d3f77cb7a41fbf1db2717ecd7a986b2e75971ad3e83d79f", "cursor-grok-4.6-xhigh": "3f04c6cbb30e5a3480e301a46304ea05abf951c3e91a6386afaea4a8053ebebf", "gpt-5.6-luna-medium": "903fc79898fc2e998e3bf94b4ecb2b2cc12a105237d48b244ccc2bd0d8bde8c6"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-4832", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverCalibration", "task": false, "text": "is it possible for you to let me know what health plan i'm on"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-4834", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0fef6231cf10cb683cedca9c2c9cbe8675bbf30a6b4b4975d958b3ee34eac7b9", "cursor-grok-4.6-xhigh": "13acd6f1154ce06be993153ed5cbc3fbc62bf6573a0aef78ae077f8cd286e02b", "gpt-5.6-luna-medium": "5dc337c268885b1878b19bd294d827d525ba6cd7f520ced1fc35308521f91b74"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-4834", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "list my insurance benefits"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "followUpReminder", "family": "consensus_public", "followUpReminder": true, "fullAgreement": false, "id": "open-clinc150-5082", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "dd0c6d7a71000d68c04cde4517015c26cc97cc50c6cc11aa7f6a79cd83f350f1", "cursor-grok-4.6-xhigh": "1169534b26015a573a6682347e94a0f6851664d0231edff7b7fd16af8d36c4e1", "gpt-5.6-luna-medium": "59355919322a445597d61da14818efa93f71797b324d7b20b44c4f8d09ec68b1"}, "labelerVotes": {"followUpReminder": 2, "question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["followUpReminder"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-5082", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "did i set up a reminder to clean the bathroom"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-5463", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "663423f9f3df3b23d9737228f5706484ff227d08b38c11c40e0857f4cfdd91db", "cursor-grok-4.6-xhigh": "56508a0556c0d665165a28afc1b46969148893577c349b6c54653079d136dc4d", "gpt-5.6-luna-medium": "c4cc2c23c84474c1f2727032b8713e1b5646ab2bc7495751259cbbf6f66f647c"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-5463", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "what's my apr on the credit card i used for a purchase a week ago"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-5959", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "4c435bed42d19f540e3779f505e568ba9533209b627d37c70e67847d1ef9d621", "cursor-grok-4.6-xhigh": "17ac9ab8d61232ff852a03d59386f18b3287b8791d56958a4dfd69d5bdad8e68", "gpt-5.6-luna-medium": "c90bf1ad8fe1b86980297081841e366f60d684f29c377c6aad1d57a066f9ad84"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-5959", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "what is today"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-6065", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7eb4c90f52241bc8ade4fa93163c6ebec0237be92f3cee2e93fcf8c9049a4af5", "cursor-grok-4.6-xhigh": "b1489a7a26c8e111ad8d4b1d07f834092e4cd269977b0632aa0d21b349e8f57b", "gpt-5.6-luna-medium": "e1f945ca157de8e90862ea17629c15bf564d22b49c703db581c6dbe188be48fb"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-6065", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": true, "text": "can you look up the carry-on restrictions for delta"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-6137", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "80b073d5e697054d708c3d2292f4afed887682790e87905755d85f67a177ae0a", "cursor-grok-4.6-xhigh": "ad0c094bd32e20f9a030a063ddcd572d477e7f680a81a313c58845832f10fa0b", "gpt-5.6-luna-medium": "97ef995667b89cbe935c6e1f64ee686ee9aa8a5d96533a5d4ad5341062953478"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-6137", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverCalibration", "task": false, "text": "how many of my vacation days have i depleted"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "followUpReminder", "family": "consensus_public", "followUpReminder": true, "fullAgreement": false, "id": "open-clinc150-7302", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ce391ab1517782b5e263f8424f70e384ab2434f861c1860a1a6f8ef11297603e", "cursor-grok-4.6-xhigh": "2f7f4e1530534648fe716997a3d04f12505c6bf4efc03a1892de7e8a4d0058b5", "gpt-5.6-luna-medium": "d1b6d5cd5876e88ada142ef810eca5aa43b3d0712e647d9452c6734bd9415d3c"}, "labelerVotes": {"followUpReminder": 3, "question": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-7302", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": true, "text": "make sure my alarm is set for three thirty in the morning"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-7969", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6e243941717b8fe849a80873f05b5c55688bbb8535d7c376501a4c336c9898c5", "cursor-grok-4.6-xhigh": "1ca2d7ffefe2f7a31b08aa429c9eb7a268e631da019620762a9d067e63c5e245", "gpt-5.6-luna-medium": "de926aef70950529fdf374d9ec301eecbdb66c43a84b926327a688373b9dace0"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-7969", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "how to report bent credit card"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-8619", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "687549af3f609ec1aadf1e37295ef06044428f8dc1c72d13e0ffe427514a1de4", "cursor-grok-4.6-xhigh": "e2c057f91882a9da33dcffbe92ffb562bdb82910eac07a637b76908a9348b5b3", "gpt-5.6-luna-medium": "ae3f50e00cf7b77e0451fa71e68ec5ba7c288919cd9fea3ba05d63a27522f4ed"}, "labelerVotes": {"followUpReminder": 1, "question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-8619", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "let me know when should i get my tires changed next"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-10586-8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e995dcf1fcb4df8bba8643c634a1ab5aa075cef76a2ab523385790695cafbb20", "cursor-grok-4.6-xhigh": "f37a60db8373c50bf4065a1fac7ed754020fb10ea3e2e1bb8cbfdbdbfb0e8236", "gpt-5.6-luna-medium": "c5ceedd48866435729489a8134f3df7baf9f5e9d4194f5d7422d5bac58654271"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-10586-8", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你能帮我在格林豪泰酒店北京市首都机场第二店附近找一家评分4.5分以上,游玩的时长是0.3小时 - 0.5小时的景点吗?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-10728-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a87f1d6fe54caa4e463b6596dd247aea2134f547239fff6ee184feb4f2b25a2f", "cursor-grok-4.6-xhigh": "989a91ceb7d5729e221ad0214ae36d59a2bf169d5920c9dbc366cf40fab7c405", "gpt-5.6-luna-medium": "321d99d22f97e8fc986966f3357f671fef7dcaa56677a99578c9882849ad765f"}, "labelerVotes": {"invitation": 1, "question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-10728-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "您好,我和同学想一起出去玩,帮我推荐一个票价是50-100元的、游玩的时长是0.5小时 - 1小时的景点,谢了。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-10871-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "480edd1c00efba40a29682152d3db3a1ee84332bb4507bbf89246d36e83999b0", "cursor-grok-4.6-xhigh": "a9cc7bb1435b8263f34ca953d574397ede138ed92e3c6fa5b1a31c47c93303ae", "gpt-5.6-luna-medium": "4d6253f99937158918505762c7d8c01b1f4bcfbc5a1b2a1cb93a6a26ce814eaa"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-10871-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我想找一家人均消费50-100元吃全家福这道菜,请给我推荐一家餐馆用餐吧。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11012-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "609237ad67c214ad61dc63667dcd3f04475df24a813961fb76053e4ba01ff604", "cursor-grok-4.6-xhigh": "5c2038be0061abfcf1054a462ef779deca265e3fabb578499244d1dd27ce0945", "gpt-5.6-luna-medium": "5c2038be0061abfcf1054a462ef779deca265e3fabb578499244d1dd27ce0945"}, "labelerVotes": {"question": 3, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11012-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我想去景点钟表馆(奉先殿),帮我查询下这个景点的评分,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11109-6", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c9e84bb494d6e0d271de034dea95fe3544bb2ebe39bfccf3fa3fbb2a16fa32a7", "cursor-grok-4.6-xhigh": "b8431405f72e7f1260da54f0bb5c072912a1c5b42b5965b1cd2d8635552c2cbe", "gpt-5.6-luna-medium": "da7856228f93149d0208ffd31b380ce82b9f0a0816c0cb16ee23ede7a8666ed6"}, "labelerVotes": {"confirmationDecision": 2, "followUpReminder": 1, "question": 3, "replyableMessage": 2, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11109-6", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "对啊,谢谢你的提醒,有这个景点的电话吗?不行我还可以给它打电话咨询。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11117-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1ab48f4c679cbdc99c3a907e1dd794470c290ca6119465ffe76f9ab05736f8e3", "cursor-grok-4.6-xhigh": "9fbf94dd9a206f1b898fb738e460a24d2ccaa478b8e0d14752fe473d0ab716ec", "gpt-5.6-luna-medium": "2a763897448a8f9a0eb78a969019afe37dbcb90890224a92b3f1f563d3a71262"}, "labelerVotes": {"confirmationDecision": 2, "question": 3, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11117-12", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "好的,多谢了。另外我还想找个能玩1小时的景点,你帮我看看哪里合适呢?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11374-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "bbbeb79781b99134282ff876d600ab06230aa6ceb2e5cbcc9708ef0025d4fda7", "cursor-grok-4.6-xhigh": "d6d0cccb21516f5cafaa71e95baf41dfdc5bb7565c0d82a2d0a5a68cab9fc2c0", "gpt-5.6-luna-medium": "e9c270633cb75f4f6fb311148aa7edb4abfbcacabf0c7a8fa84c49588c0e8d1d"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11374-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,请帮我推荐一个评分是4.5分以上,人均消费在50-100元的餐馆,谢谢!"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11462-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "626f0851c8eaabfec1dcdbbc6eb2ac9dd17a245ae22056dc9a7639b3ac17a497", "cursor-grok-4.6-xhigh": "f5809c96ceabe6c0a21c4f4f396dfeeee5224e3603d1d5606c3717b07f4acbdb", "gpt-5.6-luna-medium": "3ab66e5d04255e70c8661718d64b3b17098f95a3b9608a4d7d95ff8e12a33f36"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11462-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "你好,帮我推荐一个票价在20元以内的景点吧,最好评分在4分以上的,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11677-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "3b9a0dbf2a599934e17a1a6bed2036374a687af67dd68b4bfd2897ac4989f981", "cursor-grok-4.6-xhigh": "a5262760e8e4bcceb03ae927d7d8e805ae6f36f263a8ec41747e5ab641c7c2c1", "gpt-5.6-luna-medium": "83ed80c0a9a9c722b394acd8143c7d8d071d83cfbc4dc5813d0ba42d6f0c4841"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11677-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我想去一个评分4.5分以上的,可以游玩时间0.5小时 - 1小时的景点游玩,给我推荐一个吧。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11686-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1045a2019d78ac00c7f9c500ddcd325a777ae5efe2f7d2192e2df5ee1da0cfda", "cursor-grok-4.6-xhigh": "2766aa39b656b23832474f20cdafd5b84a8fa7a0dbc7dce9e8b9f25fdf9ad9e5", "gpt-5.6-luna-medium": "b25fff2784d6e403f0eada549b96d24dc988c047e9350226dacf771b3e06808e"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11686-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,请给我推荐一家评分4.5分以上的餐馆吃南瓜粥这道菜。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11766-8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6ef2f4d587dea2404d843c01c07f18d179fee5525205321f36dfe58d86b1d82c", "cursor-grok-4.6-xhigh": "6b9ccc26414d5e25057a02c7045a95909ef416760ba8658b5da26b80a7d72577", "gpt-5.6-luna-medium": "e79a6cd1e26b0c87291f3b397d4e4df2dd10ae9c133b0ccff70ac8a57ff335b9"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11766-8", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "无所谓,有时候评分也不准的,能帮我查一下这个景点的游玩时间吗?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11884-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.7, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e30bbd236ab269dcb8db03c2cdfd79e2320de7506c1da02f0d910517f1f1fa5f", "cursor-grok-4.6-xhigh": "6a56c61d8e0168b2119d6b50663326ddaa25d6ce7c9266cb303a34f97f92ca23", "gpt-5.6-luna-medium": "787128a500112e665847675b15e4a0dc8588a7492b72a8fec5c197bd259957ba"}, "labelerVotes": {"confirmationDecision": 2, "question": 1, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11884-12", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "好的,游玩结束后帮我找个最低价格是1000元以上的景点,我你希望酒店提供24小时热水和西式餐厅,平时工作很辛苦,我也享受一下。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11953-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "42737110d1e80869158284c8ce543b5455bb9f83f21f8385ebca116088be9352", "cursor-grok-4.6-xhigh": "731b429f2b76d752e1287a924274dc6925b224bded1219201022f9ac9b03010b", "gpt-5.6-luna-medium": "8bf5badce978e700732e89c8f192c53dfc74edd1ec387b43f4ba031197f9dd48"}, "labelerVotes": {"confirmationDecision": 1, "question": 2, "replyableMessage": 2, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11953-12", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "行,我明白了,最后给我们找个餐馆好好吃一顿吧,人均消费100-150元的就可以,实惠一点的,哈哈!"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11959-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "83aae6860a0154b59f3e58ed38c4a45fc1d1f4e9bac1f08d81591bec5a4e8fb7", "cursor-grok-4.6-xhigh": "4c7410deeac77219e938d0a7fb2e31d92c29ec35780e1ec6e4958529de6905ae", "gpt-5.6-luna-medium": "5e8081501770068566e33db15973aa75d10ed7f71c61d5fa698bf36cfcaf690f"}, "labelerVotes": {"confirmationDecision": 1, "question": 3, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11959-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我想入住一个经济型的酒店,还希望评分在4.5分以上,且酒店的最低价格是300-400元。你能给我推荐一个好的吗?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-12429-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "35e22890da684efdc2b4098d6c4e7b1c482d76acddcdf3e7f6e99922928e9cfa", "cursor-grok-4.6-xhigh": "c23f2aee1faeff2495c1abacb2fa84d38ccede7e45eac71220d3be92ecbd6350", "gpt-5.6-luna-medium": "07ed0ad47f4cb047105cfd0647dfaf24bb5d91f3a2de0d9ebdba47c9430760e4"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-12429-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我想带女朋友找一家评分5分人均消费100-150元餐馆吃小笼牛肉,请给我推荐一家餐馆用餐吧。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-158-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b8f0149150446e701afc99120bb921cb462369dbb5ef086fb1cec62db0dd3d21", "cursor-grok-4.6-xhigh": "9df439e4e9fafc1e8db61708f4b10d0b7eceb988a85a48ddaf730ed92da9cb48", "gpt-5.6-luna-medium": "9df439e4e9fafc1e8db61708f4b10d0b7eceb988a85a48ddaf730ed92da9cb48"}, "labelerVotes": {"question": 3, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-158-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "你好,帮我查一下99优选酒店(北京长阳环岛店)(原摩恩快捷酒店)周边有什么餐馆?还有酒店是否提供吹风机,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-1615-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9f09c0dcd3f89f74dc223ea398227d78a7dfe3017e4110bd3a138ffbe1a2a040", "cursor-grok-4.6-xhigh": "f1529ca9a0c1b437fb844d47a908521601b44f3ad9ae36d714296c0c86c379f4", "gpt-5.6-luna-medium": "d18e6f382d7ddc951f53bf0590b45f0374550720510e2a0e7f17c99c82c85b79"}, "labelerVotes": {"question": 1, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-1615-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "您好,请帮我找一家舒适型酒店,评分在4分以上,设施中有商务中心,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-1626-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7e4f370876396e02d1239da298e95ae1d444cd8e06d64a2c467878dd17726932", "cursor-grok-4.6-xhigh": "580f263037ac9fff163a16f38569b12ac083e4efceea03a76c1f11b8afcd7186", "gpt-5.6-luna-medium": "cf78a5fe81bddda1acd4e848c3170bd6bbd260d434e0ba90ad861dc59a301c15"}, "labelerVotes": {"invitation": 1, "question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-1626-12", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "真是麻烦您了。再帮我找一家评分是4.5分以上的酒店 吧。并且把酒店的电话和类型一起告诉我吧,谢谢!"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-1766-14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "450b38cdb53f94e91b0472c54330df801f9ef131b121b465e96ab43d81a6529c", "cursor-grok-4.6-xhigh": "0070ad9994feef9216414e7fafc103d724be5cf3d53bfd460ae0acaab136e50b", "gpt-5.6-luna-medium": "b03c543b934253795ebad98a907dd054524a08cb8bbbc7bbfcf09dd1eac007a7"}, "labelerVotes": {"confirmationDecision": 1, "question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-1766-14", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverCalibration", "task": true, "text": "好的,再帮我推荐一个最低价格200-300元,评分在4.5分以上的酒店,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-338-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "20962411203eb41a959529781b949c81e88ba27de5eb0abb91610b5aae9d83f6", "cursor-grok-4.6-xhigh": "688d6a32484c9b79d79f77611478c306c1600ae3092a28f1cecd78956acb7060", "gpt-5.6-luna-medium": "688d6a32484c9b79d79f77611478c306c1600ae3092a28f1cecd78956acb7060"}, "labelerVotes": {"question": 1, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-338-10", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverCalibration", "task": true, "text": "那麻烦您帮我发一下它的地址,谢谢了。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-3595-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "bb83ab1a078baed411d7560b906c7e1ae3d0f164edf91f5fa4d3e68f1fe384a4", "cursor-grok-4.6-xhigh": "104d09cdb903cb2aaca573ccfd9b05b5615775154c9c06dc0d06dace82140c24", "gpt-5.6-luna-medium": "735e3c5d244a0d105db3e2f4772efee49d983f6de8430f889f29dd2b8c6a221f"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-3595-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我要去中央民族大学民族博物馆这个景点游玩,请告诉我景点周边都有哪些酒店啊?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-4220-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "90880da918fcedb8c875a089a9a67dd506f437ffecf3ddc7c8cb831f2438f4b1", "cursor-grok-4.6-xhigh": "9e831bae61abab475eb136366dce5b03a46ee57022bcb45e4133e79654ec57c7", "gpt-5.6-luna-medium": "8f7cd1542f84a3736e03b3d5210fa3234db671f27f410f458abfdd9f3d032812"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-4220-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,请帮我推荐一个最低价格300-400元的酒店,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-5259-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b34e4b612e496d22c851fa5536c52b833798fd1fe8de978bca96ce06834265fb", "cursor-grok-4.6-xhigh": "4c4bb2d67fa39290b561a8951d4110f255bc0c12ed81c0793c5a6ee4d9c6bcf8", "gpt-5.6-luna-medium": "f171539403129e51f70a35054227ad485de1a0388c2c421042342990f422df0f"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-5259-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,麻烦帮我推荐一下评分在4.5分以上的酒店,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-5821-18", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f65a1069c6ca6234a7386704cd0140723dba17f322493dab62a2c87d9d843573", "cursor-grok-4.6-xhigh": "9885b90fa4ade789e6174a165c58922fe1b187f335ad008cded8519145bcc8e8", "gpt-5.6-luna-medium": "912815d96d9fe64349d2528a6a1c429d39c1a0179f83688d837dd0b3f8fb2703"}, "labelerVotes": {"confirmationDecision": 1, "question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-5821-18", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "哦,那好吧,那你你帮我在古崖居风景区附近找一个评分4.5分以上,人均消费150-500元的餐馆行吗?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-6343-2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2624b9ac0ed659759cdc65ac9d9cf44cc4a858be6ff1a6ab846279375f9d334d", "cursor-grok-4.6-xhigh": "929e6d91c9f6181d4ad7af082aee28d742b432379069052b1d1d48d3c39fa743", "gpt-5.6-luna-medium": "5eb2a2f17922aeecd69442a146438e586d71363d958c68712fea6ac22ef7a94c"}, "labelerVotes": {"question": 1, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-6343-2", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverCalibration", "task": true, "text": "不好意思,再帮我找一个价格在400到500元的,有暖气的酒店,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-7477-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1cac9df3360754af1108beac34dfa8f74840c4ab28573ff486ba268de814bac9", "cursor-grok-4.6-xhigh": "9dc38d805728d4146d78f9fa432e6c6cc434b780fc5d4ef7eeaff1ea721a881d", "gpt-5.6-luna-medium": "9a2cc16171b58ff2fa6f041c7a975ccb3ed873f217816a96349af39d85ab14ef"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-7477-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "您好,请帮我推荐一个评分是4分以上、游玩的时长是3小时的景点,谢谢!"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-7576-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c603d2a562c575adc4e7e8af1ad6e8f3f68e9528e06ab788dc7651d0d7340956", "cursor-grok-4.6-xhigh": "5c774da4a76b3b129e2c24a082fb9b0a343906d806d0d16a9a2476595aa075dc", "gpt-5.6-luna-medium": "6e5397997bb4c2b0c6756e80f533a3f6b044021e728377dfffcf097becdb0fb1"}, "labelerVotes": {"question": 1, "replyableMessage": 2, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-7576-10", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "嗯,最后您在给我找个免费景点游玩0.5小时 - 1小时。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-7593-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0d244f8dcbf19a38423b73229eb2bf6b92c6eae4b3190a98659d98124a73bf77", "cursor-grok-4.6-xhigh": "8b15adb549508153e05b255fb8e3fc3ba8c9abb52d5335eb0fb75b06d4e9d5b9", "gpt-5.6-luna-medium": "3b030348375d18dd426564a71c81e89fb965bd1ba0949c32e202d404c559ec05"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-7593-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,请给我推荐一家评分4.5分以上最低价格在100-200元的高档型酒店住宿。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-7671-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d36f8a86a7a806cbc5646fc08ce2b0820eadf063a9e992fd7e1919a4771cb9fd", "cursor-grok-4.6-xhigh": "d8650a03948d8f73f1d7bb74902e388b5755fc0e89ad90b70fe9c00e2eb747fa", "gpt-5.6-luna-medium": "4b5ace737d6297b18cc0c35462158b57ffcde3adf71ebaa8bc4b47ecc13d684f"}, "labelerVotes": {"question": 1, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-7671-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "您好,请帮我找一家供行李寄存的酒店,谢谢!"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-8169-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ff12a5aafef561d851430534c027bf375430c89a5e3639937faff64858d4f2d4", "cursor-grok-4.6-xhigh": "93d23822c5d9ead01e232a67d37c908ebdbae8453320fe74bb3b42c99fe06340", "gpt-5.6-luna-medium": "93d23822c5d9ead01e232a67d37c908ebdbae8453320fe74bb3b42c99fe06340"}, "labelerVotes": {"question": 3, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-8169-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverCalibration", "task": true, "text": "你好,我要去景点红领巾公园,帮我查询下这个景点的门票和周边餐馆。谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-8242-16", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2e3c855c97f1216437537f16ed548fd32b22d2dc4a4eb3c7c0c534fb4dd36465", "cursor-grok-4.6-xhigh": "94e963d9deaa5c83df3d24d0c738081c98f02af1232fa33a74141d709776c3d9", "gpt-5.6-luna-medium": "17b715390d5ddf30528fec46fc65f7bb15ccbdd95fe9906c25ba1025af24dfe0"}, "labelerVotes": {"confirmationDecision": 1, "question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-8242-16", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "太好了,那在这些酒店中找一家经济型的,评分是4.5分以上的,告诉我地址,我去安排一下,再看看周边有什么景点没?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-8593-14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "73de8c06eef37d1d4996d91505bab6636fea4a7a432f41536c8a942ac55da5a1", "cursor-grok-4.6-xhigh": "97874f57a857366db7ee30fe2078627cf236e61097d4650215ac9a1b72983bb2", "gpt-5.6-luna-medium": "435406ab6ae8739100feb5b856e8893f56ed70e1483d3523fe31e1c29c2fafe8"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-8593-14", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "非常感谢。那请问酒店电话是多少呢?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-8657-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "946287afb3677d6f428a445d0fe90d5b57a447cb731c3ad282c8ea73f519fab9", "cursor-grok-4.6-xhigh": "c502a069cbdc83922c9b8a058056d4c7e0686ad3af685e582d700da37f84a2b4", "gpt-5.6-luna-medium": "54d938059e4e5f53decddc081d607c20e23df75dd036eae0efa2631acc49f1d5"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-8657-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,帮我推荐一家有罗宋汤的餐馆,最好评分在4.5分以上的,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-9158-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7db4752fdf6ffaeb596bfad9626c75dc8dcdd4b65dc5da9e387c420202e240b3", "cursor-grok-4.6-xhigh": "29ac142be1ddd16527e19adae46fc186dd5b9f0c844839d93ec89f4287434398", "gpt-5.6-luna-medium": "110d0d84e50f08177b4587c743648e1b5756fc9c1ac233684700c83bb7fc77ba"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-9158-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,帮我推荐一个能玩1、2个小时的景点,要没有门票费的,评分在4.5分以上的,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-9404-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "cc55f362a523de07443c1b630674419de3fba4e349f74f9cc0d9cc306dcfde55", "cursor-grok-4.6-xhigh": "8175596bec106c4f52fe0a1d75d89d3ff446cc7a9402923f44a8838e8c1dd9c9", "gpt-5.6-luna-medium": "13ab06ae88f133ad2052b0f76c283dbed1cb65a709526efdee7cad49eaf18c91"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-9404-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,请给我推荐一家评分5分人均消费150-500元的餐馆吃豆面丸子汤这道菜。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-9587-8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "debdcd13003d6f6137d87c978591f673039b908c51a5f63bd73ef98b2e6714c5", "cursor-grok-4.6-xhigh": "c7a5e9306fa03474877c4c4d7dce0e0de57fc0512ecc6308262fe43eca8850fc", "gpt-5.6-luna-medium": "2644b2bcf254a3c7c3c71896fff32be9c3ba934b0b4beeb3711779ea7ca32ea5"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-9587-8", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "好,请您在北京语言大学的周边帮我找一个评分4.5分以上的高档型酒店住宿,顺便在查下它周边有什么餐馆。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-96-2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "861171182e9012ed24e7628358eb58bd52b1418b060fb497d0d5df83c21792d1", "cursor-grok-4.6-xhigh": "c4b62b7b4cd3d8e3472646ed90cddc06801a89e1627ef6d6053b189b9643f996", "gpt-5.6-luna-medium": "90ec36b7ce48d4b1a4cce7d5312b6e2e046134b7cdb731b4e2ab890e2452bb89"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-96-2", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "麻烦你把这家酒店的地址和类型告诉我一下,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-9637-24", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d15c8aa62a1b74e022a3b40f840fd8551cf236b549dcd502efd8811b4ea5ad84", "cursor-grok-4.6-xhigh": "264c84a136617eb052ca34e1140c6a8e76097860f90e63df1a47e17fb1159d64", "gpt-5.6-luna-medium": "e385198ae02ea17277ad5a07b34b783f7105882d39dd76eb4a162ace37475f6e"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-9637-24", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "请帮我呼叫一辆从十渡风景名胜区到小吊梨汤(畅春园店)的出租车,告诉我车型和车牌。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-9866-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4b27b1e9f4c51beab3dbaf66aeb3b67af7d843b54eb8c1ae49840821ca5823b3", "cursor-grok-4.6-xhigh": "e1c8e86dfdd5a723a54ecdba35a9604104cd9b0816efd8b756101472d49607f1", "gpt-5.6-luna-medium": "04cd18541f872e869544c0a8d7c42231fa88e515d2a5ab57346677602f2d24ff"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-9866-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我要去亚太花园酒店二层翡翠金阁中餐厅用餐,请告诉我这家餐馆的周边有哪些酒店啊?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-9886-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a0203e5e0c442cb1df0e11a518a1e1774f75b19b03449ab9e6886304f833d0c1", "cursor-grok-4.6-xhigh": "c3c332219d1e64111caa83b3dcc8b17f0a7814b052dd7b5eb8efe377337eff69", "gpt-5.6-luna-medium": "f2d9785a39088b360d528420c097482f61366f3c78321edb61fedcdf96e1a9b4"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-9886-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我想去排云殿这个景点游玩。这个景点的地址帮我查一下。"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-goemotions-edhgfqz", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.85, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "cd20548f638be4b1af9408a4f3c3510840addd18142514db3633d30ae19a7b71", "cursor-grok-4.6-xhigh": "c78bb39d2e656749d2142a5314a9e10540eb6f88a7b1e9b4242c7d157e2b22d3", "gpt-5.6-luna-medium": "976555656631c83f6197fe8f784d77ce50edc3a49bd9a8af0466cc66c7eeba6c"}, "labelerVotes": {"question": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-edhgfqz", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L6496", "split": "silverAcceptance", "task": false, "text": "really? I tried last NYE during the day and it was dead"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": true, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-goemotions-edm2plp", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.84, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "11e0074ca1308dfdad27053919961ab21f9e7e19b80100f054173b5fae6289e1", "cursor-grok-4.6-xhigh": "53bf23a0a4b068add9800ef7b7f68bb7a202da8771811adfbc2920a8d4c3bd93", "gpt-5.6-luna-medium": "b1dce5b0a0a932c2ff2d020dea97ed444c2689a849bab7aa8f9edb03b2e39027"}, "labelerVotes": {"blessing": 3, "replyableMessage": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": true, "replyableMessage": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-edm2plp", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L38838", "split": "silverTrain", "task": false, "text": "I hope you like it-"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-goemotions-edqmahz", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "579b0e153532dea122b70e6de2fe1edc9c5e9fb52f6467d0bfa4faa73576a8fd", "cursor-grok-4.6-xhigh": "579b0e153532dea122b70e6de2fe1edc9c5e9fb52f6467d0bfa4faa73576a8fd", "gpt-5.6-luna-medium": "99bfd299f4cefb1515910b50444776c2dbb16d7fca5169e5973c254aa988197d"}, "labelerVotes": {"question": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-edqmahz", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L42967", "split": "silverTrain", "task": false, "text": "Why was nobody driving the damn thing? They were all in the backseat. :/"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": true, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-goemotions-ee0ui7m", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "36182ebfd2c87dcb03b9bc058838b771080a26f18ba35acbdefece0a6b4f8ea1", "cursor-grok-4.6-xhigh": "36182ebfd2c87dcb03b9bc058838b771080a26f18ba35acbdefece0a6b4f8ea1", "gpt-5.6-luna-medium": "7222f3607eb2d42ec8444d0eed9bb754eae8f4a0b9e4d926e53987908f8bf22d"}, "labelerVotes": {"blessing": 3, "question": 1, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-ee0ui7m", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L30860", "split": "silverCalibration", "task": false, "text": "You've got time to turn it around. I promise you. You can get there."}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": true, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-goemotions-ee75sip", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.85, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1884108d46f4aacd57642f04703d02d07e675421040e24b7ba231b11b4751863", "cursor-grok-4.6-xhigh": "ab5b03d924d99f3d1698f66eee619a3d7789826ee053e1b57e4130b2b4f0ec72", "gpt-5.6-luna-medium": "098111bd77ff83eabf7e1e466be16334760b415fa69d6fb8686c5873e22fd8db"}, "labelerVotes": {"blessing": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-ee75sip", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L22896", "split": "silverTrain", "task": false, "text": "Yayyy!!! Go little green bean go!!! Good job trainer!!"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-goemotions-eelizvv", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "fb93294baad5c983e498b48ef52fd46d8f9129e6f68474d8f408fe016dcd6c9a", "cursor-grok-4.6-xhigh": "fb93294baad5c983e498b48ef52fd46d8f9129e6f68474d8f408fe016dcd6c9a", "gpt-5.6-luna-medium": "6cf5ac032d340ae0ce4021db6ff6b60fa20098a9b1bfb58a7c7b033896815cef"}, "labelerVotes": {"replyableMessage": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": true, "replyableMessage": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-eelizvv", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L7322", "split": "silverTrain", "task": false, "text": "Yea the conversation went as expected and now I'm looking for a new job. Thanks to all for the help"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-goemotions-eeq8ddu", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.85, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "11de20b97f1066a60acb63b0a20d2870cec181e9f42e16d638d7dbf0e7865a5a", "cursor-grok-4.6-xhigh": "d1007e8ea549a60a0249f68b438564404d5b8afc0b693bd6fbe3ec1aac2ab5f0", "gpt-5.6-luna-medium": "f4b4cb244add0b48a42b7ed6791dfe5b33f30acc5997d3921359b4219c7e4815"}, "labelerVotes": {"replyableMessage": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": true, "replyableMessage": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-eeq8ddu", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L16603", "split": "silverCalibration", "task": false, "text": "Lol!!!!!!!!!!!!! I love it."}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-goemotions-efdl4z2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.87, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e48922f19ee2639f905990c52448282fe80b480bd126bc6a4fd2b0dc7305838c", "cursor-grok-4.6-xhigh": "5f0c01e24bcb2999173dc776fa88b51352261f5d2647ad611a2963b6540e7bc9", "gpt-5.6-luna-medium": "bf8f7b6cb5577853a10dfffbaeceaa1f1a49838910582aaf67ed5bfc4eef334d"}, "labelerVotes": {"replyableMessage": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": true, "replyableMessage": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-efdl4z2", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L33172", "split": "silverTrain", "task": false, "text": "Thanks now I’m insecure again"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-goemotions-efect26", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.87, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "09a383757cbb24380ac6f1365b5506ef5912e088eddad8280458c74b90278bf5", "cursor-grok-4.6-xhigh": "d7ba38f101b5a3d4461cbcb5614a24c40506ba07ce245af450f006872186cd92", "gpt-5.6-luna-medium": "8c8f12becdc740af9ce1667131d865bbd4ad42570d89b0fe02a837148d677919"}, "labelerVotes": {"question": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-efect26", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L28853", "split": "silverTrain", "task": false, "text": "Sorry to link it here but would love to get some opinions on this post"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-goemotions-eff0egy", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.86, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "73c3f803656dd58dd364c0d0141cf21580a8c2c9aec2882c0e34e3e0e8134a2e", "cursor-grok-4.6-xhigh": "029d7552a1892037ed178e6f97b3a581d8ada601a60a62cace2a36a213781b50", "gpt-5.6-luna-medium": "98fbf0c9545abad7d173da7471a67d0ade565358873e73492975ab4ad049b337"}, "labelerVotes": {"question": 3, "replyableMessage": 2, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-eff0egy", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L41468", "split": "silverCalibration", "task": false, "text": "Please tell me your shop didn't get you in trouble for that D:"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-goemotions-efg2bx0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.87, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "04b2f880d43b490f0b467f013a96cce4da4a1bc50c0b0f313adba1dec5aca855", "cursor-grok-4.6-xhigh": "a3dd8c7dcb5ec503869321c2726dd29d649fde490f501b735b2eb10c69fdcf8e", "gpt-5.6-luna-medium": "203c7e5444117c4d504c0118cbe133bd91c84a8c853a5afcdb063c6122bde95c"}, "labelerVotes": {"blessing": 1, "replyableMessage": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": true, "replyableMessage": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-efg2bx0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L5356", "split": "silverTrain", "task": false, "text": "Im so sorry"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-10112", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c7b57a3faf590bfe6d39e728030b9e446e16f57de7b5ba9c845ae59e0de8b00b", "cursor-grok-4.6-xhigh": "b357253b141dc848a504bf28a0b65796cba30f9e1d644437aa7efde22b9dd180", "gpt-5.6-luna-medium": "e8738af70bd9f6b33705a433fe10ab2d52c35e5c1595e7f9da3142ea5193fcc4"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-10112", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "how do you cook a good burger"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-10167", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "824dd3c867090e4b3253483c032003e5ad232e666d73ef353211dc120b197e31", "cursor-grok-4.6-xhigh": "fba1600aea4757e3f4c54adbf97b47440639cc532814c25ae605795c3758d4c5", "gpt-5.6-luna-medium": "0a14681128eddc1ac1f9ab85cb41622603cb349b06fe7f9593763c92afba5820"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-10167", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": true, "text": "find apple pie recipe"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-10643", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "451bdef06fd3ff72663cab91435dd2419ac7bdeec06560c09c0af44749459700", "cursor-grok-4.6-xhigh": "64dcca4c87fd0f33c7d2e3b7493c96eb4335198cfbf65c4c79ee56647b8ef5b2", "gpt-5.6-luna-medium": "d192c756b17c4cb61952c12d81e23a2b4b393e88ec3898d59677dfbe79681ba2"}, "labelerVotes": {"question": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-10643", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "lose the last item in the list"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-10663", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "70f483094043c9195bf289be09f5a382050f6c713dee6b90f5170299f3109044", "cursor-grok-4.6-xhigh": "0b4f39bb669b31814fa2a3abeee64fbcdb957b1cb0864ec7904b3c9980be9207", "gpt-5.6-luna-medium": "c995ef1f81820f08ba24818bf25138326ec680ca5d00943041ca6e9cd96c99b0"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-10663", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what are my engagements today"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-10874", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "72ef4df4e94c41116ea3bbdf1956c15f3060686426b85f50b22e5e1d57743e90", "cursor-grok-4.6-xhigh": "8dc7d473d7286d3ab8e385235fb9b255b94b6fef630e1c7019ddf5e8809d0617", "gpt-5.6-luna-medium": "425fe15b7c064ea0effb512e842d24c1feb63188eeaf6fa7238207521b42f5d5"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-10874", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "can you remove my to do list"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-11059", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "8b370dbaece3df5d63c4b7df8e0162e02caca77ce84239a3d430f9d8fb870924", "cursor-grok-4.6-xhigh": "05cb935c67fa9a6dabf4edb232c0ab45d79ce50a5dcc86ec53801abace630ecc", "gpt-5.6-luna-medium": "6385fb288eacfd0d758da13a886d557c82bfa9cb67da4254b90ae2fc7891c2c8"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-11059", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "name the lists available"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-11228", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7b6761a45de0f16e1d09946f5d81716932c5674f0b74664fa1468869072bb325", "cursor-grok-4.6-xhigh": "39d01d3d8da2c654f8bd305e25f8660deddaeb16f95e1dd437067598c764e7fb", "gpt-5.6-luna-medium": "f40ac0c83156a3698b7d06037fb6249b526c2686380c8a02a5179c4cce20d441"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-11228", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what is planned today"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-11637", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "40df25ba01f682121d933ad2e0e57e919e0f8b276d29d6674a0723a809a530f3", "cursor-grok-4.6-xhigh": "1418224246bdcaac543b0e4c3604f3c359b4a04d0e34ec4ab9fdd58d15785e99", "gpt-5.6-luna-medium": "f64b71210c7962de4d625be577ff9deb7d2ecb98a5ba2e37606e09b6d9d0e015"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-11637", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "tell me the movie with best i. m. d. b. ratings going on in theaters near me"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-en-US-12321", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6b04bf052674c0760a1170eda905c20978e46b0887faa3f9c831d1a0e5e26abf", "cursor-grok-4.6-xhigh": "6689e1fcd776a93e8df50a1bfd90149884d3422090e10f6e663ff57f4a6f6820", "gpt-5.6-luna-medium": "6b04bf052674c0760a1170eda905c20978e46b0887faa3f9c831d1a0e5e26abf"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-12321", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": true, "text": "olly call a taxi"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-12474", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9cd9fe911ee83e194157fec193dc45b47c5842f3c3092b0c52d24737b6a9e4cb", "cursor-grok-4.6-xhigh": "5e219b3abec2ae4e612d5624bd7b79a5d48c5f5ca2043aadd2aa2edd4706157f", "gpt-5.6-luna-medium": "7caa7d0b8e6934fb9a5276e402f49e328eb3ee1e59e6b28a34a4ccaafc1f5aae"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-12474", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "where is the closest sweet frog"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-en-US-13327", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "16fa3fd2bc96bd8eb9dbe74d399dc5a6b456d117f635870b04397399a13bef6d", "cursor-grok-4.6-xhigh": "2dc2c7cec9da7d45ccf3b82b12a7e732892c670ca498cfc7106ca94623b7732d", "gpt-5.6-luna-medium": "16fa3fd2bc96bd8eb9dbe74d399dc5a6b456d117f635870b04397399a13bef6d"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-13327", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": true, "text": "call the closest mexican restaurant"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-1348", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "22aed8b30a0ad79dc229e90bad26070c0136718dca9b3a7a302e55edbfc7ebfc", "cursor-grok-4.6-xhigh": "f7b849562d5fbaa1d7a21201506821ea60917ce16047b536f630dad7cb730324", "gpt-5.6-luna-medium": "3554207b721828a2edef24fadee7b24cb0895770b50ca26acc8130dcfbc21f15"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-1348", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "can you tell me the current time"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-13889", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c45e8d5859497f448005befe7c3e7c628e125990b44a3f594cf15a8f8beb6ae9", "cursor-grok-4.6-xhigh": "3214848b1ea3cc3bfaefd1cc878a217513c3e13b79a43513ea6b04d547d12401", "gpt-5.6-luna-medium": "c45e8d5859497f448005befe7c3e7c628e125990b44a3f594cf15a8f8beb6ae9"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-13889", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what is the capital of washington"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-13920", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9dcda9b9f224715b5ec87f72daa2b38fc512e58fdfd259a34244f158ef533532", "cursor-grok-4.6-xhigh": "4c708b860d3548d087b113e5cc94116d09adc0fddced3595f468201e624a6c30", "gpt-5.6-luna-medium": "f255317fa215c0df74e6dfe8346fff9b061b896c8ce8d1faf4530bbfcddb9272"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-13920", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what is an orange like"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-14209", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a51c9db5675e9b00fd5b5ad74b87e6693fe8eda5b7f4de030699ae6a05fc1518", "cursor-grok-4.6-xhigh": "c23435479c8758b5cc4d6af13ef8ac92cf375fe966467cee834fccc4bf2b7978", "gpt-5.6-luna-medium": "0bba4fc0929f565d08c6365033da21e427b4e042615d6a2703b8500970c2ecda"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-14209", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "how old was elvis when he died"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-16203", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a2373c61558a3b7a20222a4713600f05518292e3f450bdc4db86e2d41143d17d", "cursor-grok-4.6-xhigh": "1feb4ec419946ba7c44cf770d4cc5ac9cf9d2370c786c62c3770fe18625f8fed", "gpt-5.6-luna-medium": "7834c2f8bf24773539a6e3717c7aadad7e2c54deb9736242864dd683752f5e79"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-16203", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "do i have any new inbox message"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-en-US-16640", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "dc88e17e14b8c609a7b2f2be96191d0d7462995fe3f51d2c606db765b08295b4", "cursor-grok-4.6-xhigh": "02fad81277be9eb77bc97a4d85da3e69746ea20fd92a6409df230a5ce3594dc0", "gpt-5.6-luna-medium": "dc88e17e14b8c609a7b2f2be96191d0d7462995fe3f51d2c606db765b08295b4"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-16640", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "email joe and tell him to hurry"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-16722", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d8c2ecca5d75d77bf55eff6c3910489a705454b6a7782d337b2cf383676ba6ab", "cursor-grok-4.6-xhigh": "e1bece98c7831a55c6a642fa1a9f8a20654d6e895f14876e60d3b33aab42ce9d", "gpt-5.6-luna-medium": "9e3eaaecd9f428b9ae72ac18a48c905d8fea4ee1fcb461f16297a3705ed42b39"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-16722", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverAcceptance", "task": false, "text": "have i gotten an email from sean"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-1727", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1ab9393d0929d9396a0b47dcf064578ff60e16d0818f050ae4db70e437ee8c79", "cursor-grok-4.6-xhigh": "530134150be6b5748325bf4b899bcb38da294ea1336a694b8b51c062f71610af", "gpt-5.6-luna-medium": "998bc6f2cd0572c86bc2924cf709da76980d41f32d67d16c7de02cb8ed3372b0"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-1727", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "please could you tell me if george's geek restaurant can i order takeaway from there"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-213", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "614b70e099b6844cb256451bb0358e2e7ebdf125aae489b18b2d8f9d4a837520", "cursor-grok-4.6-xhigh": "c56cece1812b43b5a1784e4e10add9b54d4a5a0dec8372ff449fcecdcc6f99ce", "gpt-5.6-luna-medium": "614b70e099b6844cb256451bb0358e2e7ebdf125aae489b18b2d8f9d4a837520"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-213", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what's date today"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-2130", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "163145ef0e2482563d57bed872f8157f7c04f7918dfc363c18bfc952184f579f", "cursor-grok-4.6-xhigh": "317977174ea04c8ded93a5e6efafc74ca170589f5fcf4e659e9869d4cfedff9e", "gpt-5.6-luna-medium": "6ca8e110a7359448f515a9bd4f063d832bbf34e8eb26c3716f30fb7b0225a745"}, "labelerVotes": {"replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-2130", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "a little brighter thanks"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-en-US-2732", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6ba9e685d6875625861868b945fcc4bec753ca857b81894e8c2fab656dff37bb", "cursor-grok-4.6-xhigh": "6ba9e685d6875625861868b945fcc4bec753ca857b81894e8c2fab656dff37bb", "gpt-5.6-luna-medium": "1144644feac64400f345a0288fca861bff89e30df920c0fe327cd2f51dcd3789"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-2732", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "please start me some coffee"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-en-US-2837", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "db5d2d4d2a4663b3f9e2c3a992fd37edea90adebb201e630b6b9038eff56d998", "cursor-grok-4.6-xhigh": "db5d2d4d2a4663b3f9e2c3a992fd37edea90adebb201e630b6b9038eff56d998", "gpt-5.6-luna-medium": "3d41afe44d01e68ceab4a539d41c9436bfb512acf98ee8fdcff7568871f53c62"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-2837", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "change up the light colors at home"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "followUpReminder", "family": "consensus_public", "followUpReminder": true, "fullAgreement": true, "id": "open-massive-en-US-3765", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "16a9c3103034358884f85e16fe5acfdc0a1ab6ea46a627dc212b306efe145974", "cursor-grok-4.6-xhigh": "150a9ed17842758707b18d9c505da0a85d11a6872ed73496d45abad3db04125f", "gpt-5.6-luna-medium": "f1bae8d625b967dbfd58de754284b9bda9b47b7489eee175245b386210233058"}, "labelerVotes": {"followUpReminder": 3, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["followUpReminder"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-3765", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "please set an alarm for me"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "followUpReminder", "family": "consensus_public", "followUpReminder": true, "fullAgreement": true, "id": "open-massive-en-US-417", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e666aee75ab863f4c268640af5d350cc819c4ceada4e4d3be012cae82ed38198", "cursor-grok-4.6-xhigh": "7777a6f92b4cba23dee7d74c2259386fe5b08ea62c8de3363020b871380f6634", "gpt-5.6-luna-medium": "18dc5b01467d5b3784c1dcff3ba506340b404455fd254297aef2bee626a65927"}, "labelerVotes": {"followUpReminder": 3, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["followUpReminder"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-417", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "make an alarm for four p. m."}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-4610", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7b2d7448ed3504834381656831d4ceb051fbfb655e520fd547f0108a52639be5", "cursor-grok-4.6-xhigh": "a501759c8a39054996de58e865204820bd3b52efdc64768c44b0691b2bf16f4c", "gpt-5.6-luna-medium": "c137ce4cd6f2ba354583f9e5e37119db95960db527838d5f28b1cca3a5f94d2b"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-4610", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what time is it in the central time zone"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-en-US-5420", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a620d75b718c51f2eca34bd4cf45a3d86a812c541d90a389c2cbc241c4f80c95", "cursor-grok-4.6-xhigh": "df601b58ea6797f4386d29ae3dd86345865701ed0de41a2c33a007c604a4f5a1", "gpt-5.6-luna-medium": "fa492eb3f1fdeb858794fe816662c1adcec8720a2d587c80061c52302140d45d"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-5420", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "please turn on wemo socket"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-en-US-5470", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "67fd2846141d23d82c3f2afa1cc747ee5180ad7823fd24a53580db409abe2355", "cursor-grok-4.6-xhigh": "6d7fe0a2fc1ff040c29781db687812fd71870650ce65fad67bc7385d115a3c2d", "gpt-5.6-luna-medium": "67fd2846141d23d82c3f2afa1cc747ee5180ad7823fd24a53580db409abe2355"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-5470", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "alexa please turn on the lights"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-5745", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d7ee610b7d28658526b321e3f119a8850f2c7c16d682eecd6c87a7b35f650b04", "cursor-grok-4.6-xhigh": "bbd4032c144ad8f66cd3dcf33440f81d267b0767b40e7a88ae346b68789a677c", "gpt-5.6-luna-medium": "a1a5542a48e73312e0bc348b8c8038555d549a4f64ac477019d89cea4d19189c"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-5745", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "show me what day the thirty first is on"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-5975", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b0c3c8352b8d232f32a852d2032cbcf2794a111825e94d92f7d3b0f9e8f65a73", "cursor-grok-4.6-xhigh": "970a4427597aea134549b9c057af0713de60ae203ebe1f9e2557c84cc126e9db", "gpt-5.6-luna-medium": "e405b39b8ce6fabc50473852ce04e2f91400c1aee54c3acc56b009dea0acc182"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-5975", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "could you tell me what today's date is"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-6911", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0a83d8a8f51a34ba1e6e502b619be444350fb70a3f27a9cd5b616686fdabb52e", "cursor-grok-4.6-xhigh": "9f239369b13a54ced0447277c471f53c9d7c1401eda73f9312e7a80c91edf984", "gpt-5.6-luna-medium": "d54920f0b28d73c233e97442a0fefd83a4785c0056ed2d5f4dc4ca338ade786f"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-6911", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverAcceptance", "task": false, "text": "who is scheduled for tomorrow's meeting"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-7478", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "5aa0fe1f20044aecfa46dd64651255e3d92175c21b665f964230b902b6026455", "cursor-grok-4.6-xhigh": "89a49f1ab3a852dbf4359b1d25ac5f6168be273243702c0ba185e9d9a4d1f513", "gpt-5.6-luna-medium": "ff337b086e27504b394be3c9b2fec44a694ea4fe8c21f6e092fffec80459e440"}, "labelerVotes": {"followUpReminder": 1, "question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-7478", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "tell me all the pending reminders"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-8200", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "88f51fe9d3aa0aada8c6f7b43542c9b2a1bcdb1fae2deccbe88a4cd78a9e3af3", "cursor-grok-4.6-xhigh": "4f4268365754f8cccee461ab6bc91f0b588f9a992e8f388ad123b3a460ccafd7", "gpt-5.6-luna-medium": "cac695aa12dde7d17ed02d16e5a9e40787f755be313e3fb63ccad402d80defdd"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-8200", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what is on my schedule for today"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-8610", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ad5a00bef371b6299960e43af91d52c7f597656d7c4501683ebf5148a2e2ad05", "cursor-grok-4.6-xhigh": "b377ab3b1c2afa1d0065444a6e8d5b2bca2596e47035da1977376c5482faef61", "gpt-5.6-luna-medium": "cfdae24a64bd2ffa5afc5d3974be483fd3fcd050d31c36d06b5235298411bfea"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-8610", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "where the party will take start"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-8616", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "33b7d807e8eb9b1d43faff158110ec3fb4919c63ac033f363a3f6142eee206ed", "cursor-grok-4.6-xhigh": "a11482b517d2ff515b7a8fd397d075683cb3b1e0e68cbea5fd6dffb1f1bfd62e", "gpt-5.6-luna-medium": "002e8d1a42123855a096b8d9f29ee2371f3c365237404d1a74dc6f197fbb068c"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-8616", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "enter event for mondays only"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-8738", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b3d681e8d6446f9679ae433680a5b194116ac27b89392a7f7104705a526c95aa", "cursor-grok-4.6-xhigh": "3afa243c5c682ee87f5fb85b5bb3ae82a22cd8f7fb257422d9b6a6a965141c53", "gpt-5.6-luna-medium": "90d6570c20147ff9dd6058205cc8514250ca3dc71cf97416df1007a68f699a2f"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-8738", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "remove the event off the calendar"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-910", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "99d5c8e93522eb045836bbdad8767a389c284e2f8af8fbe5c2aae6fd48015943", "cursor-grok-4.6-xhigh": "00eddf39566fa4671b3e6df762b6e1e72e88fb1589eafbbc2e4516bbbfc259a5", "gpt-5.6-luna-medium": "4c86fb286b7b8eaf1cc03f0ab530ae489b4ecc117ea851af8376a12acee51e95"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-910", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what time is it right now in new york"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-9960", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ee30c72ecb246d7eabe6b995e3ac678d61021ea1365ce49a93c3ace5ab959010", "cursor-grok-4.6-xhigh": "f7d3d23e63ab688328a2ad859ff2cd05b8b3b7a8497e10f265f99c08e63f9eb1", "gpt-5.6-luna-medium": "c4e9460f6d5cd60158283b77db9f7c0a828f094065e8a9d022f962b829603061"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-9960", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "how do i steam rice"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-10782", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "a64c797f2772500b7af7556f23b7e90c1c40cfc10b30b08068425ab8b7512daa", "cursor-grok-4.6-xhigh": "387978a1af01808a330669376be4ba136b1e386e744b64bd55c2eec86cb090cc", "gpt-5.6-luna-medium": "24f27403f2d0ed514a9b20b61fd97b9eb36fc75750ca32a62253069f80c529d7"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-10782", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "我有什么任务"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-11651", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "53e107611b60ca28ca3a58b528968ecb885c0615e3a9c743605e2e7d9d28d833", "cursor-grok-4.6-xhigh": "178b37c0d2467295ce1e62633f9a9fa0a0d40c7f366cea709ea56d25461f3a4b", "gpt-5.6-luna-medium": "1cb6916de51bcb987bb8bc498b1a7a0ab2d0073cc524494058b0f1e7e0863e25"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-11651", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "让我看看周围有什么"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-12151", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "52e3dc6f2df1748394d7278049f42f41ccfceafea5298e5ee3c9a2a454f754ba", "cursor-grok-4.6-xhigh": "5ac75232ba29c494dcfdb0335d41c16b8cb149387b911d1e814d34ebd1e9b46c", "gpt-5.6-luna-medium": "7b6e3e2a5deed83963b20797953477d1351f7997950c36b4c576b173131a8ddd"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-12151", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "帮我订张这周末去北京的中国高铁火车票"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-12180", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "c521613976bb93e4df2477a1dc2000ed827e26fc1b41cf632b017558744013e9", "cursor-grok-4.6-xhigh": "cc483fb1cdec97fa19f30e1e21d8b5d04fd52ace3327e6f25aabcec7aff0ccaa", "gpt-5.6-luna-medium": "c925c807adf7ca3030b52af9decc8c7fad0d0658cfd98688da038747f26da24d"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-12180", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverAcceptance", "task": true, "text": "我需要一辆优步到我的现在的位置"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-12228", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "b3b0cc680c3e62094b8ebb25cafc578ecba692622e4d7ded37dc8f73c1c5f08f", "cursor-grok-4.6-xhigh": "b212b3ad8d1e42cb560820e219cda51128b4ed366e62ac390e273b1f753538bf", "gpt-5.6-luna-medium": "54490d9bbb301b8da5facb7ba2fd2985c81addfda6e0f2dae116068cd98d6641"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-12228", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "我现在需要辆出租车"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-12396", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "5b4ed48732674c2065d3199c8bf0c148275d3dae0a3c04d7e2b5798819c87c3c", "cursor-grok-4.6-xhigh": "77c8fd30fa0fb9861a32b4c7439d32eab728fddc3671f524fcfc1eb65f4c2013", "gpt-5.6-luna-medium": "09df31c1f12745d17a3688bcce969a1271d0fc7f79a83a21ba9effbfc3d2399f"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-12396", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "订一张去利兹市的火车票"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-12552", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "21c0d99b2e110781482cba01caa76ffa6d2911b1cc4f47d0c2371dd9c44b9b1f", "cursor-grok-4.6-xhigh": "f5220ddf1da8c296009a7c41ac9495409c874c75aae84258bb7c38218df1dea1", "gpt-5.6-luna-medium": "c63dec2372e372c91c0f7a3399035b992ea9f96736afa6a28d2ac7f94cf9275f"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-12552", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": true, "text": "你能帮我订一辆去目的地的出租车吗"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-12922", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "40a6b8701b11416d5328a9c98ac3bcceea6dc528b806cd79226bb82a5edec024", "cursor-grok-4.6-xhigh": "0b455aa5003c2c9668aa291bbe349fd1dd56b707e2e3e0794adb4b1fe5d8bfea", "gpt-5.6-luna-medium": "eabd4caf7e3edc68c1f54891610306878f869350258d74101503e31035e48691"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-12922", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "我什么时候能赶上最近的火车"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-1419", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "dba016633c0192c8e8791345f96da2430bc9d943734403f0629d523be0dd286f", "cursor-grok-4.6-xhigh": "fc3f0fb4515fa865b5acae5729d28666a07fad359f14be08e82a8132a6100eb7", "gpt-5.6-luna-medium": "1f85fc1d51dced9327950a128ce89b624d033d5a818976d3af9ce0030315a00a"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-1419", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverAcceptance", "task": true, "text": "请更多光亮"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-1514", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "f6ade08cdf2ed198151440544294625cd94950b9e4443dfacac1fcf0df8af0ef", "cursor-grok-4.6-xhigh": "47dda43f5c59620abe42ad7ddb0240e74a9081fa1e5d453863581d9237766365", "gpt-5.6-luna-medium": "60d79c0c681f98d07322eab34f09ee82786c94ce38beb94dfdb89c90606adf9d"}, "labelerVotes": {"question": 2, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-1514", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "今晚是不是下雨来着"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-15232", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "253b160f222ac2dbcfd056036d55241fff3070580dd855a30b96f0e72a718516", "cursor-grok-4.6-xhigh": "253b160f222ac2dbcfd056036d55241fff3070580dd855a30b96f0e72a718516", "gpt-5.6-luna-medium": "0b72a27bd3f5bb8b679125c92de65cf50c4743ca2fe613040f77021351bc0ca3"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-15232", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "将张三的歌发布到我的微博账户上"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-15526", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "8959f7166aaf7131ccb16fd79c5db4e5f5593b655fcd500ef81f79e43e4a3f55", "cursor-grok-4.6-xhigh": "0aba6222120792d0cd086f4021420bcfb9eb6203c1935b74f28f15d67024802d", "gpt-5.6-luna-medium": "d2b3b8f3713c3b49131b06f3d0bde71316027ccc92ea97b3bd90e88e896c5dad"}, "labelerVotes": {"complaint": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-15526", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "用微博发给大润发客服投诉"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-16006", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "5083224683e7639fe538a558613181d7e90760af765f8000cea18d9c772d01aa", "cursor-grok-4.6-xhigh": "56a78e60da0f19859a3958ea5246255bf44a9a455bec6b68cf77cc963bab2426", "gpt-5.6-luna-medium": "dff6c92812390d5d577d5bb7338222f7a21976b3ee8c9f1674c0e2b561641456"}, "labelerVotes": {"question": 1, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-16006", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverAcceptance", "task": true, "text": "天猫精灵请帮我检查我的电子邮件"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-1609", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "875074fa77dc4b8a9f0955db352c3b0d00edcd7fb272d4cac5da8796dadc700d", "cursor-grok-4.6-xhigh": "a3ebd1b176514886cd0ba0ccfa24751fcf861a9560c3ba0d0df2162e20ce1782", "gpt-5.6-luna-medium": "e4375703a6a112596d66742e1b3634833f276ff67ddaf42d3189de7952ba1d99"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-1609", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "请开始煮咖啡"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-zh-CN-16200", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1d748509fbb89f1cfc0441d7a84cf44c8ee720a0dfa5bb543ca50e75449fb779", "cursor-grok-4.6-xhigh": "1d748509fbb89f1cfc0441d7a84cf44c8ee720a0dfa5bb543ca50e75449fb779", "gpt-5.6-luna-medium": "1d748509fbb89f1cfc0441d7a84cf44c8ee720a0dfa5bb543ca50e75449fb779"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-16200", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "请给拉里的新邮箱地址 larrylarry at gmail dot com 发封电子邮件"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-16986", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "cf21fa618a75f8eed1dfecf314ce4743ff7d40ed2de1c2f91c4c0ea111fbebe0", "cursor-grok-4.6-xhigh": "8a07ab00d6c0bad020e3b293827534b61c053a2ca308d26a62a4acd0e1e3ff9a", "gpt-5.6-luna-medium": "49a5931c144448114d1594a57abc64c37993d428714d962bca58325486eff573"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-16986", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "你能查看我是否收到来自家明的电子邮件"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-241", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "7df36d51811b5a8f650b0e4422144985c8e11729e5abe2fe5c745ae1c47e548b", "cursor-grok-4.6-xhigh": "1c1bb26dd6acd03f2ddbe437492306a160ded4f17c1c0e156c22915ba3441761", "gpt-5.6-luna-medium": "6cdc3f6fa652626a0ea030f3ec53f2659ad6c437d305980d5c79f3df9b0d7eb9"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-241", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "外面怎么样"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-4352", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "859c1e72848a130e4bac6b6ff1ababc3fe6e1470aa9a5ad6e676f49b7256dcb4", "cursor-grok-4.6-xhigh": "e0cd2ff9b4af30cc75e75e0466c947801f4a57aa28d4916d58ee6af77de76573", "gpt-5.6-luna-medium": "b9fa7e846c19457a80863ed8df3c56e2e25fe42ea2f15ad81b8d95658ef7122d"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-4352", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": false, "text": "告诉我太平洋标准时间"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-5178", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "ae848239174c78b7ff70a52ec6ac0703012dd733f43e0e047277b0e9808cc5db", "cursor-grok-4.6-xhigh": "ddabfd4be2a46c9d39b35c1057c2ef2a335fcaa3239b6d92a0232f99924c1b42", "gpt-5.6-luna-medium": "e67380e5f4befd42de5bf945d64a384ddd458a4da49edec680e247aedf77065a"}, "labelerVotes": {"confirmationDecision": 1, "question": 3, "replyableMessage": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-5178", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": false, "text": "确认我现在需要伞吗"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-5980", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "b0d194d0a41b67b8f53e5adacd67650939fbba7124b5e3c86af9e9c099c7794f", "cursor-grok-4.6-xhigh": "449df665e42cabf9855d449294a69cc332e5240dc1263e376828cb0efd6ecf70", "gpt-5.6-luna-medium": "6ef05db01978c5fd959a920771e62d5f1afc1e4f477f679464c01b935fc77764"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "scheduleNegotiation": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-5980", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "现在澳大利亚几点"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-6418", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "bbf19e8756d3fccab36f1f40518eae49581f8177d6b88c36aa50b8a5b1886653", "cursor-grok-4.6-xhigh": "51d3b4972cc10608e96f1af9de4b400a328340bf088a1ac6f92d1902ebc5574a", "gpt-5.6-luna-medium": "c102b84e3fcf8c1eee284faeafbd346ab5e0cbf217804d633131738a1fc3cdb1"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-6418", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "打开备忘录记录我的会议"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "followUpReminder", "family": "consensus_public", "followUpReminder": true, "fullAgreement": false, "id": "open-massive-zh-CN-6804", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "f39b1739fe4b40e245088380df62a757adbd83ff7f3451450afac2393515f37c", "cursor-grok-4.6-xhigh": "d0ced9a2d5b409925dff27f4980d45c561f12a89389b8df3db4c0f87d6764ab0", "gpt-5.6-luna-medium": "5f972e2a4db71af20ef2886015c26b588af38d6997e194f423e1ed3b66a6154f"}, "labelerVotes": {"followUpReminder": 3, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-6804", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "每天提醒我要在凌晨一点前睡觉"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-709", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "9961b1e8588bf8ff641fd1d95e41ca6e487205da4c5aed4172afddec87b189fe", "cursor-grok-4.6-xhigh": "8ff810b95657309c15fe8379331c51fe028d615522a56a5ce64b1f40be4c3fd0", "gpt-5.6-luna-medium": "c407588653fd423d4fd1f3dab0f54a3e8870934bf13cb9f29ab33a20f59ef73d"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-709", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "给我看选举投票的最新消息"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "followUpReminder", "family": "consensus_public", "followUpReminder": true, "fullAgreement": false, "id": "open-massive-zh-CN-7172", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "83e6d4030a98eb8cedca71f49c57fd4055e2aa87aa05ce82b82dfb6b696c7b8b", "cursor-grok-4.6-xhigh": "aaddcdb540636646c20ed2a4e19f958aec65994d8b0ed87d98e96194b9d15631", "gpt-5.6-luna-medium": "c0aa41e817c9ec43fb087c57cdcb3eb86f56d833baec425e3402d011a115ed8c"}, "labelerVotes": {"followUpReminder": 3, "question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-7172", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "李雷想周日十一点会面你能在每周周六晚上提醒我吗"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-7283", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "0b13d52ffc77a02601bf1b3129ab7fcaf21d0b73b7c3f6dcfc94c2206d51ea76", "cursor-grok-4.6-xhigh": "0b13d52ffc77a02601bf1b3129ab7fcaf21d0b73b7c3f6dcfc94c2206d51ea76", "gpt-5.6-luna-medium": "a975bc07a96d0f8d6b6e7b723c6cd79f75e9f64f8011f4e33eebed7d29ce194a"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-7283", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": true, "text": "删除我的一点半的预约"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-7466", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "fe28ba73648b3ef40c959e819e6b0f4a42b818f7c459d7b85b071ffb6886a6da", "cursor-grok-4.6-xhigh": "8ed0b38e7539a370589415556f85907f59976e211b85c490d02f55f6240a7c8a", "gpt-5.6-luna-medium": "ad5b3b9340f19dc0bc789c6390c18c43d0f8d732b244092c030cec75abac7661"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-7466", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "告诉我现在正在发生的事件"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-7874", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "e5878b27c4373e5779116065cd614d1f7194e89088185a82ada37edd0308bfae", "cursor-grok-4.6-xhigh": "54cbf182f08ab06fd3dc08a07de8612984f16b301894e0c84bdacc3faa9f916b", "gpt-5.6-luna-medium": "d6691c3a7c7a93e4f34822056932d875aa211a4d667864e139bc8397cf55d45e"}, "labelerVotes": {"replyableMessage": 1, "scheduleNegotiation": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-7874", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "从现在开始的三天我需要和李强安排一个活动"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-8092", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "8baa62047c2a0494c851c138dcfc80dccc669a03faf52ae9ebed48058c441c58", "cursor-grok-4.6-xhigh": "5c5b969358bb9dbd3455b91272c863cfb1332b563f67ad4ec407d031e3cf23ca", "gpt-5.6-luna-medium": "409b445bba1c3f2a11f53134f33464d2135afd8881257aaea82599b42f130459"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-8092", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "周日白天我有空吗"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-8228", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "501b32bdd945dff4641608fa00b9a15e35551981d74374d30ea0c7ecfc2f4990", "cursor-grok-4.6-xhigh": "b00d8175b37600d0f32010792c77df3cd2b92f110b47b25982aa4fce253fb25c", "gpt-5.6-luna-medium": "aeb9a994539cf6700e806b447758f8c66cd11d323186f55ad08e049ddbe5a647"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-8228", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "我的星期五什么时候开会"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-8313", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "7c32d7226723d986101c95cab8dc422946856eb58f169d6991b8ccb09158de48", "cursor-grok-4.6-xhigh": "8a98672e872810e8301b839b8d63f006fb26c47607b164cf395fe88530dcdd90", "gpt-5.6-luna-medium": "774bba55252e1c95bc76182055ee1f98170a63ca5c06b2cb01ac8e152c7da51b"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-8313", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": false, "text": "苏珊的生日是三月一日吗"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-8505", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "668bad91b07daecb71c50a633132f40b16942fb7aa6fbfa66319c1a0f9e6af89", "cursor-grok-4.6-xhigh": "25379c9a49fbb45d111f7647f092ba549c6b5c5af976432cfbf55499ae6ad137", "gpt-5.6-luna-medium": "2af707d4fb6a6d88883884176dd6e48d0382f1a2c2a32db0abc2432630252a1c"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-8505", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": false, "text": "我的本月的日程表安排是什么"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-8845", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "8460a28e6cb61aec78e595ef68fd39b2830069374fbc851c9d7d91bcf8660689", "cursor-grok-4.6-xhigh": "2583c96280b15e7f75987c64d411bbf5935dd817ad5a4424e255ae8ae531f3fd", "gpt-5.6-luna-medium": "72efd95f2338832971c95fe8e62055f1a1fc18313902bf03d59dd612f1640f8c"}, "labelerVotes": {"task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-8845", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": true, "text": "清空我的日历"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-9091", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "558281e3bbffbfbc00c08b273a1e3434b2235dcd5989ef24e938a7712e28560e", "cursor-grok-4.6-xhigh": "2d2d05b9186c96449c95f905e4b8fb225b0c336b28b5231f11479df499914f26", "gpt-5.6-luna-medium": "87b555eba3cc241e6334c81d5adb08947b9b17e389cd0205bbfa2b4d53ad4445"}, "labelerVotes": {"task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-9091", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverAcceptance", "task": true, "text": "清除日历中的所有的事件"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>3a77afb0-10f7-4399-aed8-58512ae89fc5<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4612420854f87d448a7545da2d7ef5ab1fcc0665a0afdf96b41e9fd200ac0777", "cursor-grok-4.6-xhigh": "aa4a6643612f9f7f1f426f0210c33be8a9756a1f67ac49a689ae0909d1f55638", "gpt-5.6-luna-medium": "3efebab3d15d0f828507cb5abcaea506923ad35ac5919eb954c7045ed51c0aa5"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>3a77afb0-10f7-4399-aed8-58512ae89fc5<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L8868", "split": "silverCalibration", "task": true, "text": "can you check my seat assignment"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>42d376c2-ebd6-4c9f-8ad0-0859e3d93c60<TURN>6", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "773a7661d2b500bdab4332d0749a3c1fc08919c4d31d75b6e953ec48b966b082", "cursor-grok-4.6-xhigh": "442b437ffee2476c909cdc91222a4c059c04b2d5105bc47bb8d97793a205b75b", "gpt-5.6-luna-medium": "b001b16b032185f887785ce458e178ef9254c8638ddfa846ad568dea02afac11"}, "labelerVotes": {"confirmationDecision": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["confirmationDecision", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>42d376c2-ebd6-4c9f-8ad0-0859e3d93c60<TURN>6", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L542", "split": "silverTrain", "task": true, "text": "wow thats wonderful please gohead and confirm it"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>635cf5fe-c9c5-408c-9652-cff6470ff96e<TURN>1", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b8efa48670aa565346f74e2f9fd5cbdc389eac93b181a549ff4f4a9e4c43ac25", "cursor-grok-4.6-xhigh": "58371161e1b7bbc2f9176a8d4c23244901e442bd5177e8370a349c54bd454540", "gpt-5.6-luna-medium": "9bfe7b08e301552ec6f501302a595a34658125a7ff6875c2d846ab6099fb5fa5"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>635cf5fe-c9c5-408c-9652-cff6470ff96e<TURN>1", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L10103", "split": "silverTrain", "task": true, "text": "can you please tell me what my seat number is my confirmation number is hhd 542"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>7d7eb5fb-daf9-4b77-b00f-336a17ad05ef<TURN>14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6819faa0c6cc7962f08bd6001fc24a2309953e08dfe03259f80e95ef92ff570e", "cursor-grok-4.6-xhigh": "cbc1981454b49156238a319969d62aeea99bdad19f42b7a9e5da69dcf9d23ce1", "gpt-5.6-luna-medium": "0b2130fbbb06755b833cf716b53876dec16d3fc0dbd79ab74194c69c638f4633"}, "labelerVotes": {"blessing": 1, "confirmationDecision": 1, "replyableMessage": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": true, "replyableMessage": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>7d7eb5fb-daf9-4b77-b00f-336a17ad05ef<TURN>14", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L10945", "split": "silverTrain", "task": false, "text": "have a perfect day good bye"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>9115a2cc-b065-4f38-99bf-4f4644f769ad<TURN>12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0cf8f92939dc75932ec86674a4b24d3a9f0d3572b658ce1b0d4f786a998bf9bc", "cursor-grok-4.6-xhigh": "c7caea3cf44a2dac3f5bad92ca7f1c6201421e10d2aa4b1796c252eecea6b3b9", "gpt-5.6-luna-medium": "9cca621b459b1fcbd08da4ee859f7add10d324c97bf770572f8bd5333058a949"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>9115a2cc-b065-4f38-99bf-4f4644f769ad<TURN>12", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L4721", "split": "silverAcceptance", "task": true, "text": "will you change the window seat to aisle"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>96c056ed-0abb-403d-ada5-b81067d9f0e1<TURN>1", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2432efc15936656eb41342f9f38fb7872827c4b1585ab7e027e7ee549dc6bbe5", "cursor-grok-4.6-xhigh": "c745387d223a89297ddb717c0d5889cdb411a14a0154d174181b804e41193d8b", "gpt-5.6-luna-medium": "6d975f6bbc358582c6c435688c03ef017b28af0d18054c063defd853c498412e"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>96c056ed-0abb-403d-ada5-b81067d9f0e1<TURN>1", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L13077", "split": "silverTrain", "task": true, "text": "tell me my seat number"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>cf339b58-1802-4ae6-9428-b5f1b726145b<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "3d02b648a99db70ea5c5a848cab5e80828dc2f4963860ec6d21c5eee7bb8f07d", "cursor-grok-4.6-xhigh": "c58b1b7854bccb6ea4d28453d29ca53a3f4bea3889a4352af619c7c3c2f59f29", "gpt-5.6-luna-medium": "28be1f07ded6b45bc27703736982057116977d9c8b02ee791c8069de05c49060"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>cf339b58-1802-4ae6-9428-b5f1b726145b<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L3790", "split": "silverTrain", "task": true, "text": "check my seat assignment"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>e7168567-9cc0-4852-a10b-6cc9f4bf90f1<TURN>10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "8b7bca9a3e10ddf97e6486857703ca560586f0e8cf9c5cabbad55185b04fe673", "cursor-grok-4.6-xhigh": "01b650fccdbbbb77ff27409be4cc4aa20091c7e292bc643017ebb460e9ebd0f3", "gpt-5.6-luna-medium": "648eaba1f98f98e24283ad447567da13343f4bc09ace5151dab94b9d2f6a33fb"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>e7168567-9cc0-4852-a10b-6cc9f4bf90f1<TURN>10", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L11108", "split": "silverTrain", "task": true, "text": "charlie sorry could you please change to window seat"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>ef984b73-87da-43c7-a01d-cf345a2b33a7<TURN>4", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4ce4c028625f526495845ed484738d797d51be30aa8195122d183eb7f2db1f0c", "cursor-grok-4.6-xhigh": "12375d9427d8b9013a8ed3e1f71aa0b88fc0ab614dda69b67f0501216d0025ce", "gpt-5.6-luna-medium": "a94e083275c2bd57449955ce716906e27f82cfe4902fda640a0112d3558570c5"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>ef984b73-87da-43c7-a01d-cf345a2b33a7<TURN>4", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L7057", "split": "silverTrain", "task": true, "text": "can you send it to my email"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-multidogo-airline-<CONV>f5483ab2-6ef0-4423-9452-ceaa6567bac2<TURN>16", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d6e6efbe1f49dee31a8f56b97e62cc05370da9d0aa0b98066c27a8308a5d841c", "cursor-grok-4.6-xhigh": "65f7fe096ab0333587a4412955ce94831b7c604b2d1f2c8ae140ebb7350b333d", "gpt-5.6-luna-medium": "25d2f56b262e75b89e974d85fce7a84601635db7fa23e2614177757fc0881467"}, "labelerVotes": {"replyableMessage": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": true, "replyableMessage": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>f5483ab2-6ef0-4423-9452-ceaa6567bac2<TURN>16", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L7609", "split": "silverTrain", "task": false, "text": "have a nice daygood bye"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-fastfood-<CONV>3468c2d5-b656-4aae-bade-8450dbaa3838<TURN>3", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0f9d905d35a41953458341a805782253dafe127cc23b3723c2f8c1f9102ba4d8", "cursor-grok-4.6-xhigh": "bacf9ab5645d2b4cf6b0f60947fe0644cc602afe8d6ac794cf6399b4070f4362", "gpt-5.6-luna-medium": "a83ddd6e522b79f5c9aeaf85a9cae393cd27a03c7912eb8d16e3e5d0cc3c9c23"}, "labelerVotes": {"confirmationDecision": 3, "question": 2, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-fastfood-<CONV>3468c2d5-b656-4aae-bade-8450dbaa3838<TURN>3", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L8030", "split": "silverCalibration", "task": true, "text": "no thanks but can i get a side of large fries with it"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-fastfood-<CONV>691eed09-466e-42a9-aba4-e4f0865627b0<TURN>1", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e31b55465219e4231c728b8c78bf8b009e27b7cc8c15eea9f935710a0d084fbd", "cursor-grok-4.6-xhigh": "ab9dfd98a06d156b1f2410d256626a916336712935f761c35ac7729b584c8abb", "gpt-5.6-luna-medium": "e047ccfe23dccf093e8ed4a1fbe390635eedfee7a2adb6f808ae13c0a12b9b76"}, "labelerVotes": {"replyableMessage": 2, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-fastfood-<CONV>691eed09-466e-42a9-aba4-e4f0865627b0<TURN>1", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L1502", "split": "silverTrain", "task": true, "text": "i like to have a pizza"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-fastfood-<CONV>c8885516-5008-40f0-a83a-8bded8907f1f<TURN>10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "aa767fb24746f246ae3fa6a13e027c27cdbe52ebcc3ede204ea5bc3fef1e0a17", "cursor-grok-4.6-xhigh": "ba0f5d098d0b17b0b0df912b6975ecd12b1a43182386657011607a80f3f1e1c2", "gpt-5.6-luna-medium": "fa663d3d5b29443be58913334daceb84911d5eb8adebcf95b2798c1aa7c784a9"}, "labelerVotes": {"confirmationDecision": 1, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-fastfood-<CONV>c8885516-5008-40f0-a83a-8bded8907f1f<TURN>10", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L8908", "split": "silverTrain", "task": true, "text": "add fries medium with diet coke"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-fastfood-<CONV>cb6a933b-e78e-4f42-9859-072502b2a93d<TURN>9", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4c452466bb1af387405003f491139dd300447f81e023cf70b07adb3867c325fc", "cursor-grok-4.6-xhigh": "1c8faaa1a7a2a5a4882387b1cab82aead8e56cdc301917ac6a315dfd3dd016b4", "gpt-5.6-luna-medium": "321fc8d4b7b7db980395d6c860ffc35e8bd8c69aaa9c359d572b9329e7939c9c"}, "labelerVotes": {"confirmationDecision": 1, "question": 2, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-fastfood-<CONV>cb6a933b-e78e-4f42-9859-072502b2a93d<TURN>9", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L838", "split": "silverTrain", "task": true, "text": "thatll be all actually can i not have bbq drizzle on my pizza"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>06a5d4bf-582b-4153-9ed9-77174bdf1a3f<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e7eb65a3042ee8968bf7b1fe06fde8cccdcbf9f57f91034eb4b8440c37682c22", "cursor-grok-4.6-xhigh": "4cc8c4f52e3ed92b0fd37c718011edc29f5abf12fe50ef646f2b7a121df0d253", "gpt-5.6-luna-medium": "84bd282f09933a70f9a77a4a913ece75a504bcaa38ec57cb77d72b53a6e89196"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>06a5d4bf-582b-4153-9ed9-77174bdf1a3f<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L12502", "split": "silverTrain", "task": true, "text": "i want to know my account balance could you please help me with that"}
{"actionVerifierLabel": "both", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>09ea7462-4548-4190-bbf9-c8ef68eff2ff<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1963e06605e7cd47b33061c01812b226273618dc5c8842765aad2dd78bb841c9", "cursor-grok-4.6-xhigh": "4f72d2f421f5c27281d954fbea73cfdeb31446bfd0ce7177ae3fe62aad26c353", "gpt-5.6-luna-medium": "96e4b719f4fc338eccba62e8e02b1960d21a1a61c104cf7472ee8e9d4fabe94d"}, "labelerVotes": {"complaint": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>09ea7462-4548-4190-bbf9-c8ef68eff2ff<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L4004", "split": "silverTrain", "task": true, "text": "i want remove error bill in my credit card"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>2ddd9985-0297-41dc-bf9b-7da490ad27b2<TURN>4", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2203ad70283231f9cfee355a253677f0e54c77f669d5be4548f962a4c2053a19", "cursor-grok-4.6-xhigh": "70009c7fd6f57f0899c9d99fb12b036943b0cfec095187d6a603b64569eba6ef", "gpt-5.6-luna-medium": "8d4d967a8fc8171cce075dfcceb801de654d4d200189e449f3a16dd9c5141dc5"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>2ddd9985-0297-41dc-bf9b-7da490ad27b2<TURN>4", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L8153", "split": "silverTrain", "task": true, "text": "i need to block and apply the new card"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>4ff7ea74-7bf8-480f-b32e-796f981d4690<TURN>1", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "24ba70477626616a1a8f433c1fd2c24f0cd26320fb497e9b4de54ec9f0f1f1ca", "cursor-grok-4.6-xhigh": "bef0bdbfb10873b01ad4ee37a242f02ddb2510421ff9255844b85db8f8ce384c", "gpt-5.6-luna-medium": "4cb63526a05cf7d4479eef0ae0181a30bcfc672f6b55e6ee450a5522da3ec2a4"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>4ff7ea74-7bf8-480f-b32e-796f981d4690<TURN>1", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L3378", "split": "silverTrain", "task": true, "text": "i want to transfer money from one account to another"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>6a2c2e90-80e3-4bed-b1ae-e46352fad37e<TURN>5", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b71cf69e9464d42123f7498c8437a9c6a0af129edcab2470ad74ef1ce41e80c0", "cursor-grok-4.6-xhigh": "3b3c10c4cdde823c36c6a4d2984fb14e5be4251cd455be514008ab4c6d0bbb02", "gpt-5.6-luna-medium": "b68227c554f3644e002977e13fb875d02e23c97caadf3543299245cddbf1e526"}, "labelerVotes": {"confirmationDecision": 3, "question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>6a2c2e90-80e3-4bed-b1ae-e46352fad37e<TURN>5", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L1822", "split": "silverTrain", "task": true, "text": "yes please check my account balance of last four digit with 8523"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>6d8d6219-54cf-4a11-a20b-5e90bd74110d<TURN>1", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "467de566839bf90fea65748aae2ddd69632b55e9d4439a5c9f7277a6715e52a8", "cursor-grok-4.6-xhigh": "196e3181afdbd7aaa0d5ac9e40b7e47574872f00464fff7a8d4005074a3eadff", "gpt-5.6-luna-medium": "b094b77961e0ee99f60dea18d81e889e0acee565cd6a414163e1c2b577039fb1"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>6d8d6219-54cf-4a11-a20b-5e90bd74110d<TURN>1", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L5362", "split": "silverAcceptance", "task": true, "text": "hi drew i would like to close my account can you help me"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>768b9755-ae63-4468-b1c3-a7be9cb9de7d<TURN>13", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "70536df4674c50218c723a62075697b53ebf700dc5a7f2d45e228823841c42a6", "cursor-grok-4.6-xhigh": "6735d05777178a01fcf2616ae5d8efd7338243757a32d4a9c92a7c9eafc69042", "gpt-5.6-luna-medium": "24108d74eadaa00c05d6b205222007481d54985d92cd7a0c8afc7f25aae8f6c9"}, "labelerVotes": {"confirmationDecision": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>768b9755-ae63-4468-b1c3-a7be9cb9de7d<TURN>13", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L5877", "split": "silverTrain", "task": true, "text": "yesi need to order checks"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>8522ed9a-4478-4993-b129-312110d217b6<TURN>11", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "bad3776976a3d6cfbf3137521614bce5e8408caac0c09cfb6ed14d51e2c69bab", "cursor-grok-4.6-xhigh": "12709daaf453562fa2c72ad6fbef5b4bbcd4482b1cb71438459e873a6b1f0884", "gpt-5.6-luna-medium": "73137c92571447b03d9d062251f139489d2e563d3c2d6c91a920c13e471fc4aa"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>8522ed9a-4478-4993-b129-312110d217b6<TURN>11", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L1222", "split": "silverCalibration", "task": false, "text": "thankyou for telling this i want to know banks routing number"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>bad487db-c120-4b3d-bac9-7dc50ce5a70d<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4b514956465885ff2cd99a116de10934bacc0167af980473bf8b6cded3df5e10", "cursor-grok-4.6-xhigh": "8a60a3bb8d764d3fbe64798de555205c4648856fa1cad548c94aac495c72b290", "gpt-5.6-luna-medium": "a8eb454c10403bd6a79e741cb77341e706f53397f18cabd35085b00a6031fea0"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>bad487db-c120-4b3d-bac9-7dc50ce5a70d<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L12784", "split": "silverTrain", "task": true, "text": "can you please order a new credit card because my old one expired"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>d141b9e9-0157-47d4-a642-3378b12f6a9a<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a2d198c950a88eab927259da3be7a87d75d24a5e5b2ce3244cb08dd5d0103885", "cursor-grok-4.6-xhigh": "26f70276387d0124ee8899ee07cbd8c6cb3a2da319703670a99202c5b2bb3818", "gpt-5.6-luna-medium": "41e91e2579441efa27cb15503f91506ddcb513a8652c8e1324f5679a3c4d50fc"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>d141b9e9-0157-47d4-a642-3378b12f6a9a<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L10475", "split": "silverTrain", "task": true, "text": "my credit card was expiry can i apply new card"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>e8e210ba-ca6e-471a-b9e2-2f84e55ed499<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0a01428793f1ea0ace06360cd74aa6380df180b7929c7f5fb3b9ded1714e25b1", "cursor-grok-4.6-xhigh": "d9c569348fcdac478b76831b88e84f9816a9c7009908dc55601e510065eae970", "gpt-5.6-luna-medium": "5552f269b2162bd69c106c1d67381d4a08bfa168451688288fcfdff3709f13bd"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>e8e210ba-ca6e-471a-b9e2-2f84e55ed499<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L14075", "split": "silverCalibration", "task": true, "text": "find out the banks routing number"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>f53cc617-26d4-4eaa-be85-3d13a12c2d2c<TURN>0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1d82b3168bf0b710299b7eb65788e6c5778ccaed42f51bab006bd00f30ea704e", "cursor-grok-4.6-xhigh": "83c4313efe502b8bfd2e3c2af439e32f3ffccfeb5a3d0ec24129e7b43b2b3c0a", "gpt-5.6-luna-medium": "6e81b2fc5782ff62f27ad3f53ec7e0cb66c4c0f18e0f40f7dd1c7af0ec12b705"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>f53cc617-26d4-4eaa-be85-3d13a12c2d2c<TURN>0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L13213", "split": "silverTrain", "task": true, "text": "hello i would like to check my account balance please"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-media-<CONV>3269ff16-32ff-4d8d-8586-b178cd9a68a7<TURN>8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f9c5014f362fe8781bc8b0ff2f9490896ccdf9c3ece61af19107259e01b8b116", "cursor-grok-4.6-xhigh": "8712299c12c2628ce5179a85703b48bcf5d93a753f65a3083656562a3ef88420", "gpt-5.6-luna-medium": "90a388255fe80c816494f8b3b38099cf20874452615b0ea8bfb1981996315453"}, "labelerVotes": {"confirmationDecision": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["confirmationDecision", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-media-<CONV>3269ff16-32ff-4d8d-8586-b178cd9a68a7<TURN>8", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L9312", "split": "silverCalibration", "task": true, "text": "perfect please confirm the plan"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-media-<CONV>3dfcd6b8-b829-4e5b-a97c-e5d8120bd75b<TURN>3", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "93feb61390f6bf44136a851f3097d94fd904621b26a843d31839ff82c118933f", "cursor-grok-4.6-xhigh": "c2ce44ae7587194e2b4ab28170c72e5eae90668793ab15961b5eaf69df2f3ceb", "gpt-5.6-luna-medium": "27c579c675e10c5e24ec84578ec9594df9745df2824dd48d9eab9c059fa466cc"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-media-<CONV>3dfcd6b8-b829-4e5b-a97c-e5d8120bd75b<TURN>3", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L8688", "split": "silverAcceptance", "task": true, "text": "can you please help me to see my bill of my account"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-media-<CONV>58cd816a-5be6-45f2-9faa-484cd4222398<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "47bd1234185ea4fb6949748ee61ba92e1973765a113675430a504fbfd2897c40", "cursor-grok-4.6-xhigh": "476255d88b51313a5966d8d526ee0c968f25f33e5cb9f79f16b85641e4d7e22e", "gpt-5.6-luna-medium": "6891d5d50cb5e24fc0e061cafc7ff633a9172b2e7808b827b2d98841127a4e16"}, "labelerVotes": {"confirmationDecision": 3, "question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-media-<CONV>58cd816a-5be6-45f2-9faa-484cd4222398<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L3211", "split": "silverTrain", "task": true, "text": "yes can you know me the details about the internet service for my home"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-media-<CONV>8b07e256-f4bd-449a-ae6e-4362ce0ad51f<TURN>9", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "18924ae4b5b77c0c768f04128934b59aaedd0ca16c9489ae78e9a4db544198d6", "cursor-grok-4.6-xhigh": "6092ca0bbc347cd19a0071d9b46bb9d60c9b76c225643af3757165abc06accc2", "gpt-5.6-luna-medium": "a62326418201c59d1c5cf312494fddf2f7acca0f50939b75bb066ed53693f087"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-media-<CONV>8b07e256-f4bd-449a-ae6e-4362ce0ad51f<TURN>9", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L4315", "split": "silverTrain", "task": true, "text": "make a connection as soon as possible"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-media-<CONV>92aa2085-36e0-416f-b616-c5c26896b6f7<TURN>11", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7aa099df17427d2e29a55e0a510c166584930f47b2b5ac1beb94d504ae41fee6", "cursor-grok-4.6-xhigh": "2ff8e060455f61f0da9cf3128cb3f1b921a3dcd4946980d0b5190296e9adb4c9", "gpt-5.6-luna-medium": "42ae3f2e2c5d095598362372e8f64f407a3fc33ef8ffa41a29fea5e4505b41e0"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-media-<CONV>92aa2085-36e0-416f-b616-c5c26896b6f7<TURN>11", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L9277", "split": "silverTrain", "task": false, "text": "may i know this plan have internet option"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-software-<CONV>a7ddddb6-ff99-4d40-9f90-09b457f0152e<TURN>9", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6b66046ae5fec36aea29476f47f0c0172b10b9a8496038185f71e6d5be02dd26", "cursor-grok-4.6-xhigh": "0f796a706e254ec6eafc11545177e0ab6e86987d13d7098fe740c292c9ef88b0", "gpt-5.6-luna-medium": "a780fe81cee22f703f977838c1c870cf7b9bbc3fe7dd1f5c37705e88efd64507"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-software-<CONV>a7ddddb6-ff99-4d40-9f90-09b457f0152e<TURN>9", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/software/train.tsv#L12504", "split": "silverTrain", "task": true, "text": "also can you please check the global status of the server"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-software-<CONV>d885d685-6c06-4c0b-bee9-8255e87ea7bb<TURN>4", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "5c8a211664dfcc4434204d7bdf29ee8d417eb60d80c91206b6b7b03621351646", "cursor-grok-4.6-xhigh": "ad3f27ed1415a686ccce2f8ea872a1c7a93169c438d6fec23938eafdd0f57af3", "gpt-5.6-luna-medium": "7e84f31a791ed6a17a2278b0239505854eecd00f9497146ad42ab0508aa8de1a"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-software-<CONV>d885d685-6c06-4c0b-bee9-8255e87ea7bb<TURN>4", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/software/train.tsv#L4004", "split": "silverTrain", "task": true, "text": "please check my clobel status for my softwarews"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-software-<CONV>fff2c827-8a9e-4b5c-82be-b5edfd551a09<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "dc0bb217d5a5dbecab7ed84a3dfffa4aa74372f6c9f8964cef05ae919fde7efd", "cursor-grok-4.6-xhigh": "85a179c9879ba14121afbc37891a392415babdd820a899be6f66cdeb928ec8c8", "gpt-5.6-luna-medium": "66803d669525e354ecc820a0eebf6e4ffa94560a96a30d0021bb8bc3e2b1d677"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-software-<CONV>fff2c827-8a9e-4b5c-82be-b5edfd551a09<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/software/train.tsv#L363", "split": "silverAcceptance", "task": true, "text": "i want to purchase some keyboards"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-358f37c1-ff58-4a0b-baba-e13d2fd7e91a-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c0710fcd3ac359b1837587d3ee51ad67e9d8feaebf4109a68353bfdca6f25381", "cursor-grok-4.6-xhigh": "bdd31b988d071d4565bcd7941ecdd67cca771a33af6751c86b77ed73644d13ec", "gpt-5.6-luna-medium": "e87b22ff8b00ff6c90a12337c5b59a4387cbda696b15dd5ffcf71a78c19ece46"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-358f37c1-ff58-4a0b-baba-e13d2fd7e91a-12", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Could you please send it to my location?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-47a2fdac-9da1-43a8-a3db-9a69ec1f2c7e-16", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1d4bda7a9795679f135d93cc25505e44b433055b246a5973d66df998b5580186", "cursor-grok-4.6-xhigh": "377d7fd3aea13df0ffff39c771e3f52fe6b71fa1b24db9cd256e46b18e43b391", "gpt-5.6-luna-medium": "d7685bfc35ae60f32e2b89084ee28885dccb426b2eaf8939853b6371ce0e0ce4"}, "labelerVotes": {"confirmationDecision": 3, "question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-47a2fdac-9da1-43a8-a3db-9a69ec1f2c7e-16", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "Okay that's great is the order under my name?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-492c1586-03c4-4369-a672-e0279ffc5e0b-4", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9919c955ed15186b32c19ef298fa1ea3ba2e8f1b2efe0f67aef0823e645817a9", "cursor-grok-4.6-xhigh": "6f193cee4b73a78d9e36b0f57be045c1008099501ed056e38b15f1a1aa59f5b1", "gpt-5.6-luna-medium": "b9b432bd2a03118bf08962f02ede9e17fdb1cfa9070eb0b80ad05ff98ac17326"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-492c1586-03c4-4369-a672-e0279ffc5e0b-4", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "I have heard good things about The Chophouse. Can you make a reservation for me please?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-4e7f31e8-76dc-4b29-9e2b-f2cd33ec0f42-18", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "bef37f0f0f0d654ef67f1245c9076086141077b1e1003a056d3fb1efba71ab3f", "cursor-grok-4.6-xhigh": "914b144ee7a794da0d06b44bb9cb008b60a8ac1df30e50aa172e1491525f95fb", "gpt-5.6-luna-medium": "14663b30956aaca15d262d3587dea9b7cbcf0ee6abd727edc65ab4e8704b3091"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "scheduleNegotiation"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-4e7f31e8-76dc-4b29-9e2b-f2cd33ec0f42-18", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "What time do they close?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-514731c8-b1f8-4dfd-a576-b77467d3a2b4-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "3aa8a8cc3f0f8e12596e6845f279696d022dce15615a77afed905aac4f197bd8", "cursor-grok-4.6-xhigh": "a0a21138cd9844f2991b1c6f2fd4c95c1436fd558811b273a3c79f4d5139f0ea", "gpt-5.6-luna-medium": "fa9f98a04f2437d5198e91795cad20ac39eebdcf09685b25fbebe28e9ccc8349"}, "labelerVotes": {"confirmationDecision": 1, "question": 3, "replyableMessage": 1, "scheduleNegotiation": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-514731c8-b1f8-4dfd-a576-b77467d3a2b4-10", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "I see, is there an imax showing for Hellboy other than at 6pm?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-54b7e34e-93e7-4d80-a366-731d520e7af8-16", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4dfd21156b53d044516171cd9baceba4505d00969839f01db4311bc4b8f646ed", "cursor-grok-4.6-xhigh": "4c6d587b05b6528bde88ecd57d4e5bbdb7ff1e79ef593f4ae98d81826d39e690", "gpt-5.6-luna-medium": "72cb24c55110af1345c9d45027358ed7ce1ea4be2aa0beebed0a27af85ad1a16"}, "labelerVotes": {"confirmationDecision": 3, "question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-54b7e34e-93e7-4d80-a366-731d520e7af8-16", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": true, "text": "Ok can you go ahead and purchase 2?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-58708a29-00b4-4e9b-824c-de256c783820-6", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "89996230c277fcdb9099abf28251f6d4ee4ce2d574296603a3f446183710e004", "cursor-grok-4.6-xhigh": "40b4b25ee4f67e62c3daf6dba3b04581c519a6e7ef5facceb66e56cdfdbe7fe2", "gpt-5.6-luna-medium": "cc36d6c852964a91e851ecd95b7ae337e5b69948f7243c9c114e39e2b66d7972"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-58708a29-00b4-4e9b-824c-de256c783820-6", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverAcceptance", "task": true, "text": "I would like to know the availability of seats in the 9:00 p.m show. Could you please assist me with that?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-5bde0835-4643-4397-ae9d-7866888a62b7-14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6933f140aaa0b47565e8b1bb1a1d6f5ba3997cadae753f99387f98e0fe182b52", "cursor-grok-4.6-xhigh": "aa997270de50209165ed04641e28fe58be47f4027201e67d1d7dc3847f210084", "gpt-5.6-luna-medium": "29b55b678059f7dfb1abaf12929fab03584004cd756229c66dc3d2c50ae4cc44"}, "labelerVotes": {"confirmationDecision": 3, "question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-5bde0835-4643-4397-ae9d-7866888a62b7-14", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Great can you confirm the order?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-71869301-e89c-4484-a41f-9a7dde268dee-18", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "821a22645f41b2cca748851ff3b61fcaa139447814e2d420a29292b11a57d9a5", "cursor-grok-4.6-xhigh": "452cd8ebc6e65284210650cd4f7c4501cb67a22c7267fe5d94ae5c89fca74d08", "gpt-5.6-luna-medium": "37409ea757afbf03b9b86157f4bee3303dc5626bc622649e1469d05c4217f90b"}, "labelerVotes": {"confirmationDecision": 1, "question": 2, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-71869301-e89c-4484-a41f-9a7dde268dee-18", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "And can I also get a splash of pink lemonade in that?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-873fee8e-332d-43fe-bd42-cf9907e5940c-6", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.89, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "84bf8f46e9415f82e51e28feea8bb99de05ffe27c71445934b7caaa6cc975753", "cursor-grok-4.6-xhigh": "654d48a43f236e1c5ff32a5d09d09b16787b050adae61117f43014948b6c083a", "gpt-5.6-luna-medium": "f388b764164d4bbe2c89caa060afe93cd7dc2fd4d57c6afde556040d30306ec1"}, "labelerVotes": {"confirmationDecision": 2, "question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-873fee8e-332d-43fe-bd42-cf9907e5940c-6", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": false, "text": "I don't like Eggnog, do they have anything else?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-8b5b8bc8-da47-4f86-801d-2c05fa60aa3b-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ad6da1ad190ebdf7efe224ba95012f506f644a4d31a05e75195520466f321fa0", "cursor-grok-4.6-xhigh": "0c49486b8ea0c218dd95c9c2ee1f0be559d3375c4db785737884cfff38b05b72", "gpt-5.6-luna-medium": "5a81cf08cc6732e30708779a433e12e285837bebe6a64902fae219f999fe7522"}, "labelerVotes": {"confirmationDecision": 3, "question": 2, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-8b5b8bc8-da47-4f86-801d-2c05fa60aa3b-12", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "Yes. If there's no coconut milk, ask for oat milk. If there's no oat milk, almond milk. Got it?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "scheduleNegotiation", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-902d28b1-56a1-4249-ad4c-7ff84ea2ca26-8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7c7b3db27b0ee9b322310b7aa07cfd9c8ccf8237dce5e01b890a87d1adfc8a52", "cursor-grok-4.6-xhigh": "38699eb9dc2f9b135aa935499ccd3aa14deea0755167950e24163114f13a407b", "gpt-5.6-luna-medium": "d2f1578063f47e9ec35152e8bc1106cf894e076ad5fb2cff1cdcb8d5edab71a0"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "scheduleNegotiation": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": true, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-902d28b1-56a1-4249-ad4c-7ff84ea2ca26-8", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": false, "text": "How about 6:00 pm?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-970b1696-28b5-4e16-ba83-fb7e31445a30-4", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4a41eea52060e98acf45cf4d7947c955d1928558a9643fe5ea67a8d36f000b56", "cursor-grok-4.6-xhigh": "fd0858b3b07aba16c15af7902e4ed7f4ba7e9407cbddac3f3ff6ea78c4c06b17", "gpt-5.6-luna-medium": "caa3ad24f2f722e6f4040052cc1f7d82cbbcbd62e962ba82f0e663eca0df79c3"}, "labelerVotes": {"confirmationDecision": 1, "question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-970b1696-28b5-4e16-ba83-fb7e31445a30-4", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "I want an X-large supreme pizza please. But instead of green pepper can I get zucchini on that?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-98c53bef-df59-4ab1-bc8f-5c006c4671f8-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7787b3e1ccde009bb85d06caf615fa073f5d45ba8734b47f572d3dfd5999ccee", "cursor-grok-4.6-xhigh": "002d2294990518a683122a4b9a285e91e1b51cf16c3cb59ee88dd98e188495b5", "gpt-5.6-luna-medium": "a4b971252a549c02e68f6ad34eff87181528cab87bdb8858c7a41a50b31137bc"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-98c53bef-df59-4ab1-bc8f-5c006c4671f8-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverAcceptance", "task": true, "text": "Can you get me a Starbucks?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "scheduleNegotiation", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-a5a8569f-98b7-4054-94d7-941bbe5a74e7-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9392ded87edd1e1d012a9de5bcb7bb75885cba6ef532811bb0406b679c8f3e4d", "cursor-grok-4.6-xhigh": "f7b0045babbb643155612f665d605b7f96852d4481009107b56843403dfdba4a", "gpt-5.6-luna-medium": "994a1e983bbaea06d6413239748e788d9eac5fd9e00ecef9a72efbf8648b600e"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 3, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": true, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-a5a8569f-98b7-4054-94d7-941bbe5a74e7-10", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "If that doesnt work can you check what other times are available?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-a7a5fb3a-2bbe-4278-9e41-ff968fdd80af-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.89, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4c66f81323420409ecfcfbfaa3c5000bf433e9a66ac71d3ff2c7d8bea65dd162", "cursor-grok-4.6-xhigh": "2111b1d6fb5a3d09f0b42f9122568f6b0966aa57bd0d423b889f4dce78002655", "gpt-5.6-luna-medium": "fe5dfa4d89307aea36bea48361331ec2bdd5706406e5eb149423dd2d69ca11e4"}, "labelerVotes": {"confirmationDecision": 3, "question": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-a7a5fb3a-2bbe-4278-9e41-ff968fdd80af-10", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "Okay. Is there a patio outside?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-ab4f13a3-19ff-4af1-ad84-9bfd8465b25d-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4f89115a5d0b941ba638cb107d5360d0ab3f40e69addaa690201d35d5ada7a1b", "cursor-grok-4.6-xhigh": "4c612853235063887db8db63c8f1d5f3b2df2d445a23f79f0dc1df6c4ae020d5", "gpt-5.6-luna-medium": "cc29c455f88800e59f0a971bd82d5814d4f5fe479238426a4b3872202e683f49"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-ab4f13a3-19ff-4af1-ad84-9bfd8465b25d-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Hi. I am absolutely starving. Can you order me a pizza?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-ae3eadbe-8577-4a3a-adac-406c0a2a6515-14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7432fe5370ce4588ebc580946a8d8e184cd201b2a0b64f8f132d030a87b9e909", "cursor-grok-4.6-xhigh": "6cddabf8c3bf104041c37d71475305ee1bbeee84f1a1cd377272983740cc8c17", "gpt-5.6-luna-medium": "dc64aeff638d43a72b054411a603e8f6ececaf7edca401bfa3c29fb4b8d5e73c"}, "labelerVotes": {"confirmationDecision": 3, "question": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-ae3eadbe-8577-4a3a-adac-406c0a2a6515-14", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": false, "text": "Yes is there any other fees?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-b25c11f4-af49-4018-8e90-89ab7201786e-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "474733d7a64b136cacfa72c5ad2a7eaf3935820a8b921a9e1b0c11783e63b3ca", "cursor-grok-4.6-xhigh": "b7c2499234f9da45a4ffc3ebdf8aff55881e63ce072eed204151cd79fd5e1a7e", "gpt-5.6-luna-medium": "e081ba55047233a1f304fbfbada5225f88962f1e9b51632222747da7eb80ae29"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "scheduleNegotiation": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-b25c11f4-af49-4018-8e90-89ab7201786e-10", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Could you please ask them to have it ready at 6:00 pm?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-b3d79e61-eb01-4244-a3c2-baec23707a84-8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6d2d48f1c0e0d4db803fb36f22639ef5fb26dd432d58bd7344676c19e9a55933", "cursor-grok-4.6-xhigh": "c0822929decb8fe5eb75eacad27e873d77314e8feaf7ff1464df1e90fa48ee95", "gpt-5.6-luna-medium": "d946a7e004f194059564ad3445099080884b93a60f4a33742c7c6769d3178dd9"}, "labelerVotes": {"confirmationDecision": 3, "question": 2, "replyableMessage": 2, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-b3d79e61-eb01-4244-a3c2-baec23707a84-8", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "True. Okay, how about an iced caffe mocha?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-b6813ffb-6f52-4dcf-be61-dfb7889a5be7-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "be229ad22f7fb81a6b5268aaf5273d2cf5aa7d5f57f5411b00db85be95b070b9", "cursor-grok-4.6-xhigh": "98bc687fbd2d3d38a140abda9663bbb380b8a4dfca7e81e30ee9f7f3d031e56e", "gpt-5.6-luna-medium": "d2c04e2dd5e65734600927e78ab77d74db26ca5076dbe1503736cfdbc08a7d1e"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-b6813ffb-6f52-4dcf-be61-dfb7889a5be7-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Hello, I'm really feeling Starbucks today. Could you please order me a Iced Blonde Cinnamon Cloud Macchiato,?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "scheduleNegotiation", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-bc341386-1c38-48f7-9c06-9c7a49355f83-6", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "014fe0dfa2dcea90c3dfe19fb666f5609769a238d4963d6a1de9bda1edc01198", "cursor-grok-4.6-xhigh": "21235ed9b442f9b1d570430127b4fb56cbceb76f66f7948e8ec6fd8a5dccee5c", "gpt-5.6-luna-medium": "ffdfaf6da9d9c4901289d3f320dc73795977aac627b4e1a059adaf25ad2efdb0"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "scheduleNegotiation": 3, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": true, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-bc341386-1c38-48f7-9c06-9c7a49355f83-6", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": true, "text": "I checked with my friend and that is too late for us. Can you look into the movie US, my friend whats to see that one, around 4:00. So we can eat and shop, before the show?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-bf903ea2-2080-4d74-a457-c9a8b7aa5444-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1154bf052842758452f99a9e43eaa9c2528045abf47f646ac4ea25179fc32f04", "cursor-grok-4.6-xhigh": "ed091b83b08f3bd9a571f3925748c1e22d3e7468c3de36171c4e2e09068abb98", "gpt-5.6-luna-medium": "9ca5050f607520fa208e005a9a8569df1efc3f41f1f6a326c8a18633c805cdd4"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "scheduleNegotiation": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-bf903ea2-2080-4d74-a457-c9a8b7aa5444-12", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": false, "text": "What about 7?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-c102e26c-1aee-4a65-b5b1-c886b6b91f0d-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7da5d7559448bc31d7bb3f47a4bfb8d6586b1865c9485c356408ff26e9a622d3", "cursor-grok-4.6-xhigh": "1225bc99b1cfa76121683e4fec33b841af6bb082978c14e3bf7ce6bc607bf530", "gpt-5.6-luna-medium": "c81ab65454c459ed8908a5a867ab75cfcb1c7f6ff4e82cef4824181f179e2b7c"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-c102e26c-1aee-4a65-b5b1-c886b6b91f0d-12", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Actually can you change my order to something else?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-c1b054cb-ef63-427f-8f6f-7e68f697787e-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2715abd75db8fd30dab252de41a9944ea0aa73b78c0071df498b42af1691e3a2", "cursor-grok-4.6-xhigh": "907ab0ae9672101c2c370e9a0bb2d9d8e058c7e648de679c32c143f0c30fd25e", "gpt-5.6-luna-medium": "49bdb56299cdd45c8b7b76628d281ce43aac6ef80e1d3808c69966b9f7c52b1d"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-c1b054cb-ef63-427f-8f6f-7e68f697787e-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Hi I'm running late again and need to pick up supper on my way home. Can you call in a pizza order for me?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-c214b676-2b94-4a58-a2eb-f6dc0c95f5c6-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.78, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "28d9b285dc6e988825cf7e611084f9dfd277345c38c0aeec00e2688e248b66f9", "cursor-grok-4.6-xhigh": "bcff804872421ccbff4227cd807914d522bc35c32fa0c01e5741c0132c7cec13", "gpt-5.6-luna-medium": "2464a2fa8f2fb339452cb460f4f5c6108d62c5b473862f61057eeee49dec2ba5"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-c214b676-2b94-4a58-a2eb-f6dc0c95f5c6-10", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": true, "text": "Can you order Y for me please"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "scheduleNegotiation", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-c578ddb3-479f-427f-a614-90e02ff149d5-14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "eeb88ac76a87efbe279dd53e2e7d772526eb4aa44ccbd1134daa4ec31d86be7c", "cursor-grok-4.6-xhigh": "9e5f00d22a6ceb2523c1093f7ef8a4d277d2aad81aa7d4e98d8fe7d8ceb02dbd", "gpt-5.6-luna-medium": "29a6caf324ff4b003b97ed16483e050bb1ddb0fc3db24cfbfee1b93c5f9b9520"}, "labelerVotes": {"confirmationDecision": 1, "question": 2, "replyableMessage": 1, "scheduleNegotiation": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": true, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "scheduleNegotiation"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-c578ddb3-479f-427f-a614-90e02ff149d5-14", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "That is too late. What do they have available on Wednesday?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-c5a97940-d02e-4313-b34b-6862b65f56cc-6", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.89, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "5b9dbb053c1d9cf5ad2be51052829aed3e39f3d9e7d708a3922b4cf262b75613", "cursor-grok-4.6-xhigh": "da973b97e7fb1932b4cc70ab826d1dd5154d8e82daa132ebe6c3f3a1f1788c8f", "gpt-5.6-luna-medium": "e50f2820e09c656eb8ed4c12fbc919b69d2313685710b19e173648705bf53528"}, "labelerVotes": {"confirmationDecision": 3, "question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-c5a97940-d02e-4313-b34b-6862b65f56cc-6", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "Yes that would be great! How much is the fare?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-c86eb60b-b858-486f-af8c-957f3287cf51-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ceaf33325e0759dbb53f1a604c5b1f7cdc14d594ae3deffcd0a72ba2fa3bb220", "cursor-grok-4.6-xhigh": "32232726aed5998633fa85de35046afddc135019467577b3c0ea8c084a80b690", "gpt-5.6-luna-medium": "32232726aed5998633fa85de35046afddc135019467577b3c0ea8c084a80b690"}, "labelerVotes": {"question": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-c86eb60b-b858-486f-af8c-957f3287cf51-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "What are some really good Italian restaurants"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-cb365cb0-98da-47d9-b270-5824b1858ab7-8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.89, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e12bf40d3bd40b2a654d5d3875e61dbd3224c6bc990e783ed887f5f1f625dfb0", "cursor-grok-4.6-xhigh": "b5e9dd9c841a76d7831104137dcda510360b55b4b80eee49e3a64c1cfbf79ceb", "gpt-5.6-luna-medium": "fa54050e3799e6a1eaccd0effdc9047ef6a6150fbcc83f1e31bd14b3540ead9e"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 2, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-cb365cb0-98da-47d9-b270-5824b1858ab7-8", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": true, "text": "Can you tell me times for other locations?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-d118ebbc-561a-418b-bd5f-fd57b0126bd7-16", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "833bb23704a628caacd87ad3ddbd54d5a873d068bb3a62c12825685050af3106", "cursor-grok-4.6-xhigh": "f68f3a34ce2b5fb8d6ada7d8d9f163e76e8db4319a4c0f630fd90e617ae838eb", "gpt-5.6-luna-medium": "52ddc4f19ce41d9ff95def7d592e49cee327a69ee1a69312690c759d2057af9f"}, "labelerVotes": {"confirmationDecision": 1, "question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-d118ebbc-561a-418b-bd5f-fd57b0126bd7-16", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverAcceptance", "task": false, "text": "is it at 4:20"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "scheduleNegotiation", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-d37cee1f-7df1-4311-b4a6-34383c25643f-8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "60f1074112da5b3ef8e6bdf0a867809294960b57a1e903df27137a519fe9aac6", "cursor-grok-4.6-xhigh": "777918ce4373116159d6680658c0f9b914da1e7fc95bc070e43f7b4e77fc78fa", "gpt-5.6-luna-medium": "fd7b8a4481f8fe3747668d718538a10cddd1f192e1711db4ce09a0fdb377af03"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": true, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "scheduleNegotiation"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-d37cee1f-7df1-4311-b4a6-34383c25643f-8", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": false, "text": "what time would they have a table"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-d7abdbb2-d3ad-4506-bfe1-b2d125e82c50-6", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "8f747a2e32a12d1988267fcf48b5db7fe61aef8d7fcacccb6db21ed78f682690", "cursor-grok-4.6-xhigh": "2c7a92b3a3a32d97436e82445f484f93680951fa8cee57dc08071a390cd1bd13", "gpt-5.6-luna-medium": "b15922acbc3411aa53ac4012500042d1092d2a4a3e0a3279fa21114a357fc1e2"}, "labelerVotes": {"confirmationDecision": 2, "question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-d7abdbb2-d3ad-4506-bfe1-b2d125e82c50-6", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Oh yes. I almost forgot. Can you have them go easy on the sauce?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-dd438d00-2322-435a-9f4a-f1bca8c621c9-14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "50a47ad5ffd22a86f7884c5f699978d67f21548564e3c52e642816d930d3b54e", "cursor-grok-4.6-xhigh": "3236a1322370c79ef0846b37f08bba5229c5088f02b24489e6f51fadf8b29f97", "gpt-5.6-luna-medium": "19a98402ca59f3481c7f99cd727d27dc1f1ea01bd18293d53a91ac01d814348a"}, "labelerVotes": {"replyableMessage": 1, "scheduleNegotiation": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-dd438d00-2322-435a-9f4a-f1bca8c621c9-14", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Have them pick me up at 8 AM please."}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-eb85e2af-9bef-4e79-bc84-88f439100d30-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "864941f4d87791e56bedc0aad3f0e35d009b6a9b296f2326641536ed11eee02b", "cursor-grok-4.6-xhigh": "c13e944cfc6a53c928817f45b5c88b851ffd05f0a99a4b087752d3b008b6995c", "gpt-5.6-luna-medium": "26c75f5db8ad59e03188fbc4c2672ff4b75bdcf82b7cdf1f3189d743d88c26c4"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-eb85e2af-9bef-4e79-bc84-88f439100d30-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Hello! Can you order me a coffee from Starbucks?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-eceee47e-a4c9-431b-a730-a593873f8864-14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "cdce2ec1d8d74aac840a12eb55cd18fb72908c1717b181264117863a95592701", "cursor-grok-4.6-xhigh": "6383d76539d18d3a169715843c28a2d5d28f43d1342b409f20f6b7b3f04db02e", "gpt-5.6-luna-medium": "6383d76539d18d3a169715843c28a2d5d28f43d1342b409f20f6b7b3f04db02e"}, "labelerVotes": {"confirmationDecision": 2, "question": 2, "replyableMessage": 2, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-eceee47e-a4c9-431b-a730-a593873f8864-14", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Okay, can you text me the details?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-f0f8de86-fe25-4a62-87b6-aceb779ca6f4-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b1bd95c69b664f1b7471386c57de8498c8c26844d60db9d4b46cc9f97c9e937c", "cursor-grok-4.6-xhigh": "22ff159e61001fb8ebcfa0b17f8efdca4c19a8f484f3996c84c7b6d6decc7ef5", "gpt-5.6-luna-medium": "5d1dc3b329343b8432e86d102bc377107f7135c36a42da6e08526a527f3a5346"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-f0f8de86-fe25-4a62-87b6-aceb779ca6f4-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": true, "text": "Can you get me tickets for the movie US?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-fa9a9747-e85e-4341-9f8b-647191d75be0-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "527dd6d83097d49e10f25bd0e45858679bf48ed6ed65d0779a1a0119b220237e", "cursor-grok-4.6-xhigh": "0466c1b6cfeac0c524818fd232551aaaf60fa26910686ff0a6951842f3bdd08c", "gpt-5.6-luna-medium": "61a9a9ed882f4c00ceb1b54de0e894588f2e3f7a1e4b5021d089bb14714b131e"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-fa9a9747-e85e-4341-9f8b-647191d75be0-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverAcceptance", "task": true, "text": "Can you see if there are any available showings for Alita Battle Angel"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-fb4bb7ce-3cd8-418e-abf8-47c90098e97b-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2a8ddd91cf108891ea251f5fbdc8568bc97aedf16ba65feb2445ae93953a5423", "cursor-grok-4.6-xhigh": "e8dd52c724fd429b2dfa08dfc8c22eb3136e2d0d2495a1ca0e5c733aa2e39da8", "gpt-5.6-luna-medium": "a8677d8a13eb1045bedb1750a986a4a827c0441a6e43f3a7f60f8f7c6dfa28a9"}, "labelerVotes": {"confirmationDecision": 1, "question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-fb4bb7ce-3cd8-418e-abf8-47c90098e97b-10", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": false, "text": "Is an UberX listed?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-fd25ed51-e404-4a9b-bfdb-c86afc8fb09a-24", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.82, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "323fad176e8331e65208d5899fb3aa1b313b94cb17a91083b5c8b51dcf4fbb80", "cursor-grok-4.6-xhigh": "bf891237b5deb1a60ce4392ee9c329299845309d15d21eae5b480dc98b0edfd7", "gpt-5.6-luna-medium": "09ee7c2ed905ff4cc4637c1d0ab8ad31328169560e513341af4230606fb2cedf"}, "labelerVotes": {"confirmationDecision": 3, "question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-fd25ed51-e404-4a9b-bfdb-c86afc8fb09a-24", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "Okay do you think I can use the company card?"}
ModelTraining/ClipboardSemantics/Consensus/labeler-composer.jsonl
+360
View File
@@ -0,0 +1,360 @@
{"id": "open-asap-10502", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-11380", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-11481", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-1596", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-2210", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-22337", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-23523", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-23652", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-23742", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-23758", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-26227", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-27234", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-29777", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-30376", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-31166", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-31609", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-31889", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-31943", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-34345", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-34705", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-34899", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-35453", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-35476", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-35553", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-38143", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-38238", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-38674", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-39659", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-40660", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-40694", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-41080", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-41822", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-44699", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-45138", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-453", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-46343", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-5022", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-6345", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-7730", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-asap-9336", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-1777502", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-2555962", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-2701144", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-2986864", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-3001841", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-3073568", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-3169526", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-3258718", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-3315833", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-3431365", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-3558426", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-3577388", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-3747030", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-3828096", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-3858080", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-3919922", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-4063938", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-4075299", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-4140786", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-4232485", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-4386529", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-4613745", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-4758252", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-5094833", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-5123759", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-5296904", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-5342499", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-5430594", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-5546899", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-5594585", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-5843160", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-6061472", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-6122130", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-6461018", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-6684695", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-6854260", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-6977335", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-7054229", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-7352245", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-cfpb-7415516", "labels": ["complaint"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-clinc150-10654", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-clinc150-10760", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-clinc150-11032", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-clinc150-11158", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-clinc150-11549", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-clinc150-11599", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-clinc150-11661", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-clinc150-12331", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-clinc150-12431", "labels": ["question", "replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.88}
{"id": "open-clinc150-12583", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-clinc150-12742", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-clinc150-12891", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-clinc150-13091", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-clinc150-14078", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-clinc150-14311", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-clinc150-14562", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-clinc150-16", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-clinc150-1680", "labels": ["followUpReminder", "question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-clinc150-1839", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-clinc150-1890", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-clinc150-2341", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-clinc150-3", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-clinc150-3087", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-clinc150-3124", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-clinc150-3198", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-clinc150-4205", "labels": ["complaint", "replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.88}
{"id": "open-clinc150-4465", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-clinc150-4518", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-clinc150-4707", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-clinc150-4832", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-clinc150-4834", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-clinc150-5082", "labels": ["followUpReminder", "question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-clinc150-5463", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-clinc150-5959", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-clinc150-6", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-clinc150-6065", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-clinc150-6137", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-clinc150-7302", "labels": ["followUpReminder", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-clinc150-7969", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-clinc150-8619", "labels": ["followUpReminder", "question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-crosswoz-10586-8", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-10728-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-10871-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-11012-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-11109-6", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-11117-12", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-11374-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-11462-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-11677-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-11686-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-11766-8", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-11884-12", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-11953-12", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-crosswoz-11959-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-12429-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-158-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-1615-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-1626-12", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-1766-14", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-338-10", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-3595-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-4220-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-5259-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-5821-18", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-6343-2", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-7477-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-7576-10", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-7593-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-7671-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-crosswoz-8169-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-8242-16", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-8593-14", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-8657-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-9158-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-9404-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-9587-8", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-96-2", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-9637-24", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-9866-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-crosswoz-9886-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-goemotions-ed0miwo", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-goemotions-ed1at3i", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-goemotions-ed783v1", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-goemotions-edciwc1", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-goemotions-eddd68m", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.88}
{"id": "open-goemotions-edf80ua", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-goemotions-edhgfqz", "labels": ["question", "replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.85}
{"id": "open-goemotions-edi79i8", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-goemotions-edlfmm3", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-goemotions-edloxw1", "labels": ["replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.86}
{"id": "open-goemotions-edlqvvo", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-goemotions-edm0fy9", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.89}
{"id": "open-goemotions-edm2plp", "labels": ["blessing", "replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.84}
{"id": "open-goemotions-edqmahz", "labels": ["question", "replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.88}
{"id": "open-goemotions-eds3oe6", "labels": ["replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.87}
{"id": "open-goemotions-edumqtx", "labels": ["replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-goemotions-eduvcvy", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-goemotions-edw419k", "labels": [], "ambiguous": false, "quotedOrMeta": true, "confidence": 0.88}
{"id": "open-goemotions-edw9jvd", "labels": ["replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.86}
{"id": "open-goemotions-ee0ui7m", "labels": ["blessing", "replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.88}
{"id": "open-goemotions-ee2kfxs", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.89}
{"id": "open-goemotions-ee3h6wr", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-goemotions-ee75sip", "labels": ["blessing"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.85}
{"id": "open-goemotions-eeamw5i", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-goemotions-eefzuzt", "labels": ["replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.87}
{"id": "open-goemotions-eegulbi", "labels": ["replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.86}
{"id": "open-goemotions-eelizvv", "labels": ["replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.88}
{"id": "open-goemotions-eelsbey", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.89}
{"id": "open-goemotions-eeq8ddu", "labels": ["replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.85}
{"id": "open-goemotions-eer68if", "labels": ["replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.87}
{"id": "open-goemotions-eey0znf", "labels": ["question", "replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-goemotions-ef9kela", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.88}
{"id": "open-goemotions-efdaasf", "labels": ["blessing", "replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.86}
{"id": "open-goemotions-efdl4z2", "labels": ["replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.87}
{"id": "open-goemotions-efdnw2c", "labels": ["blessing"], "ambiguous": true, "quotedOrMeta": true, "confidence": 0.82}
{"id": "open-goemotions-efect26", "labels": ["question", "replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.87}
{"id": "open-goemotions-eff0egy", "labels": ["question", "replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.86}
{"id": "open-goemotions-eff5j9u", "labels": [], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.88}
{"id": "open-goemotions-efg2bx0", "labels": ["blessing", "replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.87}
{"id": "open-goemotions-efgtipz", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-massive-en-US-10112", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-en-US-10167", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-massive-en-US-10643", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-en-US-10663", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-massive-en-US-10874", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-massive-en-US-1092", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-en-US-11059", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-en-US-11228", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-massive-en-US-11637", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-massive-en-US-12321", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-massive-en-US-12474", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-massive-en-US-13327", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-massive-en-US-1348", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.97}
{"id": "open-massive-en-US-13889", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-massive-en-US-13920", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-en-US-14209", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-en-US-16203", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-massive-en-US-16640", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-massive-en-US-16722", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-massive-en-US-1727", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-en-US-213", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-massive-en-US-2130", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-massive-en-US-2732", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-en-US-2837", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-en-US-3765", "labels": ["followUpReminder", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-en-US-417", "labels": ["followUpReminder", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-massive-en-US-4610", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-en-US-5420", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-en-US-5470", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-massive-en-US-5745", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-en-US-5975", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-en-US-6911", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-en-US-7265", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-massive-en-US-7478", "labels": ["followUpReminder", "question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-en-US-8200", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-massive-en-US-8610", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.88}
{"id": "open-massive-en-US-8616", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-en-US-8738", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-en-US-910", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-massive-en-US-9960", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-zh-CN-10782", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-zh-CN-10918", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-zh-CN-11249", "labels": ["task"], "ambiguous": true, "quotedOrMeta": false, "confidence": 0.78}
{"id": "open-massive-zh-CN-11651", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-massive-zh-CN-12151", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-massive-zh-CN-12180", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-massive-zh-CN-12228", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-massive-zh-CN-12396", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-massive-zh-CN-12552", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-zh-CN-12922", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-zh-CN-1419", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-massive-zh-CN-1514", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-massive-zh-CN-15222", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-massive-zh-CN-15232", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-zh-CN-15390", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-massive-zh-CN-15526", "labels": ["complaint", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.88}
{"id": "open-massive-zh-CN-15682", "labels": ["question", "replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.84}
{"id": "open-massive-zh-CN-16006", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-massive-zh-CN-1609", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-zh-CN-16200", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-massive-zh-CN-16204", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-zh-CN-16986", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-massive-zh-CN-241", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-massive-zh-CN-2990", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.88}
{"id": "open-massive-zh-CN-4352", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-massive-zh-CN-5178", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-massive-zh-CN-5980", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-zh-CN-6418", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-massive-zh-CN-6804", "labels": ["followUpReminder", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-massive-zh-CN-709", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-massive-zh-CN-7172", "labels": ["followUpReminder", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-zh-CN-7283", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-zh-CN-7466", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-massive-zh-CN-7874", "labels": ["scheduleNegotiation", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-massive-zh-CN-8092", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-zh-CN-8228", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-zh-CN-8313", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-massive-zh-CN-8505", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-massive-zh-CN-8845", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-massive-zh-CN-9091", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-multidogo-airline-<CONV>3a77afb0-10f7-4399-aed8-58512ae89fc5<TURN>2", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-multidogo-airline-<CONV>42d376c2-ebd6-4c9f-8ad0-0859e3d93c60<TURN>6", "labels": ["confirmationDecision", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-multidogo-airline-<CONV>635cf5fe-c9c5-408c-9652-cff6470ff96e<TURN>1", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-multidogo-airline-<CONV>7d7eb5fb-daf9-4b77-b00f-336a17ad05ef<TURN>14", "labels": ["replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-multidogo-airline-<CONV>9115a2cc-b065-4f38-99bf-4f4644f769ad<TURN>12", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-multidogo-airline-<CONV>96c056ed-0abb-403d-ada5-b81067d9f0e1<TURN>1", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-multidogo-airline-<CONV>c1fd4c09-fcc8-4a9d-812f-97cc14b71f5c<TURN>12", "labels": ["replyableMessage"], "ambiguous": true, "quotedOrMeta": false, "confidence": 0.75}
{"id": "open-multidogo-airline-<CONV>cf339b58-1802-4ae6-9428-b5f1b726145b<TURN>2", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-multidogo-airline-<CONV>e7168567-9cc0-4852-a10b-6cc9f4bf90f1<TURN>10", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-multidogo-airline-<CONV>ef984b73-87da-43c7-a01d-cf345a2b33a7<TURN>4", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-multidogo-airline-<CONV>f5483ab2-6ef0-4423-9452-ceaa6567bac2<TURN>16", "labels": ["replyableMessage"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-multidogo-fastfood-<CONV>1617bf7b-043e-49f5-a2b0-b194ab173a8c<TURN>5", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-multidogo-fastfood-<CONV>3468c2d5-b656-4aae-bade-8450dbaa3838<TURN>3", "labels": ["confirmationDecision", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-multidogo-fastfood-<CONV>691eed09-466e-42a9-aba4-e4f0865627b0<TURN>1", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-multidogo-fastfood-<CONV>787f5a4d-271c-4671-9134-53cb3d0572a2<TURN>5", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-multidogo-fastfood-<CONV>c8885516-5008-40f0-a83a-8bded8907f1f<TURN>10", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-multidogo-fastfood-<CONV>cb6a933b-e78e-4f42-9859-072502b2a93d<TURN>9", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-multidogo-finance-<CONV>06a5d4bf-582b-4153-9ed9-77174bdf1a3f<TURN>2", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-multidogo-finance-<CONV>09ea7462-4548-4190-bbf9-c8ef68eff2ff<TURN>2", "labels": ["complaint", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-multidogo-finance-<CONV>2ddd9985-0297-41dc-bf9b-7da490ad27b2<TURN>4", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-multidogo-finance-<CONV>4ff7ea74-7bf8-480f-b32e-796f981d4690<TURN>1", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-multidogo-finance-<CONV>6a2c2e90-80e3-4bed-b1ae-e46352fad37e<TURN>5", "labels": ["confirmationDecision", "question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-multidogo-finance-<CONV>6d8d6219-54cf-4a11-a20b-5e90bd74110d<TURN>1", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-multidogo-finance-<CONV>768b9755-ae63-4468-b1c3-a7be9cb9de7d<TURN>13", "labels": ["confirmationDecision", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-multidogo-finance-<CONV>8522ed9a-4478-4993-b129-312110d217b6<TURN>11", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-multidogo-finance-<CONV>bad487db-c120-4b3d-bac9-7dc50ce5a70d<TURN>2", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-multidogo-finance-<CONV>d141b9e9-0157-47d4-a642-3378b12f6a9a<TURN>2", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-multidogo-finance-<CONV>e8e210ba-ca6e-471a-b9e2-2f84e55ed499<TURN>2", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-multidogo-finance-<CONV>f53cc617-26d4-4eaa-be85-3d13a12c2d2c<TURN>0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-multidogo-media-<CONV>3269ff16-32ff-4d8d-8586-b178cd9a68a7<TURN>8", "labels": ["confirmationDecision", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-multidogo-media-<CONV>3dfcd6b8-b829-4e5b-a97c-e5d8120bd75b<TURN>3", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-multidogo-media-<CONV>58cd816a-5be6-45f2-9faa-484cd4222398<TURN>2", "labels": ["confirmationDecision", "question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-multidogo-media-<CONV>7b50d813-22d4-47c5-a466-fda86fbe69b7<TURN>3", "labels": ["confirmationDecision", "task"], "ambiguous": true, "quotedOrMeta": false, "confidence": 0.8}
{"id": "open-multidogo-media-<CONV>8b07e256-f4bd-449a-ae6e-4362ce0ad51f<TURN>9", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-multidogo-media-<CONV>92aa2085-36e0-416f-b616-c5c26896b6f7<TURN>11", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-multidogo-software-<CONV>86eaf2de-044b-43de-8b2c-cd5ebf6d2c51<TURN>9", "labels": ["confirmationDecision"], "ambiguous": true, "quotedOrMeta": false, "confidence": 0.82}
{"id": "open-multidogo-software-<CONV>a7ddddb6-ff99-4d40-9f90-09b457f0152e<TURN>9", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-multidogo-software-<CONV>d885d685-6c06-4c0b-bee9-8255e87ea7bb<TURN>4", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-multidogo-software-<CONV>db0edc0f-4148-45ba-ab7b-94dc09020618<TURN>4", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.88}
{"id": "open-multidogo-software-<CONV>fff2c827-8a9e-4b5c-82be-b5edfd551a09<TURN>2", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-taskmaster-dlg-358f37c1-ff58-4a0b-baba-e13d2fd7e91a-12", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-taskmaster-dlg-47a2fdac-9da1-43a8-a3db-9a69ec1f2c7e-16", "labels": ["confirmationDecision", "question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-taskmaster-dlg-492c1586-03c4-4369-a672-e0279ffc5e0b-4", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-taskmaster-dlg-4e7f31e8-76dc-4b29-9e2b-f2cd33ec0f42-18", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-taskmaster-dlg-514731c8-b1f8-4dfd-a576-b77467d3a2b4-10", "labels": ["confirmationDecision", "question", "scheduleNegotiation"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-taskmaster-dlg-54b7e34e-93e7-4d80-a366-731d520e7af8-16", "labels": ["confirmationDecision", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-taskmaster-dlg-58708a29-00b4-4e9b-824c-de256c783820-6", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-taskmaster-dlg-5bde0835-4643-4397-ae9d-7866888a62b7-14", "labels": ["confirmationDecision", "question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-taskmaster-dlg-71869301-e89c-4484-a41f-9a7dde268dee-18", "labels": ["confirmationDecision", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-taskmaster-dlg-873fee8e-332d-43fe-bd42-cf9907e5940c-6", "labels": ["confirmationDecision", "question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.89}
{"id": "open-taskmaster-dlg-8b5b8bc8-da47-4f86-801d-2c05fa60aa3b-12", "labels": ["confirmationDecision", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-taskmaster-dlg-902d28b1-56a1-4249-ad4c-7ff84ea2ca26-8", "labels": ["scheduleNegotiation"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-taskmaster-dlg-970b1696-28b5-4e16-ba83-fb7e31445a30-4", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-taskmaster-dlg-98c53bef-df59-4ab1-bc8f-5c006c4671f8-0", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.95}
{"id": "open-taskmaster-dlg-a5a8569f-98b7-4054-94d7-941bbe5a74e7-10", "labels": ["question", "scheduleNegotiation", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-taskmaster-dlg-a7a5fb3a-2bbe-4278-9e41-ff968fdd80af-10", "labels": ["confirmationDecision", "question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.89}
{"id": "open-taskmaster-dlg-ab4f13a3-19ff-4af1-ad84-9bfd8465b25d-0", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-taskmaster-dlg-ae3eadbe-8577-4a3a-adac-406c0a2a6515-14", "labels": ["confirmationDecision", "question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-taskmaster-dlg-b25c11f4-af49-4018-8e90-89ab7201786e-10", "labels": ["scheduleNegotiation", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-taskmaster-dlg-b3d79e61-eb01-4244-a3c2-baec23707a84-8", "labels": ["confirmationDecision", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-taskmaster-dlg-b6813ffb-6f52-4dcf-be61-dfb7889a5be7-0", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-taskmaster-dlg-bc341386-1c38-48f7-9c06-9c7a49355f83-6", "labels": ["scheduleNegotiation", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-taskmaster-dlg-bf903ea2-2080-4d74-a457-c9a8b7aa5444-12", "labels": ["scheduleNegotiation"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.88}
{"id": "open-taskmaster-dlg-c102e26c-1aee-4a65-b5b1-c886b6b91f0d-12", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-taskmaster-dlg-c1b054cb-ef63-427f-8f6f-7e68f697787e-0", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-taskmaster-dlg-c214b676-2b94-4a58-a2eb-f6dc0c95f5c6-10", "labels": ["task"], "ambiguous": true, "quotedOrMeta": false, "confidence": 0.78}
{"id": "open-taskmaster-dlg-c578ddb3-479f-427f-a614-90e02ff149d5-14", "labels": ["scheduleNegotiation"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.91}
{"id": "open-taskmaster-dlg-c5a97940-d02e-4313-b34b-6862b65f56cc-6", "labels": ["confirmationDecision", "question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.89}
{"id": "open-taskmaster-dlg-c86eb60b-b858-486f-af8c-957f3287cf51-0", "labels": ["question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-taskmaster-dlg-cb365cb0-98da-47d9-b270-5824b1858ab7-8", "labels": ["question", "scheduleNegotiation", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.89}
{"id": "open-taskmaster-dlg-d118ebbc-561a-418b-bd5f-fd57b0126bd7-16", "labels": ["confirmationDecision", "question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.88}
{"id": "open-taskmaster-dlg-d37cee1f-7df1-4311-b4a6-34383c25643f-8", "labels": ["question", "scheduleNegotiation"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-taskmaster-dlg-d7abdbb2-d3ad-4506-bfe1-b2d125e82c50-6", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.93}
{"id": "open-taskmaster-dlg-dd438d00-2322-435a-9f4a-f1bca8c621c9-14", "labels": ["scheduleNegotiation", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-taskmaster-dlg-eb85e2af-9bef-4e79-bc84-88f439100d30-0", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.96}
{"id": "open-taskmaster-dlg-eceee47e-a4c9-431b-a730-a593873f8864-14", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-taskmaster-dlg-f0f8de86-fe25-4a62-87b6-aceb779ca6f4-0", "labels": ["task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.94}
{"id": "open-taskmaster-dlg-fa9a9747-e85e-4341-9f8b-647191d75be0-0", "labels": ["question", "task"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.92}
{"id": "open-taskmaster-dlg-fb4bb7ce-3cd8-418e-abf8-47c90098e97b-10", "labels": ["confirmationDecision", "question"], "ambiguous": false, "quotedOrMeta": false, "confidence": 0.9}
{"id": "open-taskmaster-dlg-fd25ed51-e404-4a9b-bfdb-c86afc8fb09a-24", "labels": ["confirmationDecision", "question"], "ambiguous": true, "quotedOrMeta": false, "confidence": 0.82}
ModelTraining/ClipboardSemantics/Consensus/labeler-grok.jsonl
+360
View File
@@ -0,0 +1,360 @@
{"id":"open-asap-10502","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-asap-11380","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-asap-11481","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-asap-1596","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-asap-2210","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.92}
{"id":"open-asap-22337","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.99}
{"id":"open-asap-23523","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-asap-23652","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-asap-23742","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-asap-23758","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-asap-26227","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.99}
{"id":"open-asap-27234","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-asap-29777","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.99}
{"id":"open-asap-30376","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-asap-31166","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-asap-31609","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.99}
{"id":"open-asap-31889","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-asap-31943","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-asap-34345","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.99}
{"id":"open-asap-34705","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-34899","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-asap-35453","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-asap-35476","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.99}
{"id":"open-asap-35553","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-asap-38143","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-asap-38238","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-asap-38674","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.99}
{"id":"open-asap-39659","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.88}
{"id":"open-asap-40660","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-asap-40694","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-asap-41080","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-asap-41822","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-44699","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-asap-45138","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.99}
{"id":"open-asap-453","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-asap-46343","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.82}
{"id":"open-asap-5022","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.99}
{"id":"open-asap-6345","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-asap-7730","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-asap-9336","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-cfpb-1777502","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-cfpb-2555962","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-cfpb-2701144","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-2986864","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3001841","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-cfpb-3073568","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3169526","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-cfpb-3258718","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-cfpb-3315833","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-cfpb-3431365","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-cfpb-3558426","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3577388","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-cfpb-3747030","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-cfpb-3828096","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-cfpb-3858080","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-cfpb-3919922","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-4063938","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-cfpb-4075299","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-cfpb-4140786","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-4232485","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-4386529","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-4613745","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-cfpb-4758252","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-5094833","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-cfpb-5123759","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-cfpb-5296904","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-5342499","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-5430594","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-cfpb-5546899","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-cfpb-5594585","labels":["task","question","complaint","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.92}
{"id":"open-cfpb-5843160","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-6061472","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-cfpb-6122130","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-cfpb-6461018","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-cfpb-6684695","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-cfpb-6854260","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-6977335","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-cfpb-7054229","labels":["complaint"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.6}
{"id":"open-cfpb-7352245","labels":["complaint"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.85}
{"id":"open-cfpb-7415516","labels":["task","complaint","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-clinc150-10654","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-clinc150-10760","labels":["task","replyableMessage"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.8}
{"id":"open-clinc150-11032","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.92}
{"id":"open-clinc150-11158","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-clinc150-11549","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.88}
{"id":"open-clinc150-11599","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.92}
{"id":"open-clinc150-11661","labels":["task","replyableMessage"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-clinc150-12331","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-clinc150-12431","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-clinc150-12583","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-clinc150-12742","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.75}
{"id":"open-clinc150-12891","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-13091","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-clinc150-14078","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-clinc150-14311","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-14562","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-16","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-clinc150-1680","labels":["task","followUpReminder","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-clinc150-1839","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-clinc150-1890","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-clinc150-2341","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.88}
{"id":"open-clinc150-3","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.93}
{"id":"open-clinc150-3087","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-clinc150-3124","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-clinc150-3198","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-clinc150-4205","labels":["complaint","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-clinc150-4465","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-clinc150-4518","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-clinc150-4707","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-clinc150-4832","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-clinc150-4834","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-clinc150-5082","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.92}
{"id":"open-clinc150-5463","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-5959","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-clinc150-6","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.95}
{"id":"open-clinc150-6065","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-clinc150-6137","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-7302","labels":["task","followUpReminder"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-clinc150-7969","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-clinc150-8619","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.88}
{"id":"open-crosswoz-10586-8","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-crosswoz-10728-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-10871-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-11012-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-11109-6","labels":["question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.92}
{"id":"open-crosswoz-11117-12","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-crosswoz-11374-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-11462-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-11677-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-11686-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-11766-8","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-11884-12","labels":["task","confirmationDecision","replyableMessage"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-crosswoz-11953-12","labels":["task","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-crosswoz-11959-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-12429-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-158-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-1615-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-1626-12","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-1766-14","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-338-10","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-3595-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-4220-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-5259-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-5821-18","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.92}
{"id":"open-crosswoz-6343-2","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-7477-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-7576-10","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-crosswoz-7593-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-7671-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-8169-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-8242-16","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-crosswoz-8593-14","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-crosswoz-8657-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-9158-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-9404-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-9587-8","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-crosswoz-96-2","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-9637-24","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-9866-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-9886-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-goemotions-ed0miwo","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-goemotions-ed1at3i","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.8}
{"id":"open-goemotions-ed783v1","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.8}
{"id":"open-goemotions-edciwc1","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.82}
{"id":"open-goemotions-eddd68m","labels":["replyableMessage"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.55}
{"id":"open-goemotions-edf80ua","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-goemotions-edhgfqz","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-goemotions-edi79i8","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-goemotions-edlfmm3","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-goemotions-edloxw1","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.8}
{"id":"open-goemotions-edlqvvo","labels":["complaint","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-goemotions-edm0fy9","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-goemotions-edm2plp","labels":["blessing","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.8}
{"id":"open-goemotions-edqmahz","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.88}
{"id":"open-goemotions-eds3oe6","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-goemotions-edumqtx","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-goemotions-eduvcvy","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.8}
{"id":"open-goemotions-edw419k","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.9}
{"id":"open-goemotions-edw9jvd","labels":["complaint","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-goemotions-ee0ui7m","labels":["blessing","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.88}
{"id":"open-goemotions-ee2kfxs","labels":["confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-goemotions-ee3h6wr","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.88}
{"id":"open-goemotions-ee75sip","labels":["blessing","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.92}
{"id":"open-goemotions-eeamw5i","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-goemotions-eefzuzt","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-goemotions-eegulbi","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-goemotions-eelizvv","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.88}
{"id":"open-goemotions-eelsbey","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-goemotions-eeq8ddu","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-goemotions-eer68if","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-goemotions-eey0znf","labels":["confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-goemotions-ef9kela","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.8}
{"id":"open-goemotions-efdaasf","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-goemotions-efdl4z2","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.88}
{"id":"open-goemotions-efdnw2c","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.85}
{"id":"open-goemotions-efect26","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.92}
{"id":"open-goemotions-eff0egy","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-goemotions-eff5j9u","labels":["complaint","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.8}
{"id":"open-goemotions-efg2bx0","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-goemotions-efgtipz","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-massive-en-US-10112","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-10167","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-massive-en-US-10643","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-massive-en-US-10663","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-10874","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-1092","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-en-US-11059","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-massive-en-US-11228","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-11637","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-massive-en-US-12321","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-en-US-12474","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-massive-en-US-13327","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-en-US-1348","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-massive-en-US-13889","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-massive-en-US-13920","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-14209","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-massive-en-US-16203","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-16640","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-en-US-16722","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-1727","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-massive-en-US-213","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-massive-en-US-2130","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.8}
{"id":"open-massive-en-US-2732","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-en-US-2837","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-en-US-3765","labels":["task","followUpReminder"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-massive-en-US-417","labels":["task","followUpReminder"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-en-US-4610","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-massive-en-US-5420","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-massive-en-US-5470","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-massive-en-US-5745","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-massive-en-US-5975","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-massive-en-US-6911","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-en-US-7265","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-massive-en-US-7478","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-massive-en-US-8200","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-massive-en-US-8610","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-massive-en-US-8616","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.8}
{"id":"open-massive-en-US-8738","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-massive-en-US-910","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-massive-en-US-9960","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-massive-zh-CN-10782","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-zh-CN-10918","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.8}
{"id":"open-massive-zh-CN-11249","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-massive-zh-CN-11651","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.92}
{"id":"open-massive-zh-CN-12151","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-zh-CN-12180","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-zh-CN-12228","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-massive-zh-CN-12396","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-zh-CN-12552","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-zh-CN-12922","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-zh-CN-1419","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-massive-zh-CN-1514","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-zh-CN-15222","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.8}
{"id":"open-massive-zh-CN-15232","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-zh-CN-15390","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.75}
{"id":"open-massive-zh-CN-15526","labels":["task"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.9}
{"id":"open-massive-zh-CN-15682","labels":["question","replyableMessage"],"ambiguous":true,"quotedOrMeta":true,"confidence":0.7}
{"id":"open-massive-zh-CN-16006","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-zh-CN-1609","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-zh-CN-16200","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-zh-CN-16204","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-massive-zh-CN-16986","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-zh-CN-241","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-massive-zh-CN-2990","labels":["task","replyableMessage"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-massive-zh-CN-4352","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-zh-CN-5178","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-massive-zh-CN-5980","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-massive-zh-CN-6418","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-massive-zh-CN-6804","labels":["task","followUpReminder"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-massive-zh-CN-709","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-massive-zh-CN-7172","labels":["task","question","followUpReminder","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-zh-CN-7283","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-zh-CN-7466","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-massive-zh-CN-7874","labels":["task","scheduleNegotiation","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-massive-zh-CN-8092","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.92}
{"id":"open-massive-zh-CN-8228","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-massive-zh-CN-8313","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-zh-CN-8505","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-zh-CN-8845","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-zh-CN-9091","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-airline-<CONV>3a77afb0-10f7-4399-aed8-58512ae89fc5<TURN>2","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-multidogo-airline-<CONV>42d376c2-ebd6-4c9f-8ad0-0859e3d93c60<TURN>6","labels":["task","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-multidogo-airline-<CONV>635cf5fe-c9c5-408c-9652-cff6470ff96e<TURN>1","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-multidogo-airline-<CONV>7d7eb5fb-daf9-4b77-b00f-336a17ad05ef<TURN>14","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-multidogo-airline-<CONV>9115a2cc-b065-4f38-99bf-4f4644f769ad<TURN>12","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-airline-<CONV>96c056ed-0abb-403d-ada5-b81067d9f0e1<TURN>1","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-multidogo-airline-<CONV>c1fd4c09-fcc8-4a9d-812f-97cc14b71f5c<TURN>12","labels":["replyableMessage"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.4}
{"id":"open-multidogo-airline-<CONV>cf339b58-1802-4ae6-9428-b5f1b726145b<TURN>2","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-multidogo-airline-<CONV>e7168567-9cc0-4852-a10b-6cc9f4bf90f1<TURN>10","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-airline-<CONV>ef984b73-87da-43c7-a01d-cf345a2b33a7<TURN>4","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-multidogo-airline-<CONV>f5483ab2-6ef0-4423-9452-ceaa6567bac2<TURN>16","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.88}
{"id":"open-multidogo-fastfood-<CONV>1617bf7b-043e-49f5-a2b0-b194ab173a8c<TURN>5","labels":["confirmationDecision"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.65}
{"id":"open-multidogo-fastfood-<CONV>3468c2d5-b656-4aae-bade-8450dbaa3838<TURN>3","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-multidogo-fastfood-<CONV>691eed09-466e-42a9-aba4-e4f0865627b0<TURN>1","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-multidogo-fastfood-<CONV>787f5a4d-271c-4671-9134-53cb3d0572a2<TURN>5","labels":["confirmationDecision"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.65}
{"id":"open-multidogo-fastfood-<CONV>c8885516-5008-40f0-a83a-8bded8907f1f<TURN>10","labels":["task","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-multidogo-fastfood-<CONV>cb6a933b-e78e-4f42-9859-072502b2a93d<TURN>9","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.92}
{"id":"open-multidogo-finance-<CONV>06a5d4bf-582b-4153-9ed9-77174bdf1a3f<TURN>2","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>09ea7462-4548-4190-bbf9-c8ef68eff2ff<TURN>2","labels":["task","complaint","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-multidogo-finance-<CONV>2ddd9985-0297-41dc-bf9b-7da490ad27b2<TURN>4","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-multidogo-finance-<CONV>4ff7ea74-7bf8-480f-b32e-796f981d4690<TURN>1","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-multidogo-finance-<CONV>6a2c2e90-80e3-4bed-b1ae-e46352fad37e<TURN>5","labels":["task","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>6d8d6219-54cf-4a11-a20b-5e90bd74110d<TURN>1","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>768b9755-ae63-4468-b1c3-a7be9cb9de7d<TURN>13","labels":["task","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-multidogo-finance-<CONV>8522ed9a-4478-4993-b129-312110d217b6<TURN>11","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-multidogo-finance-<CONV>bad487db-c120-4b3d-bac9-7dc50ce5a70d<TURN>2","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>d141b9e9-0157-47d4-a642-3378b12f6a9a<TURN>2","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-multidogo-finance-<CONV>e8e210ba-ca6e-471a-b9e2-2f84e55ed499<TURN>2","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-multidogo-finance-<CONV>f53cc617-26d4-4eaa-be85-3d13a12c2d2c<TURN>0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-multidogo-media-<CONV>3269ff16-32ff-4d8d-8586-b178cd9a68a7<TURN>8","labels":["task","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-media-<CONV>3dfcd6b8-b829-4e5b-a97c-e5d8120bd75b<TURN>3","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-media-<CONV>58cd816a-5be6-45f2-9faa-484cd4222398<TURN>2","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-multidogo-media-<CONV>7b50d813-22d4-47c5-a466-fda86fbe69b7<TURN>3","labels":["task","confirmationDecision","replyableMessage"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.8}
{"id":"open-multidogo-media-<CONV>8b07e256-f4bd-449a-ae6e-4362ce0ad51f<TURN>9","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-multidogo-media-<CONV>92aa2085-36e0-416f-b616-c5c26896b6f7<TURN>11","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-multidogo-software-<CONV>86eaf2de-044b-43de-8b2c-cd5ebf6d2c51<TURN>9","labels":["confirmationDecision","replyableMessage"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.85}
{"id":"open-multidogo-software-<CONV>a7ddddb6-ff99-4d40-9f90-09b457f0152e<TURN>9","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-software-<CONV>d885d685-6c06-4c0b-bee9-8255e87ea7bb<TURN>4","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-multidogo-software-<CONV>db0edc0f-4148-45ba-ab7b-94dc09020618<TURN>4","labels":["replyableMessage"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.6}
{"id":"open-multidogo-software-<CONV>fff2c827-8a9e-4b5c-82be-b5edfd551a09<TURN>2","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.92}
{"id":"open-taskmaster-dlg-358f37c1-ff58-4a0b-baba-e13d2fd7e91a-12","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
{"id":"open-taskmaster-dlg-47a2fdac-9da1-43a8-a3db-9a69ec1f2c7e-16","labels":["question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-taskmaster-dlg-492c1586-03c4-4369-a672-e0279ffc5e0b-4","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-taskmaster-dlg-4e7f31e8-76dc-4b29-9e2b-f2cd33ec0f42-18","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-taskmaster-dlg-514731c8-b1f8-4dfd-a576-b77467d3a2b4-10","labels":["question","scheduleNegotiation","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-taskmaster-dlg-54b7e34e-93e7-4d80-a366-731d520e7af8-16","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-58708a29-00b4-4e9b-824c-de256c783820-6","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-taskmaster-dlg-5bde0835-4643-4397-ae9d-7866888a62b7-14","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-71869301-e89c-4484-a41f-9a7dde268dee-18","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-taskmaster-dlg-873fee8e-332d-43fe-bd42-cf9907e5940c-6","labels":["question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.92}
{"id":"open-taskmaster-dlg-8b5b8bc8-da47-4f86-801d-2c05fa60aa3b-12","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-taskmaster-dlg-902d28b1-56a1-4249-ad4c-7ff84ea2ca26-8","labels":["question","scheduleNegotiation","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-taskmaster-dlg-970b1696-28b5-4e16-ba83-fb7e31445a30-4","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-taskmaster-dlg-98c53bef-df59-4ab1-bc8f-5c006c4671f8-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-taskmaster-dlg-a5a8569f-98b7-4054-94d7-941bbe5a74e7-10","labels":["task","question","scheduleNegotiation","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-a7a5fb3a-2bbe-4278-9e41-ff968fdd80af-10","labels":["question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-taskmaster-dlg-ab4f13a3-19ff-4af1-ad84-9bfd8465b25d-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-taskmaster-dlg-ae3eadbe-8577-4a3a-adac-406c0a2a6515-14","labels":["question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-taskmaster-dlg-b25c11f4-af49-4018-8e90-89ab7201786e-10","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-taskmaster-dlg-b3d79e61-eb01-4244-a3c2-baec23707a84-8","labels":["question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
{"id":"open-taskmaster-dlg-b6813ffb-6f52-4dcf-be61-dfb7889a5be7-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-taskmaster-dlg-bc341386-1c38-48f7-9c06-9c7a49355f83-6","labels":["task","question","scheduleNegotiation","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-taskmaster-dlg-bf903ea2-2080-4d74-a457-c9a8b7aa5444-12","labels":["question","scheduleNegotiation","replyableMessage"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.8}
{"id":"open-taskmaster-dlg-c102e26c-1aee-4a65-b5b1-c886b6b91f0d-12","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-taskmaster-dlg-c1b054cb-ef63-427f-8f6f-7e68f697787e-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-taskmaster-dlg-c214b676-2b94-4a58-a2eb-f6dc0c95f5c6-10","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-taskmaster-dlg-c578ddb3-479f-427f-a614-90e02ff149d5-14","labels":["question","scheduleNegotiation","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.94}
{"id":"open-taskmaster-dlg-c5a97940-d02e-4313-b34b-6862b65f56cc-6","labels":["question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-c86eb60b-b858-486f-af8c-957f3287cf51-0","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-cb365cb0-98da-47d9-b270-5824b1858ab7-8","labels":["task","question","scheduleNegotiation","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.88}
{"id":"open-taskmaster-dlg-d118ebbc-561a-418b-bd5f-fd57b0126bd7-16","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-taskmaster-dlg-d37cee1f-7df1-4311-b4a6-34383c25643f-8","labels":["question","scheduleNegotiation","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.9}
{"id":"open-taskmaster-dlg-d7abdbb2-d3ad-4506-bfe1-b2d125e82c50-6","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-taskmaster-dlg-dd438d00-2322-435a-9f4a-f1bca8c621c9-14","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-taskmaster-dlg-eb85e2af-9bef-4e79-bc84-88f439100d30-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-taskmaster-dlg-eceee47e-a4c9-431b-a730-a593873f8864-14","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-f0f8de86-fe25-4a62-87b6-aceb779ca6f4-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.97}
{"id":"open-taskmaster-dlg-fa9a9747-e85e-4341-9f8b-647191d75be0-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-fb4bb7ce-3cd8-418e-abf8-47c90098e97b-10","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.95}
{"id":"open-taskmaster-dlg-fd25ed51-e404-4a9b-bfdb-c86afc8fb09a-24","labels":["question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.93}
ModelTraining/ClipboardSemantics/Consensus/labeler-luna.jsonl
+360
View File
@@ -0,0 +1,360 @@
{"id":"open-asap-10502","labels":["task","question","complaint","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-11380","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-11481","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-1596","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-2210","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-22337","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-23523","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-23652","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-23742","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-23758","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-26227","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-27234","labels":["task","question","complaint","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-29777","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-30376","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-31166","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-31609","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-31889","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-31943","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-34345","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.96}
{"id":"open-asap-34705","labels":["complaint","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-34899","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-35453","labels":["question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-35476","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-35553","labels":["task","question","complaint","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-38143","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-38238","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-38674","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-39659","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-40660","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-40694","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-41080","labels":["question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-41822","labels":["question","complaint","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-44699","labels":["question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-45138","labels":["task","question","complaint","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-453","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-46343","labels":["question","invitation","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-5022","labels":["question","complaint","scheduleNegotiation"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-6345","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-asap-7730","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-asap-9336","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-1777502","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-2555962","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-2701144","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-2986864","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3001841","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3073568","labels":["task","question","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3169526","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3258718","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3315833","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3431365","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3558426","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3577388","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3747030","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3828096","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3858080","labels":["task","question","complaint","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-3919922","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-4063938","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-4075299","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-4140786","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-4232485","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-4386529","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-4613745","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-4758252","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-5094833","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-5123759","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-5296904","labels":["question"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.96}
{"id":"open-cfpb-5342499","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-5430594","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-5546899","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-5594585","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-5843160","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-6061472","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-6122130","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-6461018","labels":["question","complaint","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-6684695","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-6854260","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-6977335","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-7054229","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-7352245","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-cfpb-7415516","labels":["task","question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-10654","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-10760","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-11032","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-11158","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-11549","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-11599","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-11661","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-clinc150-12331","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-12431","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-12583","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-12742","labels":["task"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.96}
{"id":"open-clinc150-12891","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-13091","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-14078","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-14311","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-14562","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-16","labels":["question"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.96}
{"id":"open-clinc150-1680","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-1839","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-1890","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-2341","labels":["task","question"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.96}
{"id":"open-clinc150-3","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-3087","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-3124","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-3198","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-4205","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-clinc150-4465","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-4518","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-4707","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-4832","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-4834","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-5082","labels":["task","question","followUpReminder"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-5463","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-5959","labels":["question"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-clinc150-6","labels":["task","question"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.96}
{"id":"open-clinc150-6065","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-6137","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-7302","labels":["task","question","followUpReminder"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-7969","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-clinc150-8619","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-10586-8","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-10728-0","labels":["task","question","invitation"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-10871-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-11012-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-11109-6","labels":["task","question","confirmationDecision","followUpReminder","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-11117-12","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-11374-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-11462-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-11677-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-11686-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-11766-8","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-11884-12","labels":["task","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-11953-12","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-11959-0","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-12429-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-158-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-1615-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-1626-12","labels":["task","question","invitation","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-1766-14","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-338-10","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-3595-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-4220-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-5259-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-5821-18","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-6343-2","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-7477-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-7576-10","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-7593-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-7671-0","labels":["task","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-8169-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-8242-16","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-8593-14","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-8657-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-9158-0","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-9404-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-9587-8","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-96-2","labels":["task","question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-9637-24","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-9866-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-crosswoz-9886-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-ed0miwo","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-goemotions-ed1at3i","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-ed783v1","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-goemotions-edciwc1","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-eddd68m","labels":["invitation"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-edf80ua","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-edhgfqz","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-edi79i8","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-edlfmm3","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-edloxw1","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-goemotions-edlqvvo","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.96}
{"id":"open-goemotions-edm0fy9","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-goemotions-edm2plp","labels":["blessing","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-edqmahz","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-eds3oe6","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-edumqtx","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-eduvcvy","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-edw419k","labels":["task"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.96}
{"id":"open-goemotions-edw9jvd","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-goemotions-ee0ui7m","labels":["question","blessing"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-ee2kfxs","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-ee3h6wr","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-ee75sip","labels":["blessing","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-eeamw5i","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-goemotions-eefzuzt","labels":["complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-eegulbi","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-goemotions-eelizvv","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-eelsbey","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-eeq8ddu","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-eer68if","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-eey0znf","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-goemotions-ef9kela","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-goemotions-efdaasf","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-efdl4z2","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-efdnw2c","labels":["question"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.96}
{"id":"open-goemotions-efect26","labels":["question"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.96}
{"id":"open-goemotions-eff0egy","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-eff5j9u","labels":["question","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-goemotions-efg2bx0","labels":["replyableMessage"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-goemotions-efgtipz","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-10112","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-10167","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-10643","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-10663","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-10874","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-1092","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-massive-en-US-11059","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-massive-en-US-11228","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-11637","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-12321","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-12474","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-13327","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-1348","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-13889","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-13920","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-14209","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-16203","labels":["question"],"ambiguous":false,"quotedOrMeta":true,"confidence":0.96}
{"id":"open-massive-en-US-16640","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-16722","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-1727","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-213","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-2130","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-2732","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-2837","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-3765","labels":["task","followUpReminder"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-417","labels":["task","followUpReminder"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-4610","labels":["question","scheduleNegotiation"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-5420","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-5470","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-5745","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-5975","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-6911","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-7265","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-7478","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-8200","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-8610","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-8616","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-8738","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-910","labels":["question","scheduleNegotiation"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-en-US-9960","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-zh-CN-10782","labels":["question"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-10918","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-11249","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-11651","labels":["question"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-12151","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-12180","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-12228","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-12396","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-12552","labels":["task","question"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-12922","labels":["question","scheduleNegotiation"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-1419","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-1514","labels":[],"ambiguous":true,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-massive-zh-CN-15222","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-15232","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-15390","labels":[],"ambiguous":true,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-massive-zh-CN-15526","labels":["task","complaint"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-15682","labels":["question"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-16006","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-1609","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-16200","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-massive-zh-CN-16204","labels":["task"],"ambiguous":true,"quotedOrMeta":true,"confidence":0.72}
{"id":"open-massive-zh-CN-16986","labels":["question"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-241","labels":["question"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-2990","labels":[],"ambiguous":true,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-massive-zh-CN-4352","labels":["question"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-5178","labels":["task","question","confirmationDecision"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-5980","labels":["scheduleNegotiation"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-6418","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-6804","labels":["task","followUpReminder"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-709","labels":["question"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-7172","labels":["task","question","followUpReminder"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-7283","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-7466","labels":["task","question"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-7874","labels":["task"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-8092","labels":["question","scheduleNegotiation"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-8228","labels":["question","scheduleNegotiation"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-8313","labels":["question"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-8505","labels":["task","question"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-massive-zh-CN-8845","labels":[],"ambiguous":true,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-massive-zh-CN-9091","labels":[],"ambiguous":true,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-multidogo-airline-<CONV>3a77afb0-10f7-4399-aed8-58512ae89fc5<TURN>2","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-airline-<CONV>42d376c2-ebd6-4c9f-8ad0-0859e3d93c60<TURN>6","labels":["task","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-airline-<CONV>635cf5fe-c9c5-408c-9652-cff6470ff96e<TURN>1","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-airline-<CONV>7d7eb5fb-daf9-4b77-b00f-336a17ad05ef<TURN>14","labels":["confirmationDecision","blessing","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-airline-<CONV>9115a2cc-b065-4f38-99bf-4f4644f769ad<TURN>12","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-airline-<CONV>96c056ed-0abb-403d-ada5-b81067d9f0e1<TURN>1","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-airline-<CONV>c1fd4c09-fcc8-4a9d-812f-97cc14b71f5c<TURN>12","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-airline-<CONV>cf339b58-1802-4ae6-9428-b5f1b726145b<TURN>2","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-airline-<CONV>e7168567-9cc0-4852-a10b-6cc9f4bf90f1<TURN>10","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-airline-<CONV>ef984b73-87da-43c7-a01d-cf345a2b33a7<TURN>4","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-airline-<CONV>f5483ab2-6ef0-4423-9452-ceaa6567bac2<TURN>16","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-fastfood-<CONV>1617bf7b-043e-49f5-a2b0-b194ab173a8c<TURN>5","labels":[],"ambiguous":true,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-multidogo-fastfood-<CONV>3468c2d5-b656-4aae-bade-8450dbaa3838<TURN>3","labels":["question","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-fastfood-<CONV>691eed09-466e-42a9-aba4-e4f0865627b0<TURN>1","labels":["replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-fastfood-<CONV>787f5a4d-271c-4671-9134-53cb3d0572a2<TURN>5","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-multidogo-fastfood-<CONV>c8885516-5008-40f0-a83a-8bded8907f1f<TURN>10","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-fastfood-<CONV>cb6a933b-e78e-4f42-9859-072502b2a93d<TURN>9","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>06a5d4bf-582b-4153-9ed9-77174bdf1a3f<TURN>2","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>09ea7462-4548-4190-bbf9-c8ef68eff2ff<TURN>2","labels":["task","complaint"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>2ddd9985-0297-41dc-bf9b-7da490ad27b2<TURN>4","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>4ff7ea74-7bf8-480f-b32e-796f981d4690<TURN>1","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>6a2c2e90-80e3-4bed-b1ae-e46352fad37e<TURN>5","labels":["task","question","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>6d8d6219-54cf-4a11-a20b-5e90bd74110d<TURN>1","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>768b9755-ae63-4468-b1c3-a7be9cb9de7d<TURN>13","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>8522ed9a-4478-4993-b129-312110d217b6<TURN>11","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>bad487db-c120-4b3d-bac9-7dc50ce5a70d<TURN>2","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>d141b9e9-0157-47d4-a642-3378b12f6a9a<TURN>2","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>e8e210ba-ca6e-471a-b9e2-2f84e55ed499<TURN>2","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-finance-<CONV>f53cc617-26d4-4eaa-be85-3d13a12c2d2c<TURN>0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-media-<CONV>3269ff16-32ff-4d8d-8586-b178cd9a68a7<TURN>8","labels":["task","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-media-<CONV>3dfcd6b8-b829-4e5b-a97c-e5d8120bd75b<TURN>3","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-media-<CONV>58cd816a-5be6-45f2-9faa-484cd4222398<TURN>2","labels":["task","question","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-media-<CONV>7b50d813-22d4-47c5-a466-fda86fbe69b7<TURN>3","labels":["task","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-media-<CONV>8b07e256-f4bd-449a-ae6e-4362ce0ad51f<TURN>9","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-media-<CONV>92aa2085-36e0-416f-b616-c5c26896b6f7<TURN>11","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-software-<CONV>86eaf2de-044b-43de-8b2c-cd5ebf6d2c51<TURN>9","labels":["task","confirmationDecision","replyableMessage"],"ambiguous":true,"quotedOrMeta":false,"confidence":0.72}
{"id":"open-multidogo-software-<CONV>a7ddddb6-ff99-4d40-9f90-09b457f0152e<TURN>9","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-software-<CONV>d885d685-6c06-4c0b-bee9-8255e87ea7bb<TURN>4","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-multidogo-software-<CONV>db0edc0f-4148-45ba-ab7b-94dc09020618<TURN>4","labels":[],"ambiguous":false,"quotedOrMeta":false,"confidence":0.7}
{"id":"open-multidogo-software-<CONV>fff2c827-8a9e-4b5c-82be-b5edfd551a09<TURN>2","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-358f37c1-ff58-4a0b-baba-e13d2fd7e91a-12","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-47a2fdac-9da1-43a8-a3db-9a69ec1f2c7e-16","labels":["task","question","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-492c1586-03c4-4369-a672-e0279ffc5e0b-4","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-4e7f31e8-76dc-4b29-9e2b-f2cd33ec0f42-18","labels":["task","question","scheduleNegotiation"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-514731c8-b1f8-4dfd-a576-b77467d3a2b4-10","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-54b7e34e-93e7-4d80-a366-731d520e7af8-16","labels":["task","question","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-58708a29-00b4-4e9b-824c-de256c783820-6","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-5bde0835-4643-4397-ae9d-7866888a62b7-14","labels":["task","question","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-71869301-e89c-4484-a41f-9a7dde268dee-18","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-873fee8e-332d-43fe-bd42-cf9907e5940c-6","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-8b5b8bc8-da47-4f86-801d-2c05fa60aa3b-12","labels":["question","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-902d28b1-56a1-4249-ad4c-7ff84ea2ca26-8","labels":["question","scheduleNegotiation"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-970b1696-28b5-4e16-ba83-fb7e31445a30-4","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-98c53bef-df59-4ab1-bc8f-5c006c4671f8-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-a5a8569f-98b7-4054-94d7-941bbe5a74e7-10","labels":["task","question","scheduleNegotiation"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-a7a5fb3a-2bbe-4278-9e41-ff968fdd80af-10","labels":["question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-ab4f13a3-19ff-4af1-ad84-9bfd8465b25d-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-ae3eadbe-8577-4a3a-adac-406c0a2a6515-14","labels":["question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-b25c11f4-af49-4018-8e90-89ab7201786e-10","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-b3d79e61-eb01-4244-a3c2-baec23707a84-8","labels":["question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-b6813ffb-6f52-4dcf-be61-dfb7889a5be7-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-bc341386-1c38-48f7-9c06-9c7a49355f83-6","labels":["task","question","scheduleNegotiation"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-bf903ea2-2080-4d74-a457-c9a8b7aa5444-12","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-c102e26c-1aee-4a65-b5b1-c886b6b91f0d-12","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-c1b054cb-ef63-427f-8f6f-7e68f697787e-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-c214b676-2b94-4a58-a2eb-f6dc0c95f5c6-10","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-c578ddb3-479f-427f-a614-90e02ff149d5-14","labels":["question","scheduleNegotiation"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-c5a97940-d02e-4313-b34b-6862b65f56cc-6","labels":["question","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-c86eb60b-b858-486f-af8c-957f3287cf51-0","labels":["question","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-cb365cb0-98da-47d9-b270-5824b1858ab7-8","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-d118ebbc-561a-418b-bd5f-fd57b0126bd7-16","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-d37cee1f-7df1-4311-b4a6-34383c25643f-8","labels":["question","scheduleNegotiation"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-d7abdbb2-d3ad-4506-bfe1-b2d125e82c50-6","labels":["task","question","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-dd438d00-2322-435a-9f4a-f1bca8c621c9-14","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-eb85e2af-9bef-4e79-bc84-88f439100d30-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-eceee47e-a4c9-431b-a730-a593873f8864-14","labels":["task","question","confirmationDecision","replyableMessage"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-f0f8de86-fe25-4a62-87b6-aceb779ca6f4-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-fa9a9747-e85e-4341-9f8b-647191d75be0-0","labels":["task","question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-fb4bb7ce-3cd8-418e-abf8-47c90098e97b-10","labels":["question"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
{"id":"open-taskmaster-dlg-fd25ed51-e404-4a9b-bfdb-c86afc8fb09a-24","labels":["task","question","confirmationDecision"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.96}
ModelTraining/ClipboardSemantics/Consensus/labeling-instructions-v2.md
-70
View File
@@ -1,70 +0,0 @@
# Clipboard semantic consensus labeling v2
Prompt version: `clipboard-consensus-v2`
Label each record independently using only its text. Do not infer missing
conversation history, and do not inspect source labels or other model outputs.
Return exactly one JSON object per input record:
```json
{
"id": "same id",
"labels": {
"task": "false",
"question": "false",
"invitation": "false",
"complaint": "false",
"scheduleNegotiation": "false",
"confirmationDecision": "false",
"followUpReminder": "false",
"blessing": "false",
"replyableMessage": "true"
},
"sentiment": "neutral",
"ambiguous": false,
"quotedOrMeta": false,
"confidence": 0.96
}
```
Every intent value must be `true`, `false`, or `unknown`. Use `unknown` when
the text alone does not contain enough evidence. Absence of evidence is not
automatically evidence of a negative label.
## Intent boundaries
- `task`: another person is explicitly requested or assigned to perform an
action. A personal plan is not a task.
- `question`: a genuine request for information. Rhetorical, quoted, search,
and documentation examples are not questions.
- `invitation`: an invitation to join an event, meeting, visit, meal, or social
activity.
- `complaint`: present dissatisfaction, malfunction, bad service, or an
unresolved problem. Negative sentiment alone is insufficient.
- `scheduleNegotiation`: proposing, changing, comparing, or choosing between
times. A fixed appointment or deadline alone is insufficient.
- `confirmationDecision`: explicit approval, rejection, commitment, or
selection of an option. Acknowledgment alone is insufficient.
- `followUpReminder`: a request to remind, check back, or follow up later or
after a trigger. An ordinary task with a deadline is insufficient.
- `blessing`: the author directly expresses a good wish, congratulation,
prayer, or hope for any recipient, including self or third parties.
- `replyableMessage`: a direct conversational message that naturally invites
a response. Terminal acknowledgments, personal notes, quoted examples, and
factual notices are negative.
Multi-label combinations are valid. For example, “Could you send the report?”
is `task + question + replyableMessage`.
## Special cases
- Set `quotedOrMeta = true` when intent-bearing language is quoted, reported,
searched, documented, requested as a writing example, or discussed rather
than performed.
- Set `ambiguous = true` when material context is missing or multiple
interpretations remain equally plausible.
- Sarcasm, negation, hypothetical future intent, and received thanks must be
interpreted semantically rather than by keyword matching.
- `sentiment` must be `positive`, `neutral`, `negative`, or `unknown`.
- Do not output reasoning, markdown, comments, or additional fields.
ModelTraining/ClipboardSemantics/Consensus/labeling-instructions-v3.md
-46
View File
@@ -1,46 +0,0 @@
# Clipboard semantic consensus labeling v3
Prompt version: `clipboard-consensus-v3`
Label each record independently using only its text. Do not infer missing
conversation history, and do not inspect source labels or other model outputs.
Return exactly one JSON object per input record using the schema from
`labeling-instructions-v2.md`.
## Product-approved boundaries
These rules override the corresponding v2 boundaries:
- Exclude commands that are clearly addressed to a device, app, search engine,
or virtual assistant rather than another person. Examples include opening an
inbox, playing music, changing device volume, or showing an account value.
Ordinary requests sent to another person remain in scope.
- `task`: a first-person need that implies an action is a task even when the
recipient is not explicit. A self-reminder is not a task. A device or virtual
assistant command is excluded before intent labeling.
- `question`: an invitation phrased as a question is not a `question`.
Request-shaped commands are also not information questions.
- `invitation`: an invitation phrased as a question is
`invitation=true`, `question=false`, and normally
`replyableMessage=true`.
- `complaint`: require an explicit expression of dissatisfaction, criticism, or
objection. A loss, theft, malfunction, or unresolved problem without
expressed dissatisfaction is not a complaint.
- `followUpReminder`: an explicit self-reminder is
`followUpReminder=true` and `task=false`.
- `blessing`: require an explicit wish, prayer, congratulation, or conventional
blessing. Generic encouragement, happiness for someone, optimism, or “good
luck”-free motivational language is not sufficient. Conventional expressions
such as “生日快乐”, “一路顺风”, “恭喜晋升”, “happy birthday”, and
“congratulations on the promotion” are explicit.
## Unchanged requirements
- Every intent value is `true`, `false`, or `unknown`.
- `sentiment` is `positive`, `neutral`, `negative`, or `unknown`.
- Set `quotedOrMeta=true` for quoted, reported, searched, documented, or
example-only intent language.
- Set `ambiguous=true` only when missing context materially prevents a stable
product label.
- Do not output reasoning, markdown, comments, or additional fields.
ModelTraining/ClipboardSemantics/Consensus/labeling-instructions-v4.md
-64
View File
@@ -1,64 +0,0 @@
# Clipboard semantic consensus labeling v4
Prompt version: `clipboard-consensus-v4`
Label from the text alone. Do not inspect source labels, model votes, or hidden
conversation history. The product owner decisions below override all earlier
versions.
## Record scope
Exclude text that is clearly a generic search, device control, app/account
query, alarm/calendar operation, or other virtual-assistant-only command.
Keep these in scope:
- a request to perform a real-world service that naturally needs confirmation,
such as booking a taxi;
- a request to communicate with a named recipient when the content to convey is
present;
- a private or shared-context information question that could naturally be sent
to another person, such as asking for a relative's email address.
If a short fragment does not contain enough evidence to distinguish a human
message from a query or command, keep it unresolved with `ambiguous=true` and
the affected intents set to `unknown`. Do not force it into the excluded or
negative class.
## Product intent boundaries
- `replyableMessage=true` when an in-scope interpersonal message naturally
supports a response. Questions, assignments, ongoing decisions, emotional
updates, and outcome sharing can be replyable.
- Terminal acknowledgments and thanks such as “知道了，谢谢” are not
replyable. A passive factual notice that creates no conversational next step
is also not replyable.
- `task=true` for an assigned action, an explicit first-person commitment, or a
first-person need that implies a personal action. A pure status question is
not a task.
- A request to email, text, or otherwise contact a named recipient is a
replyable task when the message content or purpose is included. A bare
command such as “call Mark” is ambiguous without more context.
- `question=true` for any genuine request for information, including an
imperative such as “tell me her email address”.
- A polite interrogative action request such as “Can you send the report?” is
both `task=true` and `question=true`. A question about when an existing task
will happen is `question=true`, `task=false`.
- A request for a recommendation is excluded when it is clearly a generic
assistant/search query rather than an interpersonal request.
- An invitation phrased as a question remains `invitation=true`,
`question=false`, and normally `replyableMessage=true`.
- An explicit self-reminder remains `followUpReminder=true`, `task=false`.
- A complaint still requires explicit dissatisfaction, criticism, or objection.
- A blessing still requires an explicit wish, prayer, congratulation, or
conventional blessing.
## Output states
- Intent values are `true`, `false`, or `unknown`.
- `sentiment` is `positive`, `neutral`, `negative`, or `unknown`.
- Use `ambiguous=true` only when missing context materially prevents a stable
product label.
- Use `quotedOrMeta=true` for quoted, reported, searched, documented, or
example-only intent language.
- Do not output explanations, markdown, comments, or additional fields.
ModelTraining/ClipboardSemantics/Consensus/labeling-instructions-v5.md
-39
View File
@@ -1,39 +0,0 @@
# Clipboard semantic consensus labeling v5
Prompt version: `clipboard-consensus-v5`
Apply every rule in `labeling-instructions-v4.md`, with the following
product-owner clarifications taking precedence.
## Replyable message clarifications
- “take your time” is an interpersonal supportive message:
`replyableMessage=true`, `task=false`.
- “知道了，谢谢” is terminal and not replyable.
- “活动规则按当前方案通过” is a passive decision notice and not replyable.
- Sharing a personal outcome such as “事情总算处理完了，结果居然成了” is
replyable even without a direct question.
- A private first-person need such as “I need to set up a new PIN” is a task
but not replyable unless it is addressed to another person.
## Task clarifications
- A first-person decision followed by an impersonal consequence is not
automatically an assignment. “我拍板先发布基础版，其他候选停止评估” is
replyable but not a task because it does not directly assign the recipient.
- A decision that explicitly hands off a next action is a task. “我批准退款流程
的最终版本，可以签字” is replyable and a task.
- Named-recipient communication with actual content is a replyable task:
“text Sarah that I'll be late” and “send an email to Julie that I can meet
Saturday” are both `replyableMessage=true`, `task=true`.
## Scope and ambiguity clarifications
- “tell me what's new” and “my claim status” are generic assistant/system
queries and must be excluded.
- A bare fragment such as “call Mark” does not reveal whether it is an
interpersonal assignment or an assistant command. Keep it unresolved:
`ambiguous=true`, with `replyableMessage`, `task`, and `question` all
`unknown`.
- Apply the same unknown treatment to other low-information fragments rather
than converting unspecified fields to `false`.
ModelTraining/ClipboardSemantics/Consensus/labeling-instructions-v6.md
-201
View File
@@ -1,201 +0,0 @@
# Clipboard semantic consensus labeling v6
Prompt version: `clipboard-consensus-v6`
Label each record independently from its text. Do not inspect source labels,
model votes, provenance, or hidden conversation history. This version keeps the
nine product intents from v5 and adds three routing intents plus one domain
field. Its definitions override earlier instructions when they conflict.
## Output schema
Return exactly one JSON object per input record:
```json
{
"id": "same id",
"labels": {
"task": "false",
"question": "false",
"invitation": "false",
"complaint": "false",
"scheduleNegotiation": "false",
"confirmationDecision": "false",
"followUpReminder": "false",
"blessing": "false",
"replyableMessage": "true",
"assistantCommand": "false",
"informationQuery": "false",
"systemNotification": "false"
},
"domain": "communication",
"sentiment": "neutral",
"ambiguous": false,
"quotedOrMeta": false,
"confidence": 0.96
}
```
Every intent value is `true`, `false`, or `unknown`. `domain` is one of the
twelve values below or `unknown`. `sentiment` is `positive`, `neutral`,
`negative`, or `unknown`. Do not output reasoning, comments, markdown, or
additional fields.
## Nine product intents
- `task`: a person is assigned or asked to perform an action, or the author
states an explicit personal commitment or need that implies action. A
request for a real-world service that naturally needs confirmation, such as
booking a taxi, restaurant, hotel, or ticket, is also a task. A status
question, self-reminder, passive decision notice, and pure device/app
operation are not tasks.
- `question`: a genuine interpersonal request for information. It includes
imperative requests such as “tell me her email address” when they could
naturally be sent to a person. Invitation questions and clearly generic
assistant/search/account queries are not questions.
- `invitation`: an invitation to join an event, meeting, visit, meal, or social
activity. A question-shaped invitation is normally also
`replyableMessage=true`, but `question=false`.
- `complaint`: explicit present dissatisfaction, criticism, objection, bad
service, or an unresolved problem framed as a complaint. A loss,
malfunction, negative fact, or negative sentiment without expressed
dissatisfaction is insufficient.
- `scheduleNegotiation`: proposing, changing, comparing, or choosing between
times. A fixed appointment, reminder time, or deadline alone is insufficient.
- `confirmationDecision`: explicit approval, rejection, commitment, or
selection of an option. Acknowledgment, receipt confirmation, and passive
status notice alone are insufficient.
- `followUpReminder`: an explicit request to remind, check back, or follow up
later or after a trigger, including a self-reminder. An ordinary task with a
deadline is insufficient; a self-reminder is not a `task`.
- `blessing`: the author directly expresses an explicit wish, prayer,
congratulation, or conventional blessing. Generic encouragement, optimism,
happiness for someone, quoted wishes, and requests to write a blessing are
insufficient.
- `replyableMessage`: an interpersonal message that naturally supports a
response. Questions, assignments, invitations, ongoing decisions, emotional
updates, and outcome sharing may qualify. Terminal acknowledgments or thanks,
private notes, passive factual notices, generic assistant interactions, and
machine notifications do not.
The v5 product-owner examples remain authoritative: “take your time” is
replyable but not a task; “知道了，谢谢” is terminal; personal outcome sharing
may be replyable; a private first-person need may be a task without being
replyable; and named-recipient communication with actual content is a replyable
task.
## Three routing intents
- `assistantCommand`: an instruction to a device, app, service, search engine,
or virtual assistant to perform a direct digital or device operation. This
includes opening or changing app state, alarms and calendar operations, media
playback, smart-home control, and immediate account/app settings. A
real-world service request that naturally needs confirmation remains a
`task`, even when submitted through an assistant.
- `informationQuery`: a generic assistant, search, reference, weather, account,
or service-status lookup that asks for information rather than asking a
person. “tell me what's new”, “my claim status”, and generic recommendation
searches qualify.
- `systemNotification`: machine- or service-generated status, alert, receipt,
security warning, delivery update, or other notification presented to the
user rather than authored as an interpersonal message.
These three labels replace the old blanket exclusion of assistant-only text.
Keep such records and label them explicitly. They are normally mutually
exclusive, and their clearly assistant/system-scoped records must not become
`task`, `question`, or `replyableMessage` merely because similar words could
occur in human conversation. Real-world bookings remain tasks. A request to
contact a named person with message content is interpersonal, not an
`assistantCommand`; a bare fragment such as “call Mark” remains ambiguous when
addressee and interaction mode cannot be determined.
## Domains
Choose the single primary subject or operation target:
- `finance`: banking, payments, cards, transfers, investments, insurance, or
claims.
- `travel`: transport, routes, tickets, hotels, trips, or reservations other
than restaurant bookings.
- `calendar`: dates, events, meetings, availability, alarms, reminders, or
scheduling.
- `communication`: calls, contacts, messages, email, social communication, or
interpersonal conversation.
- `media`: music, podcasts, radio, video, photos, news playback, or media
discovery.
- `smartHome`: lights, appliances, climate, locks, cameras, or other connected
home devices.
- `shopping`: products, orders, retail delivery, returns, refunds, or
marketplace activity.
- `dining`: restaurants, food, menus, takeaway, restaurant reservations, or
dining service.
- `health`: symptoms, care, medicine, fitness, wellbeing, or medical
appointments.
- `weather`: current conditions, forecasts, temperature, or weather alerts.
- `accountService`: login, identity, profile, PIN/password, subscription,
membership, entitlement, or general service support not better covered above.
- `generalKnowledge`: general facts, definitions, recommendations, and
non-specialized content that does not fit another domain.
Use the action target to resolve a cross-domain record: “text Sam about the
flight” is `communication`, while “is my flight delayed?” is `travel`. Use
`unknown`, not `generalKnowledge`, when missing context prevents a stable
choice.
## Unknown, ambiguity, and metadata
- Use `unknown` only when the text lacks enough evidence for that field. Do not
turn missing annotation or missing context into `false`.
- Use `false` when the field is in scope and the text provides enough evidence
that the intent is absent.
- Set `ambiguous=true` when missing context materially prevents a stable product
label. Set each affected intent and `domain` to `unknown`; unaffected fields
may still be resolved.
- Set `quotedOrMeta=true` when intent-bearing language is quoted, reported,
searched, documented, requested as a writing example, or discussed rather
than performed.
- Multi-label product combinations remain valid, such as
`task + question + replyableMessage` for an interpersonal “Could you send the
report?”
## `knownLabels` contract for corpus records
`knownLabels` is ingestion metadata, not part of labeler output. It lists only
the fields a source genuinely annotates after an audited deterministic mapping.
Allowed names are the twelve intent names, `domain`, and `sentiment`.
- A field in `knownLabels` may train from its resolved value, including an
explicit `false`.
- A field absent from `knownLabels` is `unknown` for training and contributes no
positive or negative loss.
- Source intent names, topic names, or missing columns must never be expanded
into negative labels for the rest of the taxonomy.
- A mapped source label may make only its audited target fields known.
Synthetic data must not claim all labels known merely because the generator
omitted them.
- Consensus or human review may add a field to `knownLabels` only after that
field receives a non-`unknown` decision under this taxonomy.
## Training-data boundary
- External data may enter candidate generation only when its commercial-use
rights and required notices are recorded, its immutable revision is pinned,
and it comes from the upstream official `train` split. Upstream validation,
development, test, challenge, and hidden-evaluation records never train.
- When an upstream source publishes only one split explicitly named `train`, it
may supply training candidates but may not supply OSGKeyboard calibration or
evaluation truth. If no official train designation exists, the source waits
in audit and is not locally re-split into eligibility.
- Exact and normalized near-duplicate overlap with any frozen local holdout is a
fatal exclusion. Privacy, credentials, direct contact data, unsafe content,
and unsupported language variants are filtered before labeling.
- Synthetic records are training-only, carry explicit synthetic provenance,
use sample weight at most `0.35`, and may know only the fields guaranteed by
their generation contract. They cannot enter calibration, evaluation, human
gold, or policy-anchor sets; cannot override a conflicting human or licensed
non-synthetic example; and cannot by themselves authorize a new boundary or
deployment threshold.
- Dataset admission means eligibility for the audited candidate queue, not
automatic inclusion in commercial training. Every generated artifact still
requires pinned license evidence, attribution, mapping review, deduplication,
and acceptance gates.
ModelTraining/ClipboardSemantics/Consensus/labeling-instructions.md
-27
View File
@@ -1,27 +0,0 @@
# Clipboard semantic consensus labeling
Prompt version: clipboard-consensus-v1
Label every JSONL queue record independently. Use only the text itself; do not
infer missing conversational context. Return one JSON object per input record:
{"id":"same id","labels":["task"],"ambiguous":false,"quotedOrMeta":false,"confidence":0.98}
Allowed labels:
- task: another person is explicitly asked/assigned to perform an action.
- question: a genuine information question, including request-shaped questions.
- invitation: invitation to join an event or social activity.
- complaint: present dissatisfaction, malfunction, bad service, or unresolved problem.
- scheduleNegotiation: proposing, changing, or choosing between times; a fixed time is not enough.
- confirmationDecision: explicit approval, rejection, or selection of an option.
- followUpReminder: request to remind, check back, or follow up later/after a trigger.
- blessing: a genuine birthday, holiday, congratulations, or good-wish message.
- replyableMessage: a direct conversational message that naturally invites a response.
Rules:
- Multi-label is allowed. "Could you send it?" is task + question + replyableMessage.
- Set quotedOrMeta when intent-like words are quoted, documented, searched, or discussed.
- Set ambiguous when the text cannot be labeled without missing context.
- Empty labels mean none of the product intents.
- Negative sentiment alone is not complaint. Fixed appointments are not schedule negotiation.
- Do not expose reasoning or add fields. Confidence must be between 0 and 1.
ModelTraining/ClipboardSemantics/Consensus/labeling-queue-report.json
-24
View File
@@ -1,24 +0,0 @@
{
"input": "ModelTraining/ClipboardSemantics/open-training-corpus.jsonl",
"languageCounts": {
"en": 240,
"zh-Hans": 120
},
"promptSHA256": "4bd3dbc01202f2a0c69c77ee30c66904889a31485fed3bc1944b286f9ab74cff",
"promptVersion": "clipboard-consensus-v1",
"queue": "ModelTraining/ClipboardSemantics/Consensus/labeling-queue.jsonl",
"recordCount": 360,
"schemaVersion": 1,
"seed": 20260827,
"sourceCounts": {
"AmazonScience/MASSIVE en-US": 40,
"AmazonScience/MASSIVE zh-CN": 40,
"CFPB via hpe-ai/customer-complaints": 40,
"CLINC150 UCI": 40,
"CrossWOZ": 40,
"Google Research GoEmotions": 40,
"Google Taskmaster-1": 40,
"Meituan-Dianping/ASAP": 40,
"MultiDoGO": 40
}
}
ModelTraining/ClipboardSemantics/Consensus/labeling-queue.jsonl
+360
View File
@@ -0,0 +1,360 @@
{"id": "open-asap-10502", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-10502", "text": "去年来吃过感觉还不错。今天又来吃,太黑太坑哪,再也不敢来了!最坑爹的是拆骨肉拌黄瓜,正常人看菜名会觉得拆骨肉有肉吧?25元的菜上来以后,就是一盘筋拌黄瓜,有的还咬不动。老板说了,牛后腿上拆下来的就是筋,和猪不一样。牛后腿没有肉?我书念的少你可不要骗我啊?!敢问你把肉弄哪里去了?没有肉,你菜名整什么拆骨肉,你叫拆蹄筋呗!欺骗消费者!早知道没肉我还不如点个拌牛肉才28。吃了一会听到他店里还有道菜叫拌蹄筋,我想知道和我点的拆骨肉有没有关系?是不是没有肉了,拿蹄筋顶替呢?欺负我一个小姑娘?***!牛肉汤也不如以前了,15元的大的,牛肉片,豆腐皮,粉丝这些都比以前少了很多,越做越不行了。"}
{"id": "open-asap-11380", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-11380", "text": "口味:菜上了之后就很失望,色面就很普通,味道也是很普通,每道菜都是很普通,都没有一道是满意的,木瓜酥难吃,虾饺像速冻的一样,金钱肚不入味,凤爪点错了,也是难吃,炒饭就和外面福建沙县里的炒饭的味道一样。\\\\n环境:开在公园里,至少开了10年的店,白天进来发现装修已经落后了,不过有一点好,就是人少,安静,但是!有一个大缺点就是地毯,地毯看得出很脏,空气中还弥漫了一股臭味。\\\\n服务:上个苏打水,拿了半天没来,上菜速度倒是可以,服务员一点精神都没有。\\\\n上次晚上来包房和家人聚餐时对这家店留下的印象还挺好,味道,服务,环境都不错,两年后来吃中饭,这里的点心真是让人失望,还是唐宫好吃"}
{"id": "open-asap-11481", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-11481", "text": "只能说这家店懂得网络营销,盲目的看大众点评真的是人云亦云,看点评来的,榆钱48,以为是本地特色才这个价钱3个人花了270,驴肉黄面特别渣,面软绵绵,菜茄辣西什么的也不好吃而且菜码特小,第二天包车去西线跟好心师傅唠一道,说我们被骗了,沙洲夜市就是糊弄外地人的,本地人都吃顺张,黄面12、3块特好吃,说本地的炒榆钱也就10来块钱,吃手把羊肉也就是本地白条就去靖远,烧烤就董记和老陆。本来还想看点评去老马,师傅说沙洲夜市那些都刷的又贵口味也不正宗。还推荐去腐败一条街的庙街党河边去吃烧烤,说那边好吃不贵,希望能帮到后来的朋友,今天敦煌最后一天了,决定再吃顿靖远或去董记和老陆选一家结束敦煌愉快的旅行!"}
{"id": "open-asap-1596", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-1596", "text": "一般餐厅里吃北京烤鸭,鸭肉都会被厨师或店家偷挖掉一些来给他们自己加菜或炒别的菜卖,这个应该是大家都知道的,但是你们有听过一条小小的鲈鱼也要被偷肉的吗?点了一份沸腾鱼,看到他们家有活的鲈鱼就要求把冰鲜鱼换成活鱼,他们说换活鱼要贵一点这也是理所当然的啊,后来当着我面捞了一条鲈鱼进厨房,我心里还在想这餐厅应该还是挺靠谱的,没想到菜端出来一吃,全是鱼鳞就算了,里面所有的鱼肉都是带着骨头在骨头边上一点点的肉,要不然就是鱼旗和鱼尾巴,里面就没有一片正常没有带骨头的鱼肉,鱼头也不知道跑那去了,这跟他们反应他们也不会承认的,肯定就说鱼头怕不卫生帮你拿掉了等这种坑爹借口!后来买单的时候还看到他们员工开始要准备吃饭了,这不用猜都知道肯定有鱼吃了!"}
{"id": "open-asap-2210", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-2210", "text": "下了火车,直奔这里,味道不算多好,跟北京差不多的店味道没有太大差异!汤,味道一般,中规中矩!肉,不太好吃,有点腥味!面,不够劲道,非常一般!辣椒油,还可以,但谈不上多惊艳!鸡蛋,非常不新鲜了,这个可以吃来!如果你没吃过正宗的牛肉面,这里可能会把你唬住!但如果,你后来在当地多吃了几家,你真会觉得这家很一般!服务态度,很恶劣,不跟你解释面条粗细的差异,也不想跟你多说,怎么取餐!可能人家在火车站旁边,根本不愁生意!总之,如果,你跟我一样是个吃货,在意食物,这家不太推荐!如果,你想吃饱,随便吃吃,还可以接受!只是服务不好!"}
{"id": "open-asap-22337", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-22337", "text": "总体来说,是不会再去第二次的消费地点。价格超级无敌的贵,菜品卖相很不好,很不精致,黑乎乎咸乎乎的,口味很差。专门去吃口味蛇,但是特别失望。口味蛇纯粹是被辣椒熬出来的,辣得无法张口,根本无法下咽。餐厅有一股霉味道,拥挤得很,还要收包厢服务费。。。餐前水果都变味了,变质了,放冰箱太久了。七个人花了1100多,真心不值这个价钱,建议大家千万不要去。之前有好多网上的好评论,可能都是他们花的钱,请的托,大家不要上当。。。"}
{"id": "open-asap-23523", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-23523", "text": "我实在不明白那些说好吃的人是怎么想的 说说我个人的看法 前餐 面包所谓好吃的面包 其实也是咸的要死 硬又难吃 !沙拉不用说也是咸 牛排更是咸 我本身是一个会吃咸的人还是完全不能接受 只有那个看起来很炫酷的大虾正常点 但也是非常一般的味道 我问了服务员是不是都那么咸 他自己也说本身就是满咸的 如果有中国人说这里东西好吃话!恭喜你是装逼高手!东西吃了一口勉强第二第三口就实在没办法再下口了 奉劝国人三思而行 !! 刚吃完怀着愤怒的心情点评"}
{"id": "open-asap-23652", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-23652", "text": "我是抽奖抽到一个海鲜锅。之前去过他家光华村那家店感觉很好,所以这次非常高兴的就前往了。结果感觉非常不好。首先这个海鲜锅并没有宣传照片上那么华丽,端上来直接就是一锅开水煮白菜放了几个虾、2个蛏子,搂底能看到下面有些虾皮和墨鱼仔须须。汤的味道并没有任何海鲜本来的味道,基本全是靠调味品勾兑的。感觉有点欺骗消费者不说,连起码的一点卖相都没有。不知道是这一家店是这样还是其他几家店都这样?让我对这家泰国鱼翅馆现在的阿诺泰仅存的好感荡然无存。此外,其他菜品的价位感觉都比正常价位贵一倍或者1/3。价格不亲民,东西没卖相。。。不知道以前泰国领事馆为啥还要推荐。。。而且,团购券折扣力度微乎其微周末还无法使用,让本来就很不实惠的消费更加不实惠。所以我只能给2星。"}
{"id": "open-asap-23742", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-23742", "text": "我真心觉得这个地方不好吃,就给两颗星吧。多一颗也不想给了。看了菜单是火锅和西餐的融合,我们都点了西餐那边就点的炸肌肉的丸子那种类型裹着面糊就是油炸类的小食,还点了意面跟番茄打卤面差不多了。说说火锅吧我们点的两个咖喱锅两个鲜虾锅,鲜虾锅里的鲜虾很鲜美很好吃汤煮到最后喝了一口还是不错的,咖喱锅没什么特色,觉得菜量一般般点了很多都放进了锅里吃吃就没了。四个人花了三百多用了优惠买单。是一个一般的餐馆不会再来这个点评也是时隔很久才来评价的我们吃完出去的时候外面居然还在排队,服务一般吧觉得服务员有点懵懵懂懂的感觉都是带孩子来吃的环境也是乱糟糟的一个一个锅子那种像呷哺火锅一样,一般般吧。不想再来了。"}
{"id": "open-asap-23758", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-23758", "text": "我第一次来这里,没就在星巴克旁边,离东山口地铁站口超近,交通便利。看评论说得很不错似的。只是吃完后感觉很差劲,不知道为什么那么多好评,不知道是不是点的东西不同还是什么原因了,反正印象太差,不会来第二次。\\\\n首先,这里的服务态度不佳,特别前台那个收银员,一点也不热情,问问题都不想答的模样,一副爱理不理的样子,反正我作为顾客很不爽。\\\\n说到点的东西,我点的是红豆薏仁黑豆花和黄金鸡翅,实在太无语了。首先两个卖相都不好,感觉很糟糕,自己煮都不会煮出这种卖相,至于味道吧,豆花一般,就是豆腐的味道的确很不错,其他很一般,而且份量不多,还有那个鸡翅,有4块,十分糟糕。不知道是用什么油来弄的,那种酱油味让人很反胃,自己做的鸡翅都比它好吃。这样一碗豆花15元,一碟鸡翅18元。太糟糕了,难吃。坑爹。。。。\\\\n虽然环境还算可以,比较静,又近电影院,但是应该没有下次。希望店家能改善一下出品质量。"}
{"id": "open-asap-26227", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-26227", "text": "最糟糕的一次团购经历。券上写明是提前2小时预约,10点打电话,说好12点到,到了之后店家居然说没听我们预约过,而我打电话的时候第一句话就说是预约498团购,虽然5分钟后店家收回了他们的说法,说是忙昏头忘了,好吧,一开始吃饭的气氛就被破坏了,后面还能好吗?然后就是漫长的等待,从12点等到2点,团购的菜也没上齐,一条鱼是足足等了2个小时才上,大家已经完全没胃口了,最后还是剩盐水鹅和时蔬没上,给孩子单点了一份蛋炒饭,也是快两个小时,经过无数次催促才胡乱炒了一份送上来。螃蟹偏小,吃口不好,其它菜也只能说是马马虎虎,完全不值一提,唯一好一点的还算店家道歉比较积。严重怀疑店家有自己刷榜的嫌疑,这个环境,口味,服务能力(怀疑烧菜厨师数量严重不足,造成上菜时间奇长),说是口碑是附近吃蟹店第一名,简直奇了怪了。最后还有件堵心的事,离店时店家不主动提供停车卡(在这里吃饭停车要店家给停车卡,否则路口要收停车费),害的我只能掉头回去又要了一次。"}
{"id": "open-asap-27234", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-27234", "text": "服务冷淡没激情!周末不可以用团购和各种优惠活动!!面包诱惑,冰淇淋很小,面包烤的焦黑,里面的方块面包都塌陷了!冰镇咕咾肉,招牌菜,菠萝被水泡久了没有味道,咕咾肉和糖醋里脊一样的味道,口感硬,冰块太多,菜品太少!清蒸鲈鱼,鱼非常小,而且酱油味道好重,偏咸!!唯一能吃的是那个炒笋,拿来下饭了!!唯一好的事下单19分钟内没上的菜免单!可能也是因为这个所以后来上的面包诱惑清蒸鲈鱼很难吃!!!即便是送的,也应该对得起你们老板的口号和品质吧?!!最后,如果说一家店你是在卖情怀,卖诚意,那么麻烦把饭菜品质提上去,要不很难有回头客!!一家装修有格调,但是很烂的店"}
{"id": "open-asap-29777", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-29777", "text": "火炉火芝士助排火锅之前已经和朋友们在爱琴海那家店吃过很多次了,感觉都不错才敢推荐同事来中关村这家店吃因为离上班很近!结果失望透顶,感觉都不会再吃了,完全颠覆以前的美好体验!\\\\n首先这家店很小,桌与桌间隔巨小,进出很不方便,聊天更不方便!我们四个人要了两个火锅套餐,结果桌子根本就放不下摆的乱七八糟的,都没地方下手!其次服务太差!因为食物完全没味道要点酱而已,结果被告知没有单独给的简直无语!他家冰沙是巨小一碗的,很多桌都希望吃完再上,结果他家完全不顾顾客感受非得统一时间每桌都上!\\\\n最最失望是食物本身,味道特别难吃跟爱琴海那家没得比!尤其是金枪鱼紫菜包饭,完全没味道!金枪鱼少的可怜,一盆里就看到一块而已!米饭也不新鲜,感觉就是在吃没有味道的很油的大米饭而已!"}
{"id": "open-asap-30376", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-30376", "text": "猜丁壳位于沙河地铁站附近, 在点评上看到好评很多,慕名而来 !晚上六点来的 ,店里没什么人 ,装修风格还可以,很复古的感觉!本来想团那个套餐的 ,服务员说需要提前两个小时预约!我们点的一个正常的小锅,微辣!还点了几个青菜,腐竹,豆皮,味道一般,特别咸,量很大,而且还不能要半份,这不是浪费么!再来说说主食吧 ,习惯了吃米饭,结果上来的米饭很硬,跟生的差不多,而且还是凉的,没办法,无奈之下又要了一份泡饼!服务也一般,叫半天也没人!这么大的店就一个服务员!总之很不愉快的体验!东西不是很干净,吃完肚子不是很舒服!不想再来这吃饭了! 不推荐这儿! 一颗星都给多了!"}
{"id": "open-asap-31166", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-31166", "text": "用了大众点评活动~九折~要了一个薯条~不评论不过不失~先说好的~服务还可以~看样子卫生不错~ 服务和卫生对于一个吃货来说固然重要~~~然而味道更重要~~本着大众点评是用作各位吃货的公平公正的平台~我觉得真实评价很重要!!!!炸鸡是重点~因为我第一次在广州吃韩国炸鸡是在西城都会那家~从此我爱上这个东东~~~我见很多网友评论这家分数这么高~本着西城都会那家对广州版韩国炸鸡的标准对这家点抱有好大的希望~~~结果~~味道好不好见仁见智~我觉得像超市十块钱一整只香辣炸鸡加了酱料在表面一样~~~这里要88一只全鸡~~我是双拼了两个口味所以有两盘~~~我有个疑惑~全鸡不是应该是一整只鸡的意思吗?我上桌的全鸡是没有臂膀的~~颠覆了我的认知~是因为我用了优惠活动吗?只是有一只鸡腿在一堆碎鸡(四分之一手掌大)上面~~请问其他小伙伴你们吃的是这样的吗?在广州我觉得食物始终是店铺持久经营的灵魂~~~"}
{"id": "open-asap-31609", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-31609", "text": "看到如皋市丁堰镇新开出的这家九门寨石锅鱼忍不住带家人去尝试了一下,结果颠覆了我的整个人生观,图为七斤鱼的量,不新鲜先不说,来说说这个店员素质,在未吃完先买单的情况下,服务员收走了我桌上的手机,在目击证人未出面的情况下,老板拒不承认拿了我的手机,各种调监控啊什么的。然后目击证人华丽丽的出场了,老板娘甩出一句:谁要你的破手机,然后以忙着给人家结账为由说你的手机待会再处理,再三催促下,老板娘又甩出一句:你的手机重要还是老板做生意重要[发呆],又过了若干久,从手底下拿出我的手机,让我若干验证,证明我的手机是我的手机[发呆],今天我彻底被如皋丁堰镇这家九门寨石锅鱼打败了。你腻害[强]"}
{"id": "open-asap-31889", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-31889", "text": "真不知道那么多好评都是哪儿来的 一个星都不想给 简直难吃的要死了 点的114元的套餐 里面有年糕火锅 金枪鱼饭团还有半份炸鸡 先说饭团吧 一股酸了的味儿 炸鸡都不如路边摊的炸鸡柳好吃 配的那个酱能不能长点儿心 根本就是李锦记的蒜辣酱 年糕火锅我真的不想吐槽了 吃到最后都没吃出什么味儿 一点儿味道都没有 原来在五道口那边上班 和火炉火比起来简直一个是天上 他们家是地下还下两层 老板倒是会在价格上赚钱 团购有101的 有炸鸡和年糕火锅 到店里服务员就推荐直接点店里的套餐 也就是我们点的114元的 这样既省去了给团购软件的钱又能多卖一份饭 总之永远不会再来了 都不如包装马车好吃!"}
{"id": "open-asap-31943", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-31943", "text": "真心是不想再去的店铺。先说排班,开门后每桌只能一个人进去,等位子找好了统一放人进去。简直搞不懂这是为啥!第二,服务员每个都是张臭脸,完全没有服务的感觉。我们居然还被清洁大妈教训,说我们拿多了。请问我四个人拿了五盘菜哪点多了?汤锅直到快吃完了都没烧开锅,找服务员来,人家说你们自己坐的位子不对。我*,还是我们的错!!第三,菜品,只想说没吃到一个新鲜的菜。海鲜就那几样,完全不新鲜。牛排将就,不过有点切不动。没啥好说的了!"}
{"id": "open-asap-34345", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-34345", "text": "绝对的差评!!本来看了大众上点评不好,还抱着试一试的心理去了,没想到真的不该来!首先桌子旁的点菜台,服务员自己就不怎么会用,我们觉得放的太高,看着不方便,就拿下来,结果服务员看到就厉声说“这个不可以拿下来,我们有监控的!”你说不可以拿下来我理解,但是TMD后面一句我们有监控的什么意思??!!然后每个人都要强迫收茶位费,我们每人点了一份饮料之后就开始点主食,结果点炒饭的时候,里面又包含了一杯饮料,我们就问服务员怎么回事,她回答说这个饮料是送你们的......那我们就很不解,你都有饮料为什么还要强迫每人都点饮料,这不是霸王条款么?!......吃饭期间有隔壁桌顾客愤然离席~可想而知服务有多差,菜品味道也很糟糕,饭又硬,牛肉吃着像猪肉,杯子没洗干净,粘糊糊的......各种不愉快......这家店不好好培训下员工我看迟早要完蛋!"}
{"id": "open-asap-34705", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-34705", "text": "老实说真心不值得。价格不是很贵可是种类比其他自助餐少。连生蚝跟老虎虾都没有,只有便宜的越南虾。熟食选择很少,味道也一般。唯一好的就是蛋糕种类还算多。\\\\n7点半去,基本上一半客人都走了,可是八成的脏桌子都没收,我还要在外面等了15分钟等服务员收桌子。这种服务也说好的真心醉了。而且自助餐应该是送一杯饮料的,可是你要是不问,服务员绝对不提。\\\\n至於环境嘛,畢竟開在威尼斯人,差不了。可问题就是收桌子速度太慢,附近都是脏碟子一大堆,影响食欲。\\\\n大老远来一次澳门还不如多加一两百去吃别的自助餐。这家简直就是浪费了我一餐饭!"}
{"id": "open-asap-34899", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-34899", "text": "考完试我老公非要吃这家,我本来要去海底捞的。事实证明他又上当受骗了。不只一次了,人还是不要贪小便宜的好,对于这种喜欢团购的人我只能说无语,不过还好今天吃完这餐他自己说出了他保证这辈子以后再也不团购了。因为什么?因为实在是太难吃了,点评好评的都是托儿。这家日料食材差,报价虚高,然后再折扣。非良心食品,关东煮跟7/11的好炖似的,刺身雪藏的我一口没吃怕拉肚子,寿司姜都是差质量的,寿司长的跟蔫茄子似的。而且团购价也不便宜298/2人,你刚买完团购券服务员就问你要什么饮料啊,有柚子茶etc,记住千万别点因为是另收费的秋后算帐。总之我今晚吃了一碗面算是填饱了我的肚皮,我肯定不会再去,而且我保留投诉大众点评商家自己刷好评的权利。这哪里是诚信社会,这是坑蒙拐骗的社会!"}
{"id": "open-asap-35453", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-35453", "text": "菜品真的不想说太多,不知道网上那些那么多的好评怎么来的,水军真的太多,真的是济南最好的自助餐厅嘛?看了下网上的菜单品种很多,今天去了海鲜只有三种!煮熟的蛤蛎、煮熟的海星触角、煮熟的的扇贝、唯一生的就是三文鱼片!三文鱼限量供应,薄如纸片...扇贝太老、网上看的照片有烤牛舌、有鹅肝、有煎牛排、有西瓜汁、牛排、烤鸭卷、焗番薯,这些都没有看到,大部分感觉和早餐差不多。本来想用团购,因为我是住店顾客,说是138元,网上团购是128元。相差10元也无所谓,三文鱼真的太薄了,第一次吃到这样的厚度,限量供应,每次每人7片左右。不过客房服务还是挺好的。"}
{"id": "open-asap-35476", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-35476", "text": "菜品还好但是老板和她弟弟都是凶悍的人,随时可能冲上来和你干架。吓的我都直接报警了,那女老板还叫嚣着你们两个人吃90块还要报警,你这女的真是连90都不值 各种骂人的话。另外这家说和大众点评没有合作,优惠只有美团,和大众点评沟通的时候老板弟弟把手机丢给我,我给放回柜台上后来就被赖着说是我把他手机摔坏了。还有她家端上来的东西你要是没点可就小心了,有的是免费有的不是,她家就靠这个坑钱的。建议要去她家吃的带上几个壮汉,妹子们千万别单独去,去了挨骂是小,挨打就亏了。"}
{"id": "open-asap-35553", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-35553", "text": "菜真的不是新疆口味,当然本人也没去过新疆,但和在别处吃过的新疆人做的比差距还是很大的。茄子这道菜感觉说的过去,茄子有点老,味道还可以。红柳串还行,但价位算高的。烤羊腰里面的筋没剔干净,不能咬断,影响口感。馕丁炒卷心菜太甜,甚至有糖还没有化。奶茶明显不是熬出来的,感觉就是红茶泡好兑上奶,而且兑的奶比例还不够。烤包子都差不多。炒片儿和我吃过的所以炒法都不一样,番茄酱好像没放一样,反正我不喜欢。小油馕是我感觉最好的,像小点心一样,可以给个赞。最后说下大菜烤羊排,真是太失望了,本想大吃一顿,以为要了整个的会吃不了,可菜上来发现块真小,更没辙的是肉还明显是被剔过的,肉少就少点吧味道还不好,烤的都干了,刷油不够,我觉得肉煨的应该也不好。总之这次午餐是很失望的。"}
{"id": "open-asap-38143", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-38143", "text": "这家店在一个不知道什么湖边,超级不好找!老板开始会非常热情,在路边等客人,等我们都坐下后,一会一个电话,根本没有心思帮你搞螃蟹,菜就是普通的家常菜,一个高淳豆腐30元,炒鸡头梗20元,清炒菱角20元,韭菜涨蛋20元总之一句话就是素菜价格不是20元就是30元,价格高也就算了,关键是难吃级了,没有水平麻烦不要开饭店,载你没有商量。一个鱼汤58元,菜品份量很少。螃蟹也普通,90元一对,比较失望,因为很失望,照片我也是难得拍照了,反应下这家宰客现象太突出,请有关部门可以介入调查。"}
{"id": "open-asap-38238", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-38238", "text": "这家店在枫蓝国际的二层 店面很有创意 餐厅整体风格都很复古 很嘻哈 很多都是老旧东西 充满小时候的回忆 进店后服务也很热情 第一印象感觉不错 之后开始点餐 二个人点了七个菜一个酸梅汤 菜量很小 估计一份菜二个人夹不了几筷子就没了 但我们剩下很多 是因为简直太难吃了 可以说我还没吃过这么难吃的餐厅 但这要看个人口味 反正我觉得不好吃 点了杭州酱鸭 很油腻 还有些咸 不好吃 首尔烤肉 特别特别柴 一点肉香味没有 不好吃 葱香大排 就是饭盒装的一块猪排 有关是炖的 没什么味道 不好吃 笨鸡蛋炒虾仁 就是摊鸡蛋弄碎放了几个人指甲盖大的水发虾仁 不好吃 干锅有机菜花 下面一层油 不好吃 开胃肥牛锅仔 这是最难吃的了 肥牛又柴又加生 里面的番茄金针菇就是白水煮出来的味道 不好吃 鲜蘑芝士卷 这个算是里面相对好吃点的了 本来看了大众点评五星过来的 但可能每人口味不一样 我只能给二星了"}
{"id": "open-asap-38674", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-38674", "text": "这家店的菜总体来说还可以,牛蛙和麻辣香锅味道还行,烤鱼实在很一般。但我想说服务实在太差了!!!!!!!非常气氛!!!!!!!服务员的素质极低!!!!!我家娃十个月大,一家人带着娃吃饭,好不容易哄睡了,在我身边的推车里。结果一个女服务员收拾另外桌时把一个大盘子打碎了,声音非常大,宝宝突然被吓着了,盘子不小心掉了就掉了我们不说什么,结果她又双脚踩在盘子上很张狂的蹦了几下,再次制造几声巨响,我们说有婴儿睡觉麻烦轻一点,另外一个男服务员一边收拾桌子一边说难道还要我垫海绵?!你说又这样的一群服务员,别说服务,连起码的公德都没有,这样的店能好吗?总之这样的店千万别去,不够生气的,服务不好还不让说,小心再在菜里放点啥。。。。。"}
{"id": "open-asap-39659", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-39659", "text": "这次去天津玩,为了图方便就住在了火车站附近,早上起来到火车站广场看看有啥好吃的,无意中看到了庆丰包子铺,当时就想到了***来吃过,所以也就进去看看了。里面吃饭的人还是很多的,排队买早点,各类早点都很齐全,就是真心贵啊,包子是按两卖的~~~俩菜包加一碗稀饭居然5块钱,包子也很小,稀饭的碗也很小,都没敢敞开肚皮吃,敞开了吃估计一个人要十几块钱吧,这要在我们家乡开店早倒闭了,我们那早上一大碗牛肉汤一个馍馍才7块钱。贵就算了,问题是味道也一般啊,还没家里老妈包的包子好吃,不要说穷吃不起,就算吃得起也不会去吃的。难怪以前看***在这吃包子的新闻,好多人下面都回帖吃不起,真TMD贵。反正以后是不会去吃了,就图个新鲜吧。"}
{"id": "open-asap-40660", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-40660", "text": "针对这家的价位而言:设施不全没有本店自己的洗手间;口感差:其中一道酸辣汤辣的我们不轻,打包时碗底还沉着那么多胡椒粉,回家添了两碗水加了菜和面片还辣的大家出汗。另外的菜油性大,口感一般。炸菇的辣椒都发苦。菜量小。土豆丝18一份,36元的茄子没多少,因为极辣,带回家也没吃完一半。餐纸自费,打包盒自费。整体来讲没有以前的清心莲高雅周到但价位高;没有新开的自然林的品种多;也没有卫校对面那家素包子铺和乐天原来15元的自助亲民实惠;更没有雨花斋的感恩氛围。对于一个吃素食的人来讲,这顿饭没吃好,似乎不知它定位在哪里。第一次让我有了下次不来了的感觉。只是最后结账时的那个男孩一直很温和,体贴,很是受安慰。"}
{"id": "open-asap-40694", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-40694", "text": "银河里的餐厅都吃过了只差这家没吃过,前几天去尝尝简直失望死......三杯鸡嚼不烂,黑椒牛柳粒不是应该用黄油么?烤玉米就是水煮玉米稍微烤一下既没有奶香味也没有刷其他的料汁调味......烤鸡翅火候不够里面还带血丝......水煮牛肉咸的要命......结账之前问服务员团购的代金券能不能用明确的说可以,结果结账时大堂经理又说不能用要提前一天预约,应答口径都不一样就不能好好培训一下么......旁边桌三个男孩点了三个菜三碗米饭吃了没十分钟就走了,菜基本没动米饭只吃不到一半......看来不止我一人觉得不好吃"}
{"id": "open-asap-41080", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-41080", "text": "隔三差五跑去吃,算常客了!但是这服务态度真是一次比一次差!今天坐无烟区,这态度我也是醉了!碰到个女的中年妇女,之前让她催单,后来让她过来结账,刚想开口,她就超级冲的开口「不是催过了吗」这说话口气差,服务态度差!过了会又跑来个男的也态度很不好的问干什么!好像来干架一样!真的搞不懂我们到底谁是客人谁是服务员!必点菜油爆虾的数量也是越来越少了!同样的老板,还是隔壁的全牛捞态度好!真是一颗老鼠屎(服务员)坏了一锅粥!现在这种讲究服务的社会,这样的店真是迟早没戏!"}
{"id": "open-asap-41822", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-41822", "text": "食物的卖相是挺好的 味道一般 但价钱好贵又不是特别好吃 人均125 而且并没有吃很饱 店里特色的寿司雪糕 不太懂欣赏 个人觉得不好吃 熟扇贝味道不错 感觉很新鲜 三文鱼塔塔一般般 其他的都没什么特别 上菜慢 下单一小时后 才上一份寿司 当时店里面客人也不是特别多 厨师就有十多个 真正在做寿司的只有两三个 其他的都在嬉皮笑脸的聊天 ...... 感觉很没有诚意!!! 这家店不会有下次了!"}
{"id": "open-asap-44699", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-44699", "text": "地址:人民公园西门向被300米路西......走到一看店家门面活动价也是一元一个鸭头......有些人会觉得门面现金价和团购价一样都是一元一个鸭头,会有一些心理落差!其实我觉得还好,一元能买到一个鸭头,不管了门面活动价还是团购价都很值......一个帐号最多买六个~~服务还挺好的,走到说是大众点评团购的,说了一个验证码就可以连续把六个都验证了,很方便!环境一般,就是一般的门头,所有卖的东西都是外带的。没有餐桌,只能打包带回家吃!回到家一看鸭头上面很多毛都没清理干净,看着就浑身起鸡皮疙瘩......顿时胃口全无!挑了一个没怎么有鸭毛的尝了尝,说实话口味还是可以的,麻辣口味的!就试吃了这一个,剩下的五个都扔了!看着鸭头上的鸭毛实在吃不下去!希望商家要注意,以后一定要把鸭毛清理干净......"}
{"id": "open-asap-45138", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-45138", "text": "差评!差评!差评!我不清楚这些好的评论是真的还是假的。作为一群七零年代的人,这个饭店的吸引力非常大,所以把同学聚会安排在这里觉得非常有意义。提前一天预订了,结果到店已经被人坐了。交涉后最后确定订座,但是座位不够没人加,餐具不够没人加,叫了半天服务员给了我们一堆碗筷,叫我们自己分,!点了八个冷菜,十二个热菜,一共七百二十。人均70,不算便宜。主要问题是菜。熏鱼是死鱼做的,海蜇是人造的,猪油饭是微波炉叮出来的,硬无味。柠檬虾都是死虾。鱼头也是死鱼,泥味。三鲜汤肉丸鱼丸全是渣。悠咄鲜更是无语。一桌菜居然没有一个菜是好吃的。也是从来没有过的。这样的饭店居然有这么多的好评,不知道是公关还是真的好吃?对于一个吃货来说还是真实的告诉大家,希望大家都有个判断。"}
{"id": "open-asap-453", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-453", "text": "9月23日陪老婆去金源mall玩在购物中心一层吃的金鼎轩,天气不错坐在外面吃的,首先,服务真心烂,一大堆服务员在那里傻站着,叫了半天才动,动,竟然先上主食!我去nmlgb,最后反复催菜才吧主菜上了,尼玛我都吃饱了!而且叫了两杯水,到最后走人了都没上!再说食物真心不好吃,其实就是一个大排档,菜品几乎可以和成都小吃类似,招牌的味道真心垃圾,也就鸡爪比较烂,味道还可以,我也是瞎了,在金源5层大排档吃你家那个鸡爪还觉得可以才去一层又吃了一次,金鼎轩名字不错,真心可惜这名字了!唯一推荐的就是鸡爪,本身菜单上菜品就少,还特么弄了4个菜单(一个水单,一个菜单,一个防霾菜单,一个素菜单),你特么逗比吗?一打开才尼玛几个菜品?弄这么多菜单你们真特么有闲工夫,这个也就是推荐吃吃小吃,不建议朋友聚会去吃,因为菜品种类太少了,几乎没有选择!kqnnamduohaoping,nimenchiguodongximei?meiqizi。"}
{"id": "open-asap-46343", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-46343", "text": "环境靠河边,还真的不错,微风凉凉,口味一般般,分量小,比浏阳蒸菜的分量少多了。价格不是一般的贵,晚上点了一个口味虾,一个清蒸虾,一份皮蛋,一份海蜇皮,一份毛豆,还有一份土豆丝,十碗猪油拌饭,一共400多,猪油拌饭,男孩子吃,应该差不多5口,份量少的可怜,味道还可以咯,只是味道跟价格不成正比,再说服务,服务本人觉得是可以,但是一起去的朋友觉得很差,去试试口味的,还可以选择,要是注重口味的,还是不用去了。"}
{"id": "open-asap-5022", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-5022", "text": "什么玩意儿,东西贵不说环境也乱哄哄的,看菜单一盘麻豆腐要26,服务员也爱答不理的,你东西再好我也不会再去了。等了50多分钟肉饼,中间问了服务员两回肉饼什么时候上,服务员哪也没去谁也没问就说快了快了,快你大爷。最后肉饼出了竟然给刚到的几桌先上了,你妈啊,真的是什么心情都没了。所幸不吃了结账,还说肉饼排号,排你大爷,我先到的旁边翻2桌了,给刚到的人先上这叫排号排单子,总共一瓶啤酒两个肉串还能给我算错帐,真的想他妈骂人摔东西了,操!真他妈给北京人丢脸。"}
{"id": "open-asap-6345", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-6345", "text": "以前去过两次感觉还可以,昨天简直太失望了,朋友过生日定的唯一一个单间,低消600,三个人先去的点了十二个菜,四百多,告诉先做,别的朋友来再点,服务员说什么也不给下单子,说必须点到六百才给做,最后点了十六个菜,七百多,又要的白酒,让服务员打酒,服务员说不会打,我们说不会打就退了吧,服务员态度恶劣,真怕把弯弯鸡的汤扣谁脑袋上,九个人十六个菜,菜量太小了,没怎么吃就没有了,羊排肥腻的没有办法吃,香辣虾也就八九个虾,鱼头土腥味很重,总之是一次很扫兴的聚会"}
{"id": "open-asap-7730", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-7730", "text": "住六建30多年不在五棵松路口吃饭、因为离301医院太近。阅兵日单位没早餐,图干净特意上二楼宏状元、没几个人,点了一碗南瓜粥、玻璃保温箱里夹了两根细长软塌榻的油条、一碟小菜(碟子就巴掌大),付款时说19元,我蒙了几秒 为了确定自己没听错又问了一下单价!服务员很淡定: 粥10元、油条3元 剩下那小菜肯定也是3元...没吃!把托盘放桌上我直接退出来了。守着301医院、连餐厅都黑!心疼那些外地来看病的。。。"}
{"id": "open-asap-9336", "knownLabels": ["complaint", "sentiment"], "language": "zh-Hans", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": {"complaint": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-9336", "text": "到广州旅游,去了广州塔,饿到九点半晚饭还没吃,原本以为是个夜宵好去处,看了下菜式以海鲜为准,谁知道价格贵点不算竟然还有隐形消费加工费,另外茶水费说是广州习俗也就算了,两人点了两个大懒尿虾,花螺,蛤蜊,生蚝,原本想点番茄炒蛋谁知道炒个番茄要58加蛋要68,毛血旺才63,这素菜赚到手软了吧,海鲜只能说新鲜点但是味道烧的都一般,但是毛血旺实在让人作恶,咸到醉了,厨师你以为在淹咸蛋啊,叫了经理,让他尝试了下,连她都觉得确实咸,哎 换了一盆上来总感觉已经有阴影而且味道也不入味色面也不好,尝了两口就放弃了,这些菜850,实在性价比不高啊,服务态度也觉得一般,只能斩斩外地游客!"}
{"id": "open-cfpb-1777502", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/1777502", "text": "took out a {$5000.00} cash advance on my bank account 115.00 % rate could not pay the high cost cash advances is not legal in the state of Arkansas XXXX is reporting these accounts for cash call XXXX XXXX collections"}
{"id": "open-cfpb-2555962", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2555962", "text": "I am a victim of identity theft and have been a victim of identity theft for well over 11 years. I have an unauthorized and fraudulent account listed on my XXXX XXXX, Equifax and XXXX credit report that 's fraudulent. The following account is fraudulent : XXXX XXXX XXXX account : XXXX. Please permanently delete this fraudulent account from my credit report."}
{"id": "open-cfpb-2701144", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2701144", "text": "There is an account on my credit report from GC Services with XXXX. For balance it says XXXX and for high balance it says XXXX the information is incorrect. This account was also removed from my credit report and keeps reappearing. It was removed because of the amount being incorrect."}
{"id": "open-cfpb-2986864", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2986864", "text": "On XX/XX/XXXX and XX/XX/2017 I received a hard inquiry from XXXX, which I did not authorize. I DID not request to obtain directly or through third party any loan or line of credit or charge card from XXXX in connection with this request ( as I already have one and do not desire anymore at this current time. )"}
{"id": "open-cfpb-3001841", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3001841", "text": "I have disputed an error for an account that I had with XXXX XXXX credit card with XXXX, experian & XXXX. I have provided a copy of the check that I paid the account in full to both the credit bureau agencies as well as XXXX directly several times and yet this account is still being reported as late and not paid. Legally they are obligated to correctly report the right information and they refuse to."}
{"id": "open-cfpb-3073568", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3073568", "text": "XXXX has been non-compliant with removing the unverified account BANK OF AMERICA which has been deleted by XXXX and XXXX. XXXX and XXXX have both completed their research and determined that BANK OF AMERICA was not established by myself but XXXX keeps verifying this accounts. Also, when I called the company they responded that XXXX did not send them all of the verifying evidence to confirm each account is unverified."}
{"id": "open-cfpb-3169526", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3169526", "text": "CMRE contacted my sister about my debt XX/XX/XXXX @ XXXX expressing to her that they were going to report the debt to my credit report and they would next garnish my wages she explained that I was not home but the rep insisted that she was in fact me I then called them and they said they were sorry the last rep did that but would I like to set up payments I explained to them this isnt correct and they needed to verify this incorrect bill"}
{"id": "open-cfpb-3258718", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3258718", "text": "They would call repeatedly and not say a word. Then they called me once cursing and using offensive language. I told them you have the wrong number and they dont care, they keep calling."}
{"id": "open-cfpb-3315833", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3315833", "text": "CEASE COMMUNICATIONS AND REMOVE ALL CREDIT REPORTING OR BE SUED. FOR XXXX XXXX AND MYSELF."}
{"id": "open-cfpb-3431365", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3431365", "text": "I sent a letter to evergreen professional asking to remove the collections account. I never received a response I have been making monthly payments ( direct withdrawal ) they take {$50.00} a month from me. It should be paid in full"}
{"id": "open-cfpb-3558426", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3558426", "text": "The billing address is incorrect on the billing statement I never stay at the address shown on the bill the account is not mines. I never received notice of any bill due for any service"}
{"id": "open-cfpb-3577388", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3577388", "text": "Hello, Both accounts are passed the 7 year mark to be removed from my credit history. Accounts XXXX and XXXX The last payments made on these accounts were in XX/XX/XXXX. Today 's date is XX/XX/XXXX it been a full 7 years. please remove these accounts fully from my credit reports. As i have written proof from date of last payment for both of these zombie debts.Thank you"}
{"id": "open-cfpb-3747030", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3747030", "text": "I was shocked when reviewing my credit report and found late payments on the dates below : 30 days late as of XX/XX/2020 XXXX all 3 bureaus ) 60 days late as of XX/XX/2020 XXXX all 3 bureaus ) I am not sure how this happened. I believe I made my payment to you when I received my statement. My only thought is that my statement did not get to me"}
{"id": "open-cfpb-3828096", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3828096", "text": "I have disputed this account and have reached out to the company/creditors MANY times but failed. This account is being reported inaccurately and incorrectly on my credit report."}
{"id": "open-cfpb-3858080", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3858080", "text": "This is the second request..I had asked you to remove accounts that I do not recognize that includes addresses, and my name is incorrect. Additionally, there are a ton of inquiries in which I did not approve. Please delete them immediately. Thank you."}
{"id": "open-cfpb-3919922", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3919922", "text": "Experian is in violation of the fair credit. My understanding is they have 4 days to block the fraudulent items on my credit report. They have failed to do so in that time frame."}
{"id": "open-cfpb-4063938", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4063938", "text": "Bank of America continues to report that I have a delinquent account with an outstanding balance on a closed account. I never received a bill and it was sent to collections even though I made payments in XXXX and XXXX. I spoke with the company via phone during both years and it now still appears as a derogatory account on my account and no one has helped me. I have disputed the companies claims because they sent me to collections and refused to hear my plea during going through a divorce."}
{"id": "open-cfpb-4075299", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4075299", "text": "This account is not accurate CONVERGENT OUTSOURCING # XXXX. My bill was PAID IN FULL XX/XX/2021 directly to XXXX XXXX. I do not have any contracts with CONVERGENT OUTSOURCING. This account has no business being on my credit file."}
{"id": "open-cfpb-4140786", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4140786", "text": "I have filed a dispute in regards to the incorrect items on my credit report. It has been well over 30 days and I have not received any investigation results."}
{"id": "open-cfpb-4232485", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4232485", "text": "I have filed a dispute in regards to the incorrect items on my credit report .It has been well over 30 days and I havent reviewed any investigation results."}
{"id": "open-cfpb-4386529", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4386529", "text": "I have disputed the items circled in my attached report and they have failed to address these items in a timely manner. These items are unknown and need to be deleted from my credit file immediately."}
{"id": "open-cfpb-4613745", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4613745", "text": "I am filing this complaint because Credit Bureaus have ignored my request to provide me with the documents that their company has on file that was used to verify the accounts I disputed. Being that they have gone past the 30 day mark and can not verify these accounts under Section 611 ( 5 ) ( A ) of the FCRA - they are required to. Promptly delete all information which can not be verified. Please resolve this manner as soon as possible thank you"}
{"id": "open-cfpb-4758252", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4758252", "text": "Received a letter on XX/XX/XXXX from American Coradius International LLC claiming I owe XXXX, XXXX {$9400.00}. This is not my account and XXXX shows a XXXX balance for my account."}
{"id": "open-cfpb-5094833", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5094833", "text": "I'm not swayed that Bureaus efficiently pleased the principles of the Fair Credit Reporting Act in completing their investigation. The Bureaus are reporting inaccurate information on XXXX XXXX. Per FCRA, reporting must be 100 % accurate or the information must be deleted. If this type of information can not be equipped, make sure to erase the item in question immediately."}
{"id": "open-cfpb-5123759", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5123759", "text": "I have paid off the balance to my credit card back in XX/XX/2021 and the credit card company is not reporting correctly to the credit bureaus the balance should be XXXX they are reporting i have a balance of XXXX dollars also they reported the card closed when it shouldn't be closed this has caused me stress time from my job to keep calling and getting refused an apartment"}
{"id": "open-cfpb-5296904", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5296904", "text": "I received a demand letter from Perdue Brandon Fielder Collins & Mott LLP dated XX/XX/XXXX. In XXXX I had an arrest with a restitution. Since that time I have been paying XXXX XXXX XXXX XXXX directly. The letter the \" law firm '' threatened my arrest and or license suspension. Neither of which, according to the courthouse and my used to be probation officer, can happen. Not only claiming I owe them, they are also claiming I owe {$420.00} more than I owe."}
{"id": "open-cfpb-5342499", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5342499", "text": "I have filed a dispute in regards to incorrect items on my credit report. It has been well over 30 days and I haven't received any investigation results."}
{"id": "open-cfpb-5430594", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5430594", "text": "XXXX XXXX XXXX {$29.00} Date XX/XX/2018 acct endin XXXX In accordance with the Fair Credit Reporting act XXXX Account # XXXX, has violated my rights. 15 U.S.C 1681 section 602 A. States I have the right to privacy. 15 U.S.C 1681 Section 604 A Section 2 : It also states a consumer reporting agency can not furnish a account without my written instructions"}
{"id": "open-cfpb-5546899", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5546899", "text": "Someone opened a XXXX XXXX XXXX account in my name, with my documents, and for years I've submitted an identity theft report to ALL of the major credit bureaus AND the creditor. Each company fails to remove the account from my credit report and fails to acknowledge the identity theft, even though I've submitted a police report and a report from identitytheft.gov"}
{"id": "open-cfpb-5594585", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5594585", "text": "How did you get my personal information? Who and what gave you the rights to violate my rights to privacy as a federally protected consumer? And Are you aware of the laws youre in violation of by getting an federally protected consumer personal information without consent? Now Im giving you this one opportunity Firstsource Advantage LLC to explain yourself and answer every question mentioned above. Failure to comply will result in fines. Best regards! And the best of luck!"}
{"id": "open-cfpb-5843160", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5843160", "text": "I want to report Identity Theft that has been going on for years. I never knew much about credit or cared to use it until recently. Now that I'm looking to build my credit I've noticed several things on my report that I have never opened. I've sent dispute letters in the past and have been having a hard time getting everything removed."}
{"id": "open-cfpb-6061472", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6061472", "text": "To : Consumer Financial Protection Bureau, XXXX is continuously violating the Federal Law made by the Congress and keep violating my rights as consumer of this Federal Corporation. As the Credit Reporting Boss please I request you to stop them with their misinterpretation of my consumer report. Thank you"}
{"id": "open-cfpb-6122130", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6122130", "text": "n accordance with the Fair Credit Reporting act XXXX Account # XXXX, has violated my rights. 15 U.S.C 1681 section 602 A. States I have the right to privacy. 15 U.S.C 1681 Section 604 A Section 2 : It also states a consumer reporting agency can not furnish a account without my written instructions"}
{"id": "open-cfpb-6461018", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6461018", "text": "I was scammed by a sophisticated pseudo scam thru XXXX and I disputed 17 charges for which they only claim to do an investigation of which they didn't do and then turn around and agreed with XXXX that it was ok for me to be scam of over 90 thousand dollars."}
{"id": "open-cfpb-6684695", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6684695", "text": "Unable to open a new bank account with pnc bank, XXXX, XXXX XXXX XXXX due to accounts being opened fraudulently under my name in the past"}
{"id": "open-cfpb-6854260", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6854260", "text": "The account in question is not mine, as I stated in my initial complaint. Despite the fact that it says this account has been validated, the information is still incorrect. This account has to be immediately deleted from my credit record, as requested."}
{"id": "open-cfpb-6977335", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6977335", "text": "I did not consent for these consumer reporting agencies to furnish any information disclosed in my FTC report to any person."}
{"id": "open-cfpb-7054229", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7054229", "text": "Multiple inquiries when applying for vehicle multiple inquiries on XXXX credit card and multiple inquiries by mortgage companies"}
{"id": "open-cfpb-7352245", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7352245", "text": "I submitted a credit repair request to a company, but they failed to respond within the 30-day timeframe required by law. This failure to respond has negatively impacted my credit and caused difficulties for me. I am now considering submitting a complaint to the Consumer Financial Protection Bureau ( CFPB ), in order to address the situation and protect my rights as a consumer."}
{"id": "open-cfpb-7415516", "knownLabels": ["complaint", "sentiment"], "language": "en", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": {"complaint": true}, "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7415516", "text": "I am a victim of identity theft. I am writing to request that you block the following fraudulent information from my credit report. I have no idea how the theft took place. I also have no knowledge of any suspects. I did not receive any money, goods, or services as a result of identity theft. Please let me know if you need any other information from me to block this information from my credit report. Thank XXXX XXXX XXXX XXXX XXXX"}
{"id": "open-clinc150-10654", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "please find me a hotel room for 4 people from monday to wednesday in lakewood"}
{"id": "open-clinc150-10760", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "i am in need of my location"}
{"id": "open-clinc150-11032", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "tell me my electric bill minimum payment"}
{"id": "open-clinc150-11158", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "i want you to use whisper voice now"}
{"id": "open-clinc150-11549", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "check days of pto"}
{"id": "open-clinc150-11599", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "let me know my vacation time"}
{"id": "open-clinc150-11661", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "i want to see the golden gate bridge and i'm walking on 5th street right now"}
{"id": "open-clinc150-12331", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "can you increase my credit limit"}
{"id": "open-clinc150-12431", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "what sorts of things do you do to have a good time"}
{"id": "open-clinc150-12583", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "show me roundtrip flights from dallas to houston for march 7 and march 10"}
{"id": "open-clinc150-12742", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "send a text message for me"}
{"id": "open-clinc150-12891", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "how much do i have on credit card bill"}
{"id": "open-clinc150-13091", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "transfer my cash reward balance to my bank"}
{"id": "open-clinc150-14078", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "on what day and date of what year were you born"}
{"id": "open-clinc150-14311", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "can you give me a thai meal suggestion"}
{"id": "open-clinc150-14562", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "what is my current gross salary"}
{"id": "open-clinc150-16", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "if i were english how would i say subway"}
{"id": "open-clinc150-1680", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "please inform me when my flight scheduled to board"}
{"id": "open-clinc150-1839", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "can you just start calling me sir"}
{"id": "open-clinc150-1890", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "i want you to call me lord"}
{"id": "open-clinc150-2341", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "i want manual on how to change oil"}
{"id": "open-clinc150-3", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "tell me how to say, 'it is a beautiful morning' in italian"}
{"id": "open-clinc150-3087", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "how long will it take to get to long beach terminal from long beach airport"}
{"id": "open-clinc150-3124", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "what will you call me"}
{"id": "open-clinc150-3198", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "so what name do you have for me"}
{"id": "open-clinc150-4205", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "it seems my luggage was lost"}
{"id": "open-clinc150-4465", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "how good is the fuel usage for this vehicle"}
{"id": "open-clinc150-4518", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "when do i need to change the oil again"}
{"id": "open-clinc150-4707", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "what sites are there to see when in evans"}
{"id": "open-clinc150-4832", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "is it possible for you to let me know what health plan i'm on"}
{"id": "open-clinc150-4834", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "list my insurance benefits"}
{"id": "open-clinc150-5082", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": true, "question": false, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "did i set up a reminder to clean the bathroom"}
{"id": "open-clinc150-5463", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "what's my apr on the credit card i used for a purchase a week ago"}
{"id": "open-clinc150-5959", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "what is today"}
{"id": "open-clinc150-6", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "i need you to translate the sentence, 'we will be there soon' into portuguese"}
{"id": "open-clinc150-6065", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "can you look up the carry-on restrictions for delta"}
{"id": "open-clinc150-6137", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "how many of my vacation days have i depleted"}
{"id": "open-clinc150-7302", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "make sure my alarm is set for three thirty in the morning"}
{"id": "open-clinc150-7969", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "how to report bent credit card"}
{"id": "open-clinc150-8619", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "CLINC150 UCI", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-3.0", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "text": "let me know when should i get my tires changed next"}
{"id": "open-crosswoz-10586-8", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你能帮我在格林豪泰酒店北京市首都机场第二店附近找一家评分4.5分以上,游玩的时长是0.3小时 - 0.5小时的景点吗?"}
{"id": "open-crosswoz-10728-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "您好,我和同学想一起出去玩,帮我推荐一个票价是50-100元的、游玩的时长是0.5小时 - 1小时的景点,谢了。"}
{"id": "open-crosswoz-10871-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,我想找一家人均消费50-100元吃全家福这道菜,请给我推荐一家餐馆用餐吧。"}
{"id": "open-crosswoz-11012-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,我想去景点钟表馆(奉先殿),帮我查询下这个景点的评分,谢谢。"}
{"id": "open-crosswoz-11109-6", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "对啊,谢谢你的提醒,有这个景点的电话吗?不行我还可以给它打电话咨询。"}
{"id": "open-crosswoz-11117-12", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "好的,多谢了。另外我还想找个能玩1小时的景点,你帮我看看哪里合适呢?"}
{"id": "open-crosswoz-11374-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,请帮我推荐一个评分是4.5分以上,人均消费在50-100元的餐馆,谢谢!"}
{"id": "open-crosswoz-11462-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,帮我推荐一个票价在20元以内的景点吧,最好评分在4分以上的,谢谢。"}
{"id": "open-crosswoz-11677-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,我想去一个评分4.5分以上的,可以游玩时间0.5小时 - 1小时的景点游玩,给我推荐一个吧。"}
{"id": "open-crosswoz-11686-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,请给我推荐一家评分4.5分以上的餐馆吃南瓜粥这道菜。"}
{"id": "open-crosswoz-11766-8", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "无所谓,有时候评分也不准的,能帮我查一下这个景点的游玩时间吗?"}
{"id": "open-crosswoz-11884-12", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "好的,游玩结束后帮我找个最低价格是1000元以上的景点,我你希望酒店提供24小时热水和西式餐厅,平时工作很辛苦,我也享受一下。"}
{"id": "open-crosswoz-11953-12", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "行,我明白了,最后给我们找个餐馆好好吃一顿吧,人均消费100-150元的就可以,实惠一点的,哈哈!"}
{"id": "open-crosswoz-11959-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,我想入住一个经济型的酒店,还希望评分在4.5分以上,且酒店的最低价格是300-400元。你能给我推荐一个好的吗?"}
{"id": "open-crosswoz-12429-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,我想带女朋友找一家评分5分人均消费100-150元餐馆吃小笼牛肉,请给我推荐一家餐馆用餐吧。"}
{"id": "open-crosswoz-158-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,帮我查一下99优选酒店(北京长阳环岛店)(原摩恩快捷酒店)周边有什么餐馆?还有酒店是否提供吹风机,谢谢。"}
{"id": "open-crosswoz-1615-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "您好,请帮我找一家舒适型酒店,评分在4分以上,设施中有商务中心,谢谢。"}
{"id": "open-crosswoz-1626-12", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "真是麻烦您了。再帮我找一家评分是4.5分以上的酒店 吧。并且把酒店的电话和类型一起告诉我吧,谢谢!"}
{"id": "open-crosswoz-1766-14", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "好的,再帮我推荐一个最低价格200-300元,评分在4.5分以上的酒店,谢谢。"}
{"id": "open-crosswoz-338-10", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "那麻烦您帮我发一下它的地址,谢谢了。"}
{"id": "open-crosswoz-3595-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,我要去中央民族大学民族博物馆这个景点游玩,请告诉我景点周边都有哪些酒店啊?"}
{"id": "open-crosswoz-4220-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,请帮我推荐一个最低价格300-400元的酒店,谢谢。"}
{"id": "open-crosswoz-5259-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,麻烦帮我推荐一下评分在4.5分以上的酒店,谢谢。"}
{"id": "open-crosswoz-5821-18", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "哦,那好吧,那你你帮我在古崖居风景区附近找一个评分4.5分以上,人均消费150-500元的餐馆行吗?"}
{"id": "open-crosswoz-6343-2", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "不好意思,再帮我找一个价格在400到500元的,有暖气的酒店,谢谢。"}
{"id": "open-crosswoz-7477-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "您好,请帮我推荐一个评分是4分以上、游玩的时长是3小时的景点,谢谢!"}
{"id": "open-crosswoz-7576-10", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "嗯,最后您在给我找个免费景点游玩0.5小时 - 1小时。"}
{"id": "open-crosswoz-7593-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,请给我推荐一家评分4.5分以上最低价格在100-200元的高档型酒店住宿。"}
{"id": "open-crosswoz-7671-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "您好,请帮我找一家供行李寄存的酒店,谢谢!"}
{"id": "open-crosswoz-8169-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,我要去景点红领巾公园,帮我查询下这个景点的门票和周边餐馆。谢谢。"}
{"id": "open-crosswoz-8242-16", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "太好了,那在这些酒店中找一家经济型的,评分是4.5分以上的,告诉我地址,我去安排一下,再看看周边有什么景点没?"}
{"id": "open-crosswoz-8593-14", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "非常感谢。那请问酒店电话是多少呢?"}
{"id": "open-crosswoz-8657-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,帮我推荐一家有罗宋汤的餐馆,最好评分在4.5分以上的,谢谢。"}
{"id": "open-crosswoz-9158-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,帮我推荐一个能玩1、2个小时的景点,要没有门票费的,评分在4.5分以上的,谢谢。"}
{"id": "open-crosswoz-9404-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,请给我推荐一家评分5分人均消费150-500元的餐馆吃豆面丸子汤这道菜。"}
{"id": "open-crosswoz-9587-8", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "好,请您在北京语言大学的周边帮我找一个评分4.5分以上的高档型酒店住宿,顺便在查下它周边有什么餐馆。"}
{"id": "open-crosswoz-96-2", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "麻烦你把这家酒店的地址和类型告诉我一下,谢谢。"}
{"id": "open-crosswoz-9637-24", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "请帮我呼叫一辆从十渡风景名胜区到小吊梨汤(畅春园店)的出租车,告诉我车型和车牌。"}
{"id": "open-crosswoz-9866-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,我要去亚太花园酒店二层翡翠金阁中餐厅用餐,请告诉我这家餐馆的周边有哪些酒店啊?"}
{"id": "open-crosswoz-9886-0", "knownLabels": ["question", "task"], "language": "zh-Hans", "sourceDataset": "CrossWOZ", "sourceLabels": {"question": true, "task": true}, "sourceLicense": "Apache-2.0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "text": "你好,我想去排云殿这个景点游玩。这个景点的地址帮我查一下。"}
{"id": "open-goemotions-ed0miwo", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L6572", "text": "I low-key love his YT channel, he's genuinely an interesting and good person"}
{"id": "open-goemotions-ed1at3i", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L26134", "text": "There are no male versions of feminists. Men live in a different social reality than women."}
{"id": "open-goemotions-ed783v1", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L19103", "text": "[NAME] reinforces the pessimistic world view, I've been there and at least it was cancerous for me."}
{"id": "open-goemotions-edciwc1", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L16468", "text": "I had a nightmare about something similar, the combination of high walls and water is truly scary"}
{"id": "open-goemotions-eddd68m", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L18316", "text": "Go to the movies with people not related to me."}
{"id": "open-goemotions-edf80ua", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L3033", "text": "There is irony in what you guys are saying."}
{"id": "open-goemotions-edhgfqz", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L6496", "text": "really? I tried last NYE during the day and it was dead"}
{"id": "open-goemotions-edi79i8", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L3366", "text": "This is painfully fake"}
{"id": "open-goemotions-edlfmm3", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L21551", "text": "None of it will happen Just wait for them to yank it away"}
{"id": "open-goemotions-edloxw1", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L26398", "text": "she usually sits below the bathroom sink like a fuckin weirdo between 9-11 pm but she'll be free after."}
{"id": "open-goemotions-edlqvvo", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L2500", "text": "This post is a waste of time and doesn't belong here."}
{"id": "open-goemotions-edm0fy9", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L41964", "text": "Imagine being upset by this"}
{"id": "open-goemotions-edm2plp", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L38838", "text": "I hope you like it-"}
{"id": "open-goemotions-edqmahz", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L42967", "text": "Why was nobody driving the damn thing? They were all in the backseat. :/"}
{"id": "open-goemotions-eds3oe6", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L25072", "text": "You're 105 years out of date. Please update your beliefs to the current version of the Constitution."}
{"id": "open-goemotions-edumqtx", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L5809", "text": "You're a horrible person."}
{"id": "open-goemotions-eduvcvy", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L6071", "text": "We have not been a Constitutional Republic for a long long time. The Constitution is just a nice idea at this point."}
{"id": "open-goemotions-edw419k", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L21850", "text": "\"we have a \"\"righty\"\" complaining about \"\"lefties\"\" making up BS, while they make up BS... sad.\""}
{"id": "open-goemotions-edw9jvd", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L22678", "text": "Real nice, swearing up a storm right in front of your kids."}
{"id": "open-goemotions-ee0ui7m", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L30860", "text": "You've got time to turn it around. I promise you. You can get there."}
{"id": "open-goemotions-ee2kfxs", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L12876", "text": "Agreed 100%, Governor [NAME] will have some say in this, they broke Wisconsin law, plain and simple !"}
{"id": "open-goemotions-ee3h6wr", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L17694", "text": "Hmmm, mildly interesting :)"}
{"id": "open-goemotions-ee75sip", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L22896", "text": "Yayyy!!! Go little green bean go!!! Good job trainer!!"}
{"id": "open-goemotions-eeamw5i", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L27443", "text": "I don’t think that tells us any moralising lesson on the practice of incest."}
{"id": "open-goemotions-eefzuzt", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L13081", "text": "[NAME], that fucking sucks."}
{"id": "open-goemotions-eegulbi", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L35840", "text": "Yah, I'm a bad girl. In fact I'm bad at everything."}
{"id": "open-goemotions-eelizvv", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L7322", "text": "Yea the conversation went as expected and now I'm looking for a new job. Thanks to all for the help"}
{"id": "open-goemotions-eelsbey", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L27429", "text": "Makes it even better that a multi millionaire successful pro athlete is shitting on him [NAME] damn I love me some sweet twitter roasting"}
{"id": "open-goemotions-eeq8ddu", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L16603", "text": "Lol!!!!!!!!!!!!! I love it."}
{"id": "open-goemotions-eer68if", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L9951", "text": "He's so far into his fantasy land he can't let anyone say a fact to his face, it would destroy his dreams. Poor little snowflake u/chabanais"}
{"id": "open-goemotions-eey0znf", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L15733", "text": "Short answer: No. Long answer: Nooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo."}
{"id": "open-goemotions-ef9kela", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L15900", "text": "Someone has a story."}
{"id": "open-goemotions-efdaasf", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L29366", "text": "Your name is amazing"}
{"id": "open-goemotions-efdl4z2", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L33172", "text": "Thanks now I’m insecure again"}
{"id": "open-goemotions-efdnw2c", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L31525", "text": "\"Here's another message \"\"You're a good mom. Your boy is lucky to have you.\"\"\""}
{"id": "open-goemotions-efect26", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L28853", "text": "Sorry to link it here but would love to get some opinions on this post"}
{"id": "open-goemotions-eff0egy", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L41468", "text": "Please tell me your shop didn't get you in trouble for that D:"}
{"id": "open-goemotions-eff5j9u", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L32483", "text": "But something is extremely wrong if people are getting sick. Might not be a sonic wave, but it definitely is *something*"}
{"id": "open-goemotions-efg2bx0", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L5356", "text": "Im so sorry"}
{"id": "open-goemotions-efgtipz", "knownLabels": ["sentiment"], "language": "en", "sourceDataset": "Google Research GoEmotions", "sourceLabels": {}, "sourceLicense": "Apache-2.0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L33128", "text": "In biblical Hebrew they're called [NAME], soos meaning horse and yaor meaning the Nile, in modern Hebrew they are called hipototam"}
{"id": "open-massive-en-US-10112", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "how do you cook a good burger"}
{"id": "open-massive-en-US-10167", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "find apple pie recipe"}
{"id": "open-massive-en-US-10643", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "lose the last item in the list"}
{"id": "open-massive-en-US-10663", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "what are my engagements today"}
{"id": "open-massive-en-US-10874", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "can you remove my to do list"}
{"id": "open-massive-en-US-1092", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "go to nytimes dot com"}
{"id": "open-massive-en-US-11059", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "name the lists available"}
{"id": "open-massive-en-US-11228", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "what is planned today"}
{"id": "open-massive-en-US-11637", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "tell me the movie with best i. m. d. b. ratings going on in theaters near me"}
{"id": "open-massive-en-US-12321", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "olly call a taxi"}
{"id": "open-massive-en-US-12474", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "where is the closest sweet frog"}
{"id": "open-massive-en-US-13327", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "call the closest mexican restaurant"}
{"id": "open-massive-en-US-1348", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "can you tell me the current time"}
{"id": "open-massive-en-US-13889", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "what is the capital of washington"}
{"id": "open-massive-en-US-13920", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "what is an orange like"}
{"id": "open-massive-en-US-14209", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "how old was elvis when he died"}
{"id": "open-massive-en-US-16203", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "do i have any new inbox message"}
{"id": "open-massive-en-US-16640", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "email joe and tell him to hurry"}
{"id": "open-massive-en-US-16722", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "have i gotten an email from sean"}
{"id": "open-massive-en-US-1727", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "please could you tell me if george's geek restaurant can i order takeaway from there"}
{"id": "open-massive-en-US-213", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "what's date today"}
{"id": "open-massive-en-US-2130", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "a little brighter thanks"}
{"id": "open-massive-en-US-2732", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "please start me some coffee"}
{"id": "open-massive-en-US-2837", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "change up the light colors at home"}
{"id": "open-massive-en-US-3765", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": true, "question": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "please set an alarm for me"}
{"id": "open-massive-en-US-417", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": true, "question": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "make an alarm for four p. m."}
{"id": "open-massive-en-US-4610", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "what time is it in the central time zone"}
{"id": "open-massive-en-US-5420", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "please turn on wemo socket"}
{"id": "open-massive-en-US-5470", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "alexa please turn on the lights"}
{"id": "open-massive-en-US-5745", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "show me what day the thirty first is on"}
{"id": "open-massive-en-US-5975", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "could you tell me what today's date is"}
{"id": "open-massive-en-US-6911", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "who is scheduled for tomorrow's meeting"}
{"id": "open-massive-en-US-7265", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "bring up my agenda"}
{"id": "open-massive-en-US-7478", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "tell me all the pending reminders"}
{"id": "open-massive-en-US-8200", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "what is on my schedule for today"}
{"id": "open-massive-en-US-8610", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "where the party will take start"}
{"id": "open-massive-en-US-8616", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "enter event for mondays only"}
{"id": "open-massive-en-US-8738", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "remove the event off the calendar"}
{"id": "open-massive-en-US-910", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "what time is it right now in new york"}
{"id": "open-massive-en-US-9960", "knownLabels": ["followUpReminder", "question", "task"], "language": "en", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "how do i steam rice"}
{"id": "open-massive-zh-CN-10782", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "我有什么任务"}
{"id": "open-massive-zh-CN-10918", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "我想删除中间的列表"}
{"id": "open-massive-zh-CN-11249", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "加入这个"}
{"id": "open-massive-zh-CN-11651", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "让我看看周围有什么"}
{"id": "open-massive-zh-CN-12151", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "帮我订张这周末去北京的中国高铁火车票"}
{"id": "open-massive-zh-CN-12180", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "我需要一辆优步到我的现在的位置"}
{"id": "open-massive-zh-CN-12228", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "我现在需要辆出租车"}
{"id": "open-massive-zh-CN-12396", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "订一张去利兹市的火车票"}
{"id": "open-massive-zh-CN-12552", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "你能帮我订一辆去目的地的出租车吗"}
{"id": "open-massive-zh-CN-12922", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "我什么时候能赶上最近的火车"}
{"id": "open-massive-zh-CN-1419", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "请更多光亮"}
{"id": "open-massive-zh-CN-1514", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "今晚是不是下雨来着"}
{"id": "open-massive-zh-CN-15222", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "在微博上发表评论"}
{"id": "open-massive-zh-CN-15232", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "将张三的歌发布到我的微博账户上"}
{"id": "open-massive-zh-CN-15390", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "管理微博状态"}
{"id": "open-massive-zh-CN-15526", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "用微博发给大润发客服投诉"}
{"id": "open-massive-zh-CN-15682", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "这是康卡斯特的一条微博如果我有你的中国电信和电话服务我怎么联系你"}
{"id": "open-massive-zh-CN-16006", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "天猫精灵请帮我检查我的电子邮件"}
{"id": "open-massive-zh-CN-1609", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "请开始煮咖啡"}
{"id": "open-massive-zh-CN-16200", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "请给拉里的新邮箱地址 larrylarry at gmail dot com 发封电子邮件"}
{"id": "open-massive-zh-CN-16204", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "发送这条信息给家庭组"}
{"id": "open-massive-zh-CN-16986", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "你能查看我是否收到来自家明的电子邮件"}
{"id": "open-massive-zh-CN-241", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "外面怎么样"}
{"id": "open-massive-zh-CN-2990", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "新的科技新闻"}
{"id": "open-massive-zh-CN-4352", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "告诉我太平洋标准时间"}
{"id": "open-massive-zh-CN-5178", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "确认我现在需要伞吗"}
{"id": "open-massive-zh-CN-5980", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "现在澳大利亚几点"}
{"id": "open-massive-zh-CN-6418", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "打开备忘录记录我的会议"}
{"id": "open-massive-zh-CN-6804", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "每天提醒我要在凌晨一点前睡觉"}
{"id": "open-massive-zh-CN-709", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "给我看选举投票的最新消息"}
{"id": "open-massive-zh-CN-7172", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "李雷想周日十一点会面你能在每周周六晚上提醒我吗"}
{"id": "open-massive-zh-CN-7283", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "删除我的一点半的预约"}
{"id": "open-massive-zh-CN-7466", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "告诉我现在正在发生的事件"}
{"id": "open-massive-zh-CN-7874", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "从现在开始的三天我需要和李强安排一个活动"}
{"id": "open-massive-zh-CN-8092", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "周日白天我有空吗"}
{"id": "open-massive-zh-CN-8228", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "我的星期五什么时候开会"}
{"id": "open-massive-zh-CN-8313", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "苏珊的生日是三月一日吗"}
{"id": "open-massive-zh-CN-8505", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "我的本月的日程表安排是什么"}
{"id": "open-massive-zh-CN-8845", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "清空我的日历"}
{"id": "open-massive-zh-CN-9091", "knownLabels": ["followUpReminder", "question", "task"], "language": "zh-Hans", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": {"followUpReminder": false, "question": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "text": "清除日历中的所有的事件"}
{"id": "open-multidogo-airline-<CONV>3a77afb0-10f7-4399-aed8-58512ae89fc5<TURN>2", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L8868", "text": "can you check my seat assignment"}
{"id": "open-multidogo-airline-<CONV>42d376c2-ebd6-4c9f-8ad0-0859e3d93c60<TURN>6", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": true, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L542", "text": "wow thats wonderful please gohead and confirm it"}
{"id": "open-multidogo-airline-<CONV>635cf5fe-c9c5-408c-9652-cff6470ff96e<TURN>1", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L10103", "text": "can you please tell me what my seat number is my confirmation number is hhd 542"}
{"id": "open-multidogo-airline-<CONV>7d7eb5fb-daf9-4b77-b00f-336a17ad05ef<TURN>14", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": false}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L10945", "text": "have a perfect day good bye"}
{"id": "open-multidogo-airline-<CONV>9115a2cc-b065-4f38-99bf-4f4644f769ad<TURN>12", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L4721", "text": "will you change the window seat to aisle"}
{"id": "open-multidogo-airline-<CONV>96c056ed-0abb-403d-ada5-b81067d9f0e1<TURN>1", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L13077", "text": "tell me my seat number"}
{"id": "open-multidogo-airline-<CONV>c1fd4c09-fcc8-4a9d-812f-97cc14b71f5c<TURN>12", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L12279", "text": "please have your time"}
{"id": "open-multidogo-airline-<CONV>cf339b58-1802-4ae6-9428-b5f1b726145b<TURN>2", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L3790", "text": "check my seat assignment"}
{"id": "open-multidogo-airline-<CONV>e7168567-9cc0-4852-a10b-6cc9f4bf90f1<TURN>10", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L11108", "text": "charlie sorry could you please change to window seat"}
{"id": "open-multidogo-airline-<CONV>ef984b73-87da-43c7-a01d-cf345a2b33a7<TURN>4", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L7057", "text": "can you send it to my email"}
{"id": "open-multidogo-airline-<CONV>f5483ab2-6ef0-4423-9452-ceaa6567bac2<TURN>16", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": false}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L7609", "text": "have a nice daygood bye"}
{"id": "open-multidogo-fastfood-<CONV>1617bf7b-043e-49f5-a2b0-b194ab173a8c<TURN>5", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L8522", "text": "chocolate mikeshake"}
{"id": "open-multidogo-fastfood-<CONV>3468c2d5-b656-4aae-bade-8450dbaa3838<TURN>3", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L8030", "text": "no thanks but can i get a side of large fries with it"}
{"id": "open-multidogo-fastfood-<CONV>691eed09-466e-42a9-aba4-e4f0865627b0<TURN>1", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L1502", "text": "i like to have a pizza"}
{"id": "open-multidogo-fastfood-<CONV>787f5a4d-271c-4671-9134-53cb3d0572a2<TURN>5", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L7820", "text": "southwest buttermilk crispy chicken salad"}
{"id": "open-multidogo-fastfood-<CONV>c8885516-5008-40f0-a83a-8bded8907f1f<TURN>10", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L8908", "text": "add fries medium with diet coke"}
{"id": "open-multidogo-fastfood-<CONV>cb6a933b-e78e-4f42-9859-072502b2a93d<TURN>9", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L838", "text": "thatll be all actually can i not have bbq drizzle on my pizza"}
{"id": "open-multidogo-finance-<CONV>06a5d4bf-582b-4153-9ed9-77174bdf1a3f<TURN>2", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L12502", "text": "i want to know my account balance could you please help me with that"}
{"id": "open-multidogo-finance-<CONV>09ea7462-4548-4190-bbf9-c8ef68eff2ff<TURN>2", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L4004", "text": "i want remove error bill in my credit card"}
{"id": "open-multidogo-finance-<CONV>2ddd9985-0297-41dc-bf9b-7da490ad27b2<TURN>4", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L8153", "text": "i need to block and apply the new card"}
{"id": "open-multidogo-finance-<CONV>4ff7ea74-7bf8-480f-b32e-796f981d4690<TURN>1", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L3378", "text": "i want to transfer money from one account to another"}
{"id": "open-multidogo-finance-<CONV>6a2c2e90-80e3-4bed-b1ae-e46352fad37e<TURN>5", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L1822", "text": "yes please check my account balance of last four digit with 8523"}
{"id": "open-multidogo-finance-<CONV>6d8d6219-54cf-4a11-a20b-5e90bd74110d<TURN>1", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L5362", "text": "hi drew i would like to close my account can you help me"}
{"id": "open-multidogo-finance-<CONV>768b9755-ae63-4468-b1c3-a7be9cb9de7d<TURN>13", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L5877", "text": "yesi need to order checks"}
{"id": "open-multidogo-finance-<CONV>8522ed9a-4478-4993-b129-312110d217b6<TURN>11", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": false}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L1222", "text": "thankyou for telling this i want to know banks routing number"}
{"id": "open-multidogo-finance-<CONV>bad487db-c120-4b3d-bac9-7dc50ce5a70d<TURN>2", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L12784", "text": "can you please order a new credit card because my old one expired"}
{"id": "open-multidogo-finance-<CONV>d141b9e9-0157-47d4-a642-3378b12f6a9a<TURN>2", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L10475", "text": "my credit card was expiry can i apply new card"}
{"id": "open-multidogo-finance-<CONV>e8e210ba-ca6e-471a-b9e2-2f84e55ed499<TURN>2", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L14075", "text": "find out the banks routing number"}
{"id": "open-multidogo-finance-<CONV>f53cc617-26d4-4eaa-be85-3d13a12c2d2c<TURN>0", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L13213", "text": "hello i would like to check my account balance please"}
{"id": "open-multidogo-media-<CONV>3269ff16-32ff-4d8d-8586-b178cd9a68a7<TURN>8", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": true, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L9312", "text": "perfect please confirm the plan"}
{"id": "open-multidogo-media-<CONV>3dfcd6b8-b829-4e5b-a97c-e5d8120bd75b<TURN>3", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L8688", "text": "can you please help me to see my bill of my account"}
{"id": "open-multidogo-media-<CONV>58cd816a-5be6-45f2-9faa-484cd4222398<TURN>2", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L3211", "text": "yes can you know me the details about the internet service for my home"}
{"id": "open-multidogo-media-<CONV>7b50d813-22d4-47c5-a466-fda86fbe69b7<TURN>3", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": true, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L297", "text": "yes please help me"}
{"id": "open-multidogo-media-<CONV>8b07e256-f4bd-449a-ae6e-4362ce0ad51f<TURN>9", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L4315", "text": "make a connection as soon as possible"}
{"id": "open-multidogo-media-<CONV>92aa2085-36e0-416f-b616-c5c26896b6f7<TURN>11", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": false}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L9277", "text": "may i know this plan have internet option"}
{"id": "open-multidogo-software-<CONV>86eaf2de-044b-43de-8b2c-cd5ebf6d2c51<TURN>9", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": true, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/software/train.tsv#L7106", "text": "yes please"}
{"id": "open-multidogo-software-<CONV>a7ddddb6-ff99-4d40-9f90-09b457f0152e<TURN>9", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/software/train.tsv#L12504", "text": "also can you please check the global status of the server"}
{"id": "open-multidogo-software-<CONV>d885d685-6c06-4c0b-bee9-8255e87ea7bb<TURN>4", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": true, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/software/train.tsv#L4004", "text": "please check my clobel status for my softwarews"}
{"id": "open-multidogo-software-<CONV>db0edc0f-4148-45ba-ab7b-94dc09020618<TURN>4", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/software/train.tsv#L10514", "text": "i have a 220 rental car expense 850 for the hotel and 100 for gasoline"}
{"id": "open-multidogo-software-<CONV>fff2c827-8a9e-4b5c-82be-b5edfd551a09<TURN>2", "knownLabels": ["confirmationDecision", "question", "task"], "language": "en", "sourceDataset": "MultiDoGO", "sourceLabels": {"confirmationDecision": false, "question": false, "task": true}, "sourceLicense": "CDLA-Permissive-1.0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/software/train.tsv#L363", "text": "i want to purchase some keyboards"}
{"id": "open-taskmaster-dlg-358f37c1-ff58-4a0b-baba-e13d2fd7e91a-12", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Could you please send it to my location?"}
{"id": "open-taskmaster-dlg-47a2fdac-9da1-43a8-a3db-9a69ec1f2c7e-16", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Okay that's great is the order under my name?"}
{"id": "open-taskmaster-dlg-492c1586-03c4-4369-a672-e0279ffc5e0b-4", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "I have heard good things about The Chophouse. Can you make a reservation for me please?"}
{"id": "open-taskmaster-dlg-4e7f31e8-76dc-4b29-9e2b-f2cd33ec0f42-18", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "What time do they close?"}
{"id": "open-taskmaster-dlg-514731c8-b1f8-4dfd-a576-b77467d3a2b4-10", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "I see, is there an imax showing for Hellboy other than at 6pm?"}
{"id": "open-taskmaster-dlg-54b7e34e-93e7-4d80-a366-731d520e7af8-16", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Ok can you go ahead and purchase 2?"}
{"id": "open-taskmaster-dlg-58708a29-00b4-4e9b-824c-de256c783820-6", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "I would like to know the availability of seats in the 9:00 p.m show. Could you please assist me with that?"}
{"id": "open-taskmaster-dlg-5bde0835-4643-4397-ae9d-7866888a62b7-14", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Great can you confirm the order?"}
{"id": "open-taskmaster-dlg-71869301-e89c-4484-a41f-9a7dde268dee-18", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "And can I also get a splash of pink lemonade in that?"}
{"id": "open-taskmaster-dlg-873fee8e-332d-43fe-bd42-cf9907e5940c-6", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "I don't like Eggnog, do they have anything else?"}
{"id": "open-taskmaster-dlg-8b5b8bc8-da47-4f86-801d-2c05fa60aa3b-12", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Yes. If there's no coconut milk, ask for oat milk. If there's no oat milk, almond milk. Got it?"}
{"id": "open-taskmaster-dlg-902d28b1-56a1-4249-ad4c-7ff84ea2ca26-8", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "How about 6:00 pm?"}
{"id": "open-taskmaster-dlg-970b1696-28b5-4e16-ba83-fb7e31445a30-4", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "I want an X-large supreme pizza please. But instead of green pepper can I get zucchini on that?"}
{"id": "open-taskmaster-dlg-98c53bef-df59-4ab1-bc8f-5c006c4671f8-0", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Can you get me a Starbucks?"}
{"id": "open-taskmaster-dlg-a5a8569f-98b7-4054-94d7-941bbe5a74e7-10", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "If that doesnt work can you check what other times are available?"}
{"id": "open-taskmaster-dlg-a7a5fb3a-2bbe-4278-9e41-ff968fdd80af-10", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Okay. Is there a patio outside?"}
{"id": "open-taskmaster-dlg-ab4f13a3-19ff-4af1-ad84-9bfd8465b25d-0", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Hi. I am absolutely starving. Can you order me a pizza?"}
{"id": "open-taskmaster-dlg-ae3eadbe-8577-4a3a-adac-406c0a2a6515-14", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Yes is there any other fees?"}
{"id": "open-taskmaster-dlg-b25c11f4-af49-4018-8e90-89ab7201786e-10", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Could you please ask them to have it ready at 6:00 pm?"}
{"id": "open-taskmaster-dlg-b3d79e61-eb01-4244-a3c2-baec23707a84-8", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "True. Okay, how about an iced caffe mocha?"}
{"id": "open-taskmaster-dlg-b6813ffb-6f52-4dcf-be61-dfb7889a5be7-0", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Hello, I'm really feeling Starbucks today. Could you please order me a Iced Blonde Cinnamon Cloud Macchiato,?"}
{"id": "open-taskmaster-dlg-bc341386-1c38-48f7-9c06-9c7a49355f83-6", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "I checked with my friend and that is too late for us. Can you look into the movie US, my friend whats to see that one, around 4:00. So we can eat and shop, before the show?"}
{"id": "open-taskmaster-dlg-bf903ea2-2080-4d74-a457-c9a8b7aa5444-12", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "What about 7?"}
{"id": "open-taskmaster-dlg-c102e26c-1aee-4a65-b5b1-c886b6b91f0d-12", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Actually can you change my order to something else?"}
{"id": "open-taskmaster-dlg-c1b054cb-ef63-427f-8f6f-7e68f697787e-0", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Hi I'm running late again and need to pick up supper on my way home. Can you call in a pizza order for me?"}
{"id": "open-taskmaster-dlg-c214b676-2b94-4a58-a2eb-f6dc0c95f5c6-10", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Can you order Y for me please"}
{"id": "open-taskmaster-dlg-c578ddb3-479f-427f-a614-90e02ff149d5-14", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "That is too late. What do they have available on Wednesday?"}
{"id": "open-taskmaster-dlg-c5a97940-d02e-4313-b34b-6862b65f56cc-6", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Yes that would be great! How much is the fare?"}
{"id": "open-taskmaster-dlg-c86eb60b-b858-486f-af8c-957f3287cf51-0", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "What are some really good Italian restaurants"}
{"id": "open-taskmaster-dlg-cb365cb0-98da-47d9-b270-5824b1858ab7-8", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Can you tell me times for other locations?"}
{"id": "open-taskmaster-dlg-d118ebbc-561a-418b-bd5f-fd57b0126bd7-16", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "is it at 4:20"}
{"id": "open-taskmaster-dlg-d37cee1f-7df1-4311-b4a6-34383c25643f-8", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": true, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "what time would they have a table"}
{"id": "open-taskmaster-dlg-d7abdbb2-d3ad-4506-bfe1-b2d125e82c50-6", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Oh yes. I almost forgot. Can you have them go easy on the sauce?"}
{"id": "open-taskmaster-dlg-dd438d00-2322-435a-9f4a-f1bca8c621c9-14", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Have them pick me up at 8 AM please."}
{"id": "open-taskmaster-dlg-eb85e2af-9bef-4e79-bc84-88f439100d30-0", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Hello! Can you order me a coffee from Starbucks?"}
{"id": "open-taskmaster-dlg-eceee47e-a4c9-431b-a730-a593873f8864-14", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Okay, can you text me the details?"}
{"id": "open-taskmaster-dlg-f0f8de86-fe25-4a62-87b6-aceb779ca6f4-0", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Can you get me tickets for the movie US?"}
{"id": "open-taskmaster-dlg-fa9a9747-e85e-4341-9f8b-647191d75be0-0", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": false, "question": true, "scheduleNegotiation": false, "task": true}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Can you see if there are any available showings for Alita Battle Angel"}
{"id": "open-taskmaster-dlg-fb4bb7ce-3cd8-418e-abf8-47c90098e97b-10", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Is an UberX listed?"}
{"id": "open-taskmaster-dlg-fd25ed51-e404-4a9b-bfdb-c86afc8fb09a-24", "knownLabels": ["confirmationDecision", "question", "scheduleNegotiation", "task"], "language": "en", "sourceDataset": "Google Taskmaster-1", "sourceLabels": {"confirmationDecision": true, "question": true, "scheduleNegotiation": false, "task": false}, "sourceLicense": "CC-BY-4.0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "text": "Okay do you think I can use the company card?"}
ModelTraining/ClipboardSemantics/Consensus/product-policy-anchors-v1.json
-182
View File
@@ -1,182 +0,0 @@
[
{
"id": "human-anchor-001",
"text": "下一班离开纽约市的火车几点出发",
"language": "zh-Hans",
"expected": {"recordDisposition": "exclude-device-command"}
},
{
"id": "human-anchor-002",
"text": "告诉我露丝姑妈的电子邮件地址",
"language": "zh-Hans",
"expected": {"recordDisposition": "keep", "replyableMessage": "true", "task": "false", "question": "true", "ambiguous": "false"}
},
{
"id": "human-anchor-003",
"text": "顺便说一下，这件事我会亲自处理：预约会议室，计划周五之前开始。",
"language": "zh-Hans",
"expected": {"recordDisposition": "keep", "replyableMessage": "true", "task": "true", "question": "false", "ambiguous": "false"}
},
{
"id": "human-anchor-004",
"text": "在我上班的路上有什么事故吗",
"language": "zh-Hans",
"expected": {"recordDisposition": "exclude-device-command"}
},
{
"id": "human-anchor-005",
"text": "take your time",
"language": "en",
"expected": {"recordDisposition": "keep", "replyableMessage": "true", "task": "false", "question": "false", "ambiguous": "false"}
},
{
"id": "human-anchor-006",
"text": "tell me what's new",
"language": "en",
"expected": {"recordDisposition": "exclude-device-command"}
},
{
"id": "human-anchor-007",
"text": "知道了，这边谢谢。",
"language": "zh-Hans",
"expected": {"recordDisposition": "keep", "replyableMessage": "false", "task": "false", "question": "false", "ambiguous": "false"}
},
{
"id": "human-anchor-008",
"text": "另外，活动规则按当前方案通过。",
"language": "zh-Hans",
"expected": {"recordDisposition": "keep", "replyableMessage": "false", "task": "false", "question": "false", "ambiguous": "false"}
},
{
"id": "human-anchor-009",
"text": "我拍板用先发布基础版，其他候选停止评估。",
"language": "zh-Hans",
"expected": {"recordDisposition": "keep", "replyableMessage": "true", "task": "false", "question": "false", "ambiguous": "false"}
},
{
"id": "human-anchor-010",
"text": "还有一件事，我批准退款流程的最终版本，可以签字。",
"language": "zh-Hans",
"expected": {"recordDisposition": "keep", "replyableMessage": "true", "task": "true", "question": "false", "ambiguous": "false"}
},
{
"id": "human-anchor-011",
"text": "事情总算处理完了，结果居然成了。",
"language": "zh-Hans",
"expected": {"recordDisposition": "keep", "replyableMessage": "true", "task": "false", "question": "false", "ambiguous": "false"}
},
{
"id": "human-anchor-012",
"text": "好的，谢谢您的回答。",
"language": "zh-Hans",
"expected": {"recordDisposition": "keep", "replyableMessage": "false", "task": "false", "question": "false", "ambiguous": "false"}
},
{
"id": "human-anchor-013",
"text": "你能把报告发给我吗？",
"language": "zh-Hans",
"expected": {"recordDisposition": "keep", "replyableMessage": "true", "task": "true", "question": "true", "ambiguous": "false"}
},
{
"id": "human-anchor-014",
"text": "报告什么时候发给我？",
"language": "zh-Hans",
"expected": {"recordDisposition": "keep", "replyableMessage": "true", "task": "false", "question": "true", "ambiguous": "false"}
},
{
"id": "human-anchor-015",
"text": "请推荐一家附近评分 4.5 以上的餐馆。",
"language": "zh-Hans",
"expected": {"recordDisposition": "exclude-device-command"}
},
{
"id": "human-anchor-016",
"text": "I need to set up a new PIN.",
"language": "en",
"expected": {"recordDisposition": "keep", "replyableMessage": "false", "task": "true", "question": "false", "ambiguous": "false"}
},
{
"id": "human-anchor-017",
"text": "my claim status",
"language": "en",
"expected": {"recordDisposition": "exclude-device-command"}
},
{
"id": "human-anchor-018",
"text": "send an email to Julie that I can meet her Saturday at 1 p.m.",
"language": "en",
"expected": {"recordDisposition": "keep", "replyableMessage": "true", "task": "true", "question": "false", "ambiguous": "false"}
},
{
"id": "human-anchor-019",
"text": "call Mark",
"language": "en",
"expected": {"replyableMessage": "unknown", "task": "unknown", "question": "unknown", "ambiguous": "true"}
},
{
"id": "human-anchor-020",
"text": "text Sarah that I'll be late",
"language": "en",
"expected": {"recordDisposition": "keep", "replyableMessage": "true", "task": "true", "question": "false", "ambiguous": "false"}
},
{
"id": "human-anchor-021",
"text": "open my inbox",
"language": "en",
"expected": {"recordDisposition": "exclude-device-command"}
},
{
"id": "human-anchor-022",
"text": "show me my account balance",
"language": "en",
"expected": {"recordDisposition": "exclude-device-command"}
},
{
"id": "human-anchor-023",
"text": "book me a taxi to the airport",
"language": "en",
"expected": {"recordDisposition": "keep", "replyableMessage": "true", "task": "true", "question": "false", "ambiguous": "false"}
},
{
"id": "human-anchor-024",
"text": "set an alarm for 4 a.m.",
"language": "en",
"expected": {"recordDisposition": "exclude-device-command"}
},
{
"id": "human-anchor-025",
"text": "internet",
"language": "en",
"expected": {"replyableMessage": "unknown", "task": "unknown", "question": "unknown", "ambiguous": "true"}
},
{
"id": "human-anchor-026",
"text": "chennai 45879",
"language": "en",
"expected": {"replyableMessage": "unknown", "task": "unknown", "question": "unknown", "ambiguous": "true"}
},
{
"id": "human-anchor-027",
"text": "seat assignment",
"language": "en",
"expected": {"replyableMessage": "unknown", "task": "unknown", "question": "unknown", "ambiguous": "true"}
},
{
"id": "human-anchor-028",
"text": "maximum kilometer to delivery",
"language": "en",
"expected": {"replyableMessage": "unknown", "task": "unknown", "question": "unknown", "ambiguous": "true"}
},
{
"id": "human-anchor-029",
"text": "事件重复的整个月",
"language": "zh-Hans",
"expected": {"replyableMessage": "unknown", "task": "unknown", "question": "unknown", "ambiguous": "true"}
},
{
"id": "human-anchor-030",
"text": "意大利面的食谱",
"language": "zh-Hans",
"expected": {"recordDisposition": "exclude-device-command"}
}
]
ModelTraining/ClipboardSemantics/Consensus/silver-acceptance-evaluation-report.json
-2506
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/Consensus/silver-acceptance.jsonl
+40
View File
@@ -0,0 +1,40 @@
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-11380", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "eb812c57cd3dda3a62b32a127d09f492e0ef4f319d8302597df2778738646efc", "cursor-grok-4.6-xhigh": "b72b9331ab2daabb64b0383b336320793c26bc2d7c14a055d0b8bad4bb09bd53", "gpt-5.6-luna-medium": "20f2d25cd09db8c927203f42b902065283766accf3739773f2dc59b56277dd79"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-11380", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-11380", "split": "silverAcceptance", "task": false, "text": "口味:菜上了之后就很失望,色面就很普通,味道也是很普通,每道菜都是很普通,都没有一道是满意的,木瓜酥难吃,虾饺像速冻的一样,金钱肚不入味,凤爪点错了,也是难吃,炒饭就和外面福建沙县里的炒饭的味道一样。\\\\n环境:开在公园里,至少开了10年的店,白天进来发现装修已经落后了,不过有一点好,就是人少,安静,但是!有一个大缺点就是地毯,地毯看得出很脏,空气中还弥漫了一股臭味。\\\\n服务:上个苏打水,拿了半天没来,上菜速度倒是可以,服务员一点精神都没有。\\\\n上次晚上来包房和家人聚餐时对这家店留下的印象还挺好,味道,服务,环境都不错,两年后来吃中饭,这里的点心真是让人失望,还是唐宫好吃"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-22337", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4575c967d4ced986d15bc22229a6401339201cd3cc3345532d19bf47156df533", "cursor-grok-4.6-xhigh": "9b8cddd7feabe03b46aa9f92af4169359510112ef7742ebcba4eeeb06c27d062", "gpt-5.6-luna-medium": "b12950d508fe7404d9272eb7a238e9dd6835fc06e80f1b08789bd5604b2ea18c"}, "labelerVotes": {"complaint": 3, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-22337", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-22337", "split": "silverAcceptance", "task": false, "text": "总体来说,是不会再去第二次的消费地点。价格超级无敌的贵,菜品卖相很不好,很不精致,黑乎乎咸乎乎的,口味很差。专门去吃口味蛇,但是特别失望。口味蛇纯粹是被辣椒熬出来的,辣得无法张口,根本无法下咽。餐厅有一股霉味道,拥挤得很,还要收包厢服务费。。。餐前水果都变味了,变质了,放冰箱太久了。七个人花了1100多,真心不值这个价钱,建议大家千万不要去。之前有好多网上的好评论,可能都是他们花的钱,请的托,大家不要上当。。。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-23652", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a1d76837fc1bd0e6bb731543b09b050e301984270c22427bf11738a859fec869", "cursor-grok-4.6-xhigh": "a1d76837fc1bd0e6bb731543b09b050e301984270c22427bf11738a859fec869", "gpt-5.6-luna-medium": "e29bc559ce97ee7c0903a6ac885d76ace7661f566939794f07711e22d28a4807"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-23652", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-23652", "split": "silverAcceptance", "task": false, "text": "我是抽奖抽到一个海鲜锅。之前去过他家光华村那家店感觉很好,所以这次非常高兴的就前往了。结果感觉非常不好。首先这个海鲜锅并没有宣传照片上那么华丽,端上来直接就是一锅开水煮白菜放了几个虾、2个蛏子,搂底能看到下面有些虾皮和墨鱼仔须须。汤的味道并没有任何海鲜本来的味道,基本全是靠调味品勾兑的。感觉有点欺骗消费者不说,连起码的一点卖相都没有。不知道是这一家店是这样还是其他几家店都这样?让我对这家泰国鱼翅馆现在的阿诺泰仅存的好感荡然无存。此外,其他菜品的价位感觉都比正常价位贵一倍或者1/3。价格不亲民,东西没卖相。。。不知道以前泰国领事馆为啥还要推荐。。。而且,团购券折扣力度微乎其微周末还无法使用,让本来就很不实惠的消费更加不实惠。所以我只能给2星。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-31166", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "69d0b5a899480e512cff56623bfbee7c77e317bcd501f5ad80c47aba2e5b1bde", "cursor-grok-4.6-xhigh": "292383b495f51a5412a6cb7288fdc30ea25af51ebda6209c1e12fbf4dc656929", "gpt-5.6-luna-medium": "9b6ae2c49219422ab7cc5c45650f2034e6799235126d3a72f3de34f28fada286"}, "labelerVotes": {"complaint": 2, "confirmationDecision": 1, "question": 1, "replyableMessage": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-31166", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-31166", "split": "silverAcceptance", "task": false, "text": "用了大众点评活动~九折~要了一个薯条~不评论不过不失~先说好的~服务还可以~看样子卫生不错~ 服务和卫生对于一个吃货来说固然重要~~~然而味道更重要~~本着大众点评是用作各位吃货的公平公正的平台~我觉得真实评价很重要!!!!炸鸡是重点~因为我第一次在广州吃韩国炸鸡是在西城都会那家~从此我爱上这个东东~~~我见很多网友评论这家分数这么高~本着西城都会那家对广州版韩国炸鸡的标准对这家点抱有好大的希望~~~结果~~味道好不好见仁见智~我觉得像超市十块钱一整只香辣炸鸡加了酱料在表面一样~~~这里要88一只全鸡~~我是双拼了两个口味所以有两盘~~~我有个疑惑~全鸡不是应该是一整只鸡的意思吗?我上桌的全鸡是没有臂膀的~~颠覆了我的认知~是因为我用了优惠活动吗?只是有一只鸡腿在一堆碎鸡(四分之一手掌大)上面~~请问其他小伙伴你们吃的是这样的吗?在广州我觉得食物始终是店铺持久经营的灵魂~~~"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-34345", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ef10e5a04e4bc69727b912db279782001d5b44d57ad8687269e1f6dbbcc85b36", "cursor-grok-4.6-xhigh": "db157bfbf04455222fc02b4d48af2ab1455383b7be6ec32fe5e67cc0358628e4", "gpt-5.6-luna-medium": "e1ee9970a4c836932c88c1ccef48e978e46b2e97d88e307fd82944c682dad62a"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-34345", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-34345", "split": "silverAcceptance", "task": false, "text": "绝对的差评!!本来看了大众上点评不好,还抱着试一试的心理去了,没想到真的不该来!首先桌子旁的点菜台,服务员自己就不怎么会用,我们觉得放的太高,看着不方便,就拿下来,结果服务员看到就厉声说“这个不可以拿下来,我们有监控的!”你说不可以拿下来我理解,但是TMD后面一句我们有监控的什么意思??!!然后每个人都要强迫收茶位费,我们每人点了一份饮料之后就开始点主食,结果点炒饭的时候,里面又包含了一杯饮料,我们就问服务员怎么回事,她回答说这个饮料是送你们的......那我们就很不解,你都有饮料为什么还要强迫每人都点饮料,这不是霸王条款么?!......吃饭期间有隔壁桌顾客愤然离席~可想而知服务有多差,菜品味道也很糟糕,饭又硬,牛肉吃着像猪肉,杯子没洗干净,粘糊糊的......各种不愉快......这家店不好好培训下员工我看迟早要完蛋!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-35453", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "81b228af35eef3ead2d47c5c4bf9a0fca900729c91c1efbfa739045f0afd21cf", "cursor-grok-4.6-xhigh": "482c8212c104dd3aadb2a8c7bd98b3b352de852ddf28d136d7a8c0d29b733b9a", "gpt-5.6-luna-medium": "033a2e773e78a41e6adcb96f220dd46a4927f2b16bf516e704608efd9d0724e4"}, "labelerVotes": {"complaint": 2, "confirmationDecision": 1, "question": 1, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-35453", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-35453", "split": "silverAcceptance", "task": false, "text": "菜品真的不想说太多,不知道网上那些那么多的好评怎么来的,水军真的太多,真的是济南最好的自助餐厅嘛?看了下网上的菜单品种很多,今天去了海鲜只有三种!煮熟的蛤蛎、煮熟的海星触角、煮熟的的扇贝、唯一生的就是三文鱼片!三文鱼限量供应,薄如纸片...扇贝太老、网上看的照片有烤牛舌、有鹅肝、有煎牛排、有西瓜汁、牛排、烤鸭卷、焗番薯,这些都没有看到,大部分感觉和早餐差不多。本来想用团购,因为我是住店顾客,说是138元,网上团购是128元。相差10元也无所谓,三文鱼真的太薄了,第一次吃到这样的厚度,限量供应,每次每人7片左右。不过客房服务还是挺好的。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-40660", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "425c01877569e0d05ef8f0ef87fc38391afefda01848009ff7aa6e53b2efec33", "cursor-grok-4.6-xhigh": "bc7179d9610de46a55f10a98892acba578faa48024421b4322d59333eeb0da3d", "gpt-5.6-luna-medium": "b404ec9386a8a457aa1fd88681f8edce5b1d10f1ed887f8bafc127557c2fdc08"}, "labelerVotes": {"complaint": 2, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-40660", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-40660", "split": "silverAcceptance", "task": false, "text": "针对这家的价位而言:设施不全没有本店自己的洗手间;口感差:其中一道酸辣汤辣的我们不轻,打包时碗底还沉着那么多胡椒粉,回家添了两碗水加了菜和面片还辣的大家出汗。另外的菜油性大,口感一般。炸菇的辣椒都发苦。菜量小。土豆丝18一份,36元的茄子没多少,因为极辣,带回家也没吃完一半。餐纸自费,打包盒自费。整体来讲没有以前的清心莲高雅周到但价位高;没有新开的自然林的品种多;也没有卫校对面那家素包子铺和乐天原来15元的自助亲民实惠;更没有雨花斋的感恩氛围。对于一个吃素食的人来讲,这顿饭没吃好,似乎不知它定位在哪里。第一次让我有了下次不来了的感觉。只是最后结账时的那个男孩一直很温和,体贴,很是受安慰。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-44699", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "13d7e6307f533cc495c7d96f5bdac19b29b2478f4bcc060c51898af9d0d6265e", "cursor-grok-4.6-xhigh": "b59d4aaed223aa2ed16b4bcc0fc6ccd15f504818261e5f530f7e1314ddf7ea37", "gpt-5.6-luna-medium": "0a785018f041aa7b0f153b872fdc48868ca5bfe6c493f1305602bef3dd743d24"}, "labelerVotes": {"complaint": 2, "confirmationDecision": 1, "question": 1, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-44699", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-44699", "split": "silverAcceptance", "task": false, "text": "地址:人民公园西门向被300米路西......走到一看店家门面活动价也是一元一个鸭头......有些人会觉得门面现金价和团购价一样都是一元一个鸭头,会有一些心理落差!其实我觉得还好,一元能买到一个鸭头,不管了门面活动价还是团购价都很值......一个帐号最多买六个~~服务还挺好的,走到说是大众点评团购的,说了一个验证码就可以连续把六个都验证了,很方便!环境一般,就是一般的门头,所有卖的东西都是外带的。没有餐桌,只能打包带回家吃!回到家一看鸭头上面很多毛都没清理干净,看着就浑身起鸡皮疙瘩......顿时胃口全无!挑了一个没怎么有鸭毛的尝了尝,说实话口味还是可以的,麻辣口味的!就试吃了这一个,剩下的五个都扔了!看着鸭头上的鸭毛实在吃不下去!希望商家要注意,以后一定要把鸭毛清理干净......"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-6854260", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "464aef7707db8a7a43a7b7d85e68dd7a9d612aa7186572323fdf5957d02002fd", "cursor-grok-4.6-xhigh": "0a7b8b13bd46b1f23ef4bad5b1d5ee218770e57a21067b90bf42e9713f9202b3", "gpt-5.6-luna-medium": "cc02250df86bbd528060fe00d2f56154b6335493fcca9080f7cece05c3495941"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-6854260", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6854260", "split": "silverAcceptance", "task": false, "text": "The account in question is not mine, as I stated in my initial complaint. Despite the fact that it says this account has been validated, the information is still incorrect. This account has to be immediately deleted from my credit record, as requested."}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-10760", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d048a39cebcd2aad510978f9d8bd56c8e087280778f13cc2d44de75c5da83b98", "cursor-grok-4.6-xhigh": "7f7a364cbdd5fa8d8607c9bfcc7d328a0f7df4274fb14002928220addc14af92", "gpt-5.6-luna-medium": "b5411289d25fefa0035bae2defc1cf4a62cccb57ac1f8fe24ca7313209dbbaa9"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-10760", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": false, "text": "i am in need of my location"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-11549", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "cf6705c44d47c7cb7a048bd779f32a7b691f5d25045f136c0d536a477372c22a", "cursor-grok-4.6-xhigh": "ddbdca3410163da413411b24e64ddf80f5922de39acbcdd522aed3da7f763624", "gpt-5.6-luna-medium": "1dd1d4d936abac093c079b7b563bee1397086721f99e906bf4f4ab253915f9c8"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-11549", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": false, "text": "check days of pto"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-12331", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "602fd91dda771368abc490a738de5b6d63c9beef683a04f6831d5539ebe41c51", "cursor-grok-4.6-xhigh": "e97c3ee9b424b194f34b5f8ed310cd0cc1d89e39c38188f9927d2cc31c93cd08", "gpt-5.6-luna-medium": "58e21c7cf3f27233386a9b0016ff09345e9717706c29abdbd1f82f6ae73825ce"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-12331", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": true, "text": "can you increase my credit limit"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-12742", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.75, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "09d8dee726377e877988d0735cbca7bd1355a09b77f295ecd666d2ebae1d244d", "cursor-grok-4.6-xhigh": "bb71dcd10a55648d59bc46e157b4ca8ab8bba2923870edd69057779b0af606d3", "gpt-5.6-luna-medium": "9806fd06281fc0bee335bb3aa48a460fa672384efc4d50c2b5c9ab32f288a098"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-12742", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": true, "text": "send a text message for me"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-clinc150-13091", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0acd6a00003a8c8651739f2a9d6c7bdd17d01ec65f1727128a24e51a01ef42a5", "cursor-grok-4.6-xhigh": "9e290606b9911c36354b5534ff22f6cf9000d8c02dcbbb43ed6d51f7f11a2d5d", "gpt-5.6-luna-medium": "0acd6a00003a8c8651739f2a9d6c7bdd17d01ec65f1727128a24e51a01ef42a5"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-13091", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": true, "text": "transfer my cash reward balance to my bank"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-2341", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "85d143535f9713a2cc2821d0da752c658d7b88fd2186303f3f50046a5ddb0ce7", "cursor-grok-4.6-xhigh": "9f7c4437a425327f09dac8c5876d6a5bd884c8d61691a896b051801e05a5b51f", "gpt-5.6-luna-medium": "a233fd78f72d0f006daccf85910739f1423caf62d6486f3da576e4ec93218e0e"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-2341", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": false, "text": "i want manual on how to change oil"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-3", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7be0992056eb397236ac235178b6b511e92fda824d5ebba2a788566ece87d8d2", "cursor-grok-4.6-xhigh": "71dc447c4022e63a8a128d067ea68616113673c8126dc2e4c8d2012052ccf5f2", "gpt-5.6-luna-medium": "1e2f19fe83cb947e635fd23b8b8d697e116ca97dba3f2dee7e1fd93864f268cf"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-3", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": true, "text": "tell me how to say, 'it is a beautiful morning' in italian"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-3124", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e3fa78491dedcc550d55664f69f7ad4c23cff7ab63b6e92948d41c2b25847345", "cursor-grok-4.6-xhigh": "093d0478eaa692593cd2f4f49a0f6bc8f18f304708eb4ab35ba4958332799f26", "gpt-5.6-luna-medium": "2495a0565a75f4fd279cab810beb833cc9abcf8d32796fb9cc222f749e864eeb"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-3124", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverAcceptance", "task": false, "text": "what will you call me"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11462-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "626f0851c8eaabfec1dcdbbc6eb2ac9dd17a245ae22056dc9a7639b3ac17a497", "cursor-grok-4.6-xhigh": "f5809c96ceabe6c0a21c4f4f396dfeeee5224e3603d1d5606c3717b07f4acbdb", "gpt-5.6-luna-medium": "3ab66e5d04255e70c8661718d64b3b17098f95a3b9608a4d7d95ff8e12a33f36"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11462-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "你好,帮我推荐一个票价在20元以内的景点吧,最好评分在4分以上的,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11766-8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6ef2f4d587dea2404d843c01c07f18d179fee5525205321f36dfe58d86b1d82c", "cursor-grok-4.6-xhigh": "6b9ccc26414d5e25057a02c7045a95909ef416760ba8658b5da26b80a7d72577", "gpt-5.6-luna-medium": "e79a6cd1e26b0c87291f3b397d4e4df2dd10ae9c133b0ccff70ac8a57ff335b9"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11766-8", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "无所谓,有时候评分也不准的,能帮我查一下这个景点的游玩时间吗?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11884-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.7, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e30bbd236ab269dcb8db03c2cdfd79e2320de7506c1da02f0d910517f1f1fa5f", "cursor-grok-4.6-xhigh": "6a56c61d8e0168b2119d6b50663326ddaa25d6ce7c9266cb303a34f97f92ca23", "gpt-5.6-luna-medium": "787128a500112e665847675b15e4a0dc8588a7492b72a8fec5c197bd259957ba"}, "labelerVotes": {"confirmationDecision": 2, "question": 1, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11884-12", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "好的,游玩结束后帮我找个最低价格是1000元以上的景点,我你希望酒店提供24小时热水和西式餐厅,平时工作很辛苦,我也享受一下。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-158-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b8f0149150446e701afc99120bb921cb462369dbb5ef086fb1cec62db0dd3d21", "cursor-grok-4.6-xhigh": "9df439e4e9fafc1e8db61708f4b10d0b7eceb988a85a48ddaf730ed92da9cb48", "gpt-5.6-luna-medium": "9df439e4e9fafc1e8db61708f4b10d0b7eceb988a85a48ddaf730ed92da9cb48"}, "labelerVotes": {"question": 3, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-158-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "你好,帮我查一下99优选酒店(北京长阳环岛店)(原摩恩快捷酒店)周边有什么餐馆?还有酒店是否提供吹风机,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-1615-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9f09c0dcd3f89f74dc223ea398227d78a7dfe3017e4110bd3a138ffbe1a2a040", "cursor-grok-4.6-xhigh": "f1529ca9a0c1b437fb844d47a908521601b44f3ad9ae36d714296c0c86c379f4", "gpt-5.6-luna-medium": "d18e6f382d7ddc951f53bf0590b45f0374550720510e2a0e7f17c99c82c85b79"}, "labelerVotes": {"question": 1, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-1615-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "您好,请帮我找一家舒适型酒店,评分在4分以上,设施中有商务中心,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-7671-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d36f8a86a7a806cbc5646fc08ce2b0820eadf063a9e992fd7e1919a4771cb9fd", "cursor-grok-4.6-xhigh": "d8650a03948d8f73f1d7bb74902e388b5755fc0e89ad90b70fe9c00e2eb747fa", "gpt-5.6-luna-medium": "4b5ace737d6297b18cc0c35462158b57ffcde3adf71ebaa8bc4b47ecc13d684f"}, "labelerVotes": {"question": 1, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-7671-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "您好,请帮我找一家供行李寄存的酒店,谢谢!"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-96-2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "861171182e9012ed24e7628358eb58bd52b1418b060fb497d0d5df83c21792d1", "cursor-grok-4.6-xhigh": "c4b62b7b4cd3d8e3472646ed90cddc06801a89e1627ef6d6053b189b9643f996", "gpt-5.6-luna-medium": "90ec36b7ce48d4b1a4cce7d5312b6e2e046134b7cdb731b4e2ab890e2452bb89"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-96-2", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "麻烦你把这家酒店的地址和类型告诉我一下,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-9637-24", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d15c8aa62a1b74e022a3b40f840fd8551cf236b549dcd502efd8811b4ea5ad84", "cursor-grok-4.6-xhigh": "264c84a136617eb052ca34e1140c6a8e76097860f90e63df1a47e17fb1159d64", "gpt-5.6-luna-medium": "e385198ae02ea17277ad5a07b34b783f7105882d39dd76eb4a162ace37475f6e"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-9637-24", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverAcceptance", "task": true, "text": "请帮我呼叫一辆从十渡风景名胜区到小吊梨汤(畅春园店)的出租车,告诉我车型和车牌。"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-goemotions-edhgfqz", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.85, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "cd20548f638be4b1af9408a4f3c3510840addd18142514db3633d30ae19a7b71", "cursor-grok-4.6-xhigh": "c78bb39d2e656749d2142a5314a9e10540eb6f88a7b1e9b4242c7d157e2b22d3", "gpt-5.6-luna-medium": "976555656631c83f6197fe8f784d77ce50edc3a49bd9a8af0466cc66c7eeba6c"}, "labelerVotes": {"question": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-edhgfqz", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L6496", "split": "silverAcceptance", "task": false, "text": "really? I tried last NYE during the day and it was dead"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-16722", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d8c2ecca5d75d77bf55eff6c3910489a705454b6a7782d337b2cf383676ba6ab", "cursor-grok-4.6-xhigh": "e1bece98c7831a55c6a642fa1a9f8a20654d6e895f14876e60d3b33aab42ce9d", "gpt-5.6-luna-medium": "9e3eaaecd9f428b9ae72ac18a48c905d8fea4ee1fcb461f16297a3705ed42b39"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-16722", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverAcceptance", "task": false, "text": "have i gotten an email from sean"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-6911", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0a83d8a8f51a34ba1e6e502b619be444350fb70a3f27a9cd5b616686fdabb52e", "cursor-grok-4.6-xhigh": "9f239369b13a54ced0447277c471f53c9d7c1401eda73f9312e7a80c91edf984", "gpt-5.6-luna-medium": "d54920f0b28d73c233e97442a0fefd83a4785c0056ed2d5f4dc4ca338ade786f"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-6911", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverAcceptance", "task": false, "text": "who is scheduled for tomorrow's meeting"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-12180", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "c521613976bb93e4df2477a1dc2000ed827e26fc1b41cf632b017558744013e9", "cursor-grok-4.6-xhigh": "cc483fb1cdec97fa19f30e1e21d8b5d04fd52ace3327e6f25aabcec7aff0ccaa", "gpt-5.6-luna-medium": "c925c807adf7ca3030b52af9decc8c7fad0d0658cfd98688da038747f26da24d"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-12180", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverAcceptance", "task": true, "text": "我需要一辆优步到我的现在的位置"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-1419", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "dba016633c0192c8e8791345f96da2430bc9d943734403f0629d523be0dd286f", "cursor-grok-4.6-xhigh": "fc3f0fb4515fa865b5acae5729d28666a07fad359f14be08e82a8132a6100eb7", "gpt-5.6-luna-medium": "1f85fc1d51dced9327950a128ce89b624d033d5a818976d3af9ce0030315a00a"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-1419", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverAcceptance", "task": true, "text": "请更多光亮"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-16006", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "5083224683e7639fe538a558613181d7e90760af765f8000cea18d9c772d01aa", "cursor-grok-4.6-xhigh": "56a78e60da0f19859a3958ea5246255bf44a9a455bec6b68cf77cc963bab2426", "gpt-5.6-luna-medium": "dff6c92812390d5d577d5bb7338222f7a21976b3ee8c9f1674c0e2b561641456"}, "labelerVotes": {"question": 1, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-16006", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverAcceptance", "task": true, "text": "天猫精灵请帮我检查我的电子邮件"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-9091", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "558281e3bbffbfbc00c08b273a1e3434b2235dcd5989ef24e938a7712e28560e", "cursor-grok-4.6-xhigh": "2d2d05b9186c96449c95f905e4b8fb225b0c336b28b5231f11479df499914f26", "gpt-5.6-luna-medium": "87b555eba3cc241e6334c81d5adb08947b9b17e389cd0205bbfa2b4d53ad4445"}, "labelerVotes": {"task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-9091", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverAcceptance", "task": true, "text": "清除日历中的所有的事件"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>9115a2cc-b065-4f38-99bf-4f4644f769ad<TURN>12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0cf8f92939dc75932ec86674a4b24d3a9f0d3572b658ce1b0d4f786a998bf9bc", "cursor-grok-4.6-xhigh": "c7caea3cf44a2dac3f5bad92ca7f1c6201421e10d2aa4b1796c252eecea6b3b9", "gpt-5.6-luna-medium": "9cca621b459b1fcbd08da4ee859f7add10d324c97bf770572f8bd5333058a949"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>9115a2cc-b065-4f38-99bf-4f4644f769ad<TURN>12", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L4721", "split": "silverAcceptance", "task": true, "text": "will you change the window seat to aisle"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>6d8d6219-54cf-4a11-a20b-5e90bd74110d<TURN>1", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "467de566839bf90fea65748aae2ddd69632b55e9d4439a5c9f7277a6715e52a8", "cursor-grok-4.6-xhigh": "196e3181afdbd7aaa0d5ac9e40b7e47574872f00464fff7a8d4005074a3eadff", "gpt-5.6-luna-medium": "b094b77961e0ee99f60dea18d81e889e0acee565cd6a414163e1c2b577039fb1"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>6d8d6219-54cf-4a11-a20b-5e90bd74110d<TURN>1", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L5362", "split": "silverAcceptance", "task": true, "text": "hi drew i would like to close my account can you help me"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-media-<CONV>3dfcd6b8-b829-4e5b-a97c-e5d8120bd75b<TURN>3", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "93feb61390f6bf44136a851f3097d94fd904621b26a843d31839ff82c118933f", "cursor-grok-4.6-xhigh": "c2ce44ae7587194e2b4ab28170c72e5eae90668793ab15961b5eaf69df2f3ceb", "gpt-5.6-luna-medium": "27c579c675e10c5e24ec84578ec9594df9745df2824dd48d9eab9c059fa466cc"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-media-<CONV>3dfcd6b8-b829-4e5b-a97c-e5d8120bd75b<TURN>3", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L8688", "split": "silverAcceptance", "task": true, "text": "can you please help me to see my bill of my account"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-software-<CONV>fff2c827-8a9e-4b5c-82be-b5edfd551a09<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "dc0bb217d5a5dbecab7ed84a3dfffa4aa74372f6c9f8964cef05ae919fde7efd", "cursor-grok-4.6-xhigh": "85a179c9879ba14121afbc37891a392415babdd820a899be6f66cdeb928ec8c8", "gpt-5.6-luna-medium": "66803d669525e354ecc820a0eebf6e4ffa94560a96a30d0021bb8bc3e2b1d677"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-software-<CONV>fff2c827-8a9e-4b5c-82be-b5edfd551a09<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/software/train.tsv#L363", "split": "silverAcceptance", "task": true, "text": "i want to purchase some keyboards"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-58708a29-00b4-4e9b-824c-de256c783820-6", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "89996230c277fcdb9099abf28251f6d4ee4ce2d574296603a3f446183710e004", "cursor-grok-4.6-xhigh": "40b4b25ee4f67e62c3daf6dba3b04581c519a6e7ef5facceb66e56cdfdbe7fe2", "gpt-5.6-luna-medium": "cc36d6c852964a91e851ecd95b7ae337e5b69948f7243c9c114e39e2b66d7972"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-58708a29-00b4-4e9b-824c-de256c783820-6", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverAcceptance", "task": true, "text": "I would like to know the availability of seats in the 9:00 p.m show. Could you please assist me with that?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-98c53bef-df59-4ab1-bc8f-5c006c4671f8-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7787b3e1ccde009bb85d06caf615fa073f5d45ba8734b47f572d3dfd5999ccee", "cursor-grok-4.6-xhigh": "002d2294990518a683122a4b9a285e91e1b51cf16c3cb59ee88dd98e188495b5", "gpt-5.6-luna-medium": "a4b971252a549c02e68f6ad34eff87181528cab87bdb8858c7a41a50b31137bc"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-98c53bef-df59-4ab1-bc8f-5c006c4671f8-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverAcceptance", "task": true, "text": "Can you get me a Starbucks?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-d118ebbc-561a-418b-bd5f-fd57b0126bd7-16", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "833bb23704a628caacd87ad3ddbd54d5a873d068bb3a62c12825685050af3106", "cursor-grok-4.6-xhigh": "f68f3a34ce2b5fb8d6ada7d8d9f163e76e8db4319a4c0f630fd90e617ae838eb", "gpt-5.6-luna-medium": "52ddc4f19ce41d9ff95def7d592e49cee327a69ee1a69312690c759d2057af9f"}, "labelerVotes": {"confirmationDecision": 1, "question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-d118ebbc-561a-418b-bd5f-fd57b0126bd7-16", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverAcceptance", "task": false, "text": "is it at 4:20"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-fa9a9747-e85e-4341-9f8b-647191d75be0-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "527dd6d83097d49e10f25bd0e45858679bf48ed6ed65d0779a1a0119b220237e", "cursor-grok-4.6-xhigh": "0466c1b6cfeac0c524818fd232551aaaf60fa26910686ff0a6951842f3bdd08c", "gpt-5.6-luna-medium": "61a9a9ed882f4c00ceb1b54de0e894588f2e3f7a1e4b5021d089bb14714b131e"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-fa9a9747-e85e-4341-9f8b-647191d75be0-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverAcceptance", "task": true, "text": "Can you see if there are any available showings for Alita Battle Angel"}
ModelTraining/ClipboardSemantics/Consensus/silver-calibration.jsonl
+50
View File
@@ -0,0 +1,50 @@
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-10502", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "70fd1d1a036fe5dd38151f828d88172bba69b33cee52f331239a15975a9bb43e", "cursor-grok-4.6-xhigh": "181f026a10cf8f489bd3b15c417b9dcb58113e436a10d6d5b71a6cad7314577f", "gpt-5.6-luna-medium": "39c2ceb730d16a0df204050b169ac658645d923715b28c9f96f5cfeb5893327a"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-10502", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-10502", "split": "silverCalibration", "task": false, "text": "去年来吃过感觉还不错。今天又来吃,太黑太坑哪,再也不敢来了!最坑爹的是拆骨肉拌黄瓜,正常人看菜名会觉得拆骨肉有肉吧?25元的菜上来以后,就是一盘筋拌黄瓜,有的还咬不动。老板说了,牛后腿上拆下来的就是筋,和猪不一样。牛后腿没有肉?我书念的少你可不要骗我啊?!敢问你把肉弄哪里去了?没有肉,你菜名整什么拆骨肉,你叫拆蹄筋呗!欺骗消费者!早知道没肉我还不如点个拌牛肉才28。吃了一会听到他店里还有道菜叫拌蹄筋,我想知道和我点的拆骨肉有没有关系?是不是没有肉了,拿蹄筋顶替呢?欺负我一个小姑娘?***!牛肉汤也不如以前了,15元的大的,牛肉片,豆腐皮,粉丝这些都比以前少了很多,越做越不行了。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-23758", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1103d57a407068db094ea808aa06c1887ef1b2c67ca5cf3659ef905269c8678d", "cursor-grok-4.6-xhigh": "1103d57a407068db094ea808aa06c1887ef1b2c67ca5cf3659ef905269c8678d", "gpt-5.6-luna-medium": "0922d1a275896434ad42616f9cf1b261b320b4b7e399d3247b3fb79294eddbd8"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-23758", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-23758", "split": "silverCalibration", "task": false, "text": "我第一次来这里,没就在星巴克旁边,离东山口地铁站口超近,交通便利。看评论说得很不错似的。只是吃完后感觉很差劲,不知道为什么那么多好评,不知道是不是点的东西不同还是什么原因了,反正印象太差,不会来第二次。\\\\n首先,这里的服务态度不佳,特别前台那个收银员,一点也不热情,问问题都不想答的模样,一副爱理不理的样子,反正我作为顾客很不爽。\\\\n说到点的东西,我点的是红豆薏仁黑豆花和黄金鸡翅,实在太无语了。首先两个卖相都不好,感觉很糟糕,自己煮都不会煮出这种卖相,至于味道吧,豆花一般,就是豆腐的味道的确很不错,其他很一般,而且份量不多,还有那个鸡翅,有4块,十分糟糕。不知道是用什么油来弄的,那种酱油味让人很反胃,自己做的鸡翅都比它好吃。这样一碗豆花15元,一碟鸡翅18元。太糟糕了,难吃。坑爹。。。。\\\\n虽然环境还算可以,比较静,又近电影院,但是应该没有下次。希望店家能改善一下出品质量。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-29777", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "778ecf0f0dda7e681d6db71429a68371d480c90b48cebbbbc73d37ccc8fdf395", "cursor-grok-4.6-xhigh": "9cf8aa0eabb5837d4ee9501121bd60d52b22eca464ed633c909944be1e560286", "gpt-5.6-luna-medium": "cee15ffc6b38fc58198fa4fd43c44552ffeaf5d7f5767e3a1edb20d722a40a2f"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-29777", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-29777", "split": "silverCalibration", "task": false, "text": "火炉火芝士助排火锅之前已经和朋友们在爱琴海那家店吃过很多次了,感觉都不错才敢推荐同事来中关村这家店吃因为离上班很近!结果失望透顶,感觉都不会再吃了,完全颠覆以前的美好体验!\\\\n首先这家店很小,桌与桌间隔巨小,进出很不方便,聊天更不方便!我们四个人要了两个火锅套餐,结果桌子根本就放不下摆的乱七八糟的,都没地方下手!其次服务太差!因为食物完全没味道要点酱而已,结果被告知没有单独给的简直无语!他家冰沙是巨小一碗的,很多桌都希望吃完再上,结果他家完全不顾顾客感受非得统一时间每桌都上!\\\\n最最失望是食物本身,味道特别难吃跟爱琴海那家没得比!尤其是金枪鱼紫菜包饭,完全没味道!金枪鱼少的可怜,一盆里就看到一块而已!米饭也不新鲜,感觉就是在吃没有味道的很油的大米饭而已!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-40694", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "51181cdf13367c16fabf60283f8dd33a6312c5769dd7f3e1f7187b10bc1f3634", "cursor-grok-4.6-xhigh": "51181cdf13367c16fabf60283f8dd33a6312c5769dd7f3e1f7187b10bc1f3634", "gpt-5.6-luna-medium": "20c19f32f97f1d059edfb7b4258563833716be8806527fc5d85af134f655f35f"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-40694", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-40694", "split": "silverCalibration", "task": false, "text": "银河里的餐厅都吃过了只差这家没吃过,前几天去尝尝简直失望死......三杯鸡嚼不烂,黑椒牛柳粒不是应该用黄油么?烤玉米就是水煮玉米稍微烤一下既没有奶香味也没有刷其他的料汁调味......烤鸡翅火候不够里面还带血丝......水煮牛肉咸的要命......结账之前问服务员团购的代金券能不能用明确的说可以,结果结账时大堂经理又说不能用要提前一天预约,应答口径都不一样就不能好好培训一下么......旁边桌三个男孩点了三个菜三碗米饭吃了没十分钟就走了,菜基本没动米饭只吃不到一半......看来不止我一人觉得不好吃"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-453", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "99fe3e9a8fde3acda5075711856811275eb831b13d7c8a9069e9b1e92f52e852", "cursor-grok-4.6-xhigh": "3e5e37c10edff705a3ce456f5ff5409c4e79ff541ebc8c3f1e1d4837eb4a8c2f", "gpt-5.6-luna-medium": "164c2656d59174f9971993043987939cb01f21d2f6a5f86a8d65eea28c7522df"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-453", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-453", "split": "silverCalibration", "task": false, "text": "9月23日陪老婆去金源mall玩在购物中心一层吃的金鼎轩,天气不错坐在外面吃的,首先,服务真心烂,一大堆服务员在那里傻站着,叫了半天才动,动,竟然先上主食!我去nmlgb,最后反复催菜才吧主菜上了,尼玛我都吃饱了!而且叫了两杯水,到最后走人了都没上!再说食物真心不好吃,其实就是一个大排档,菜品几乎可以和成都小吃类似,招牌的味道真心垃圾,也就鸡爪比较烂,味道还可以,我也是瞎了,在金源5层大排档吃你家那个鸡爪还觉得可以才去一层又吃了一次,金鼎轩名字不错,真心可惜这名字了!唯一推荐的就是鸡爪,本身菜单上菜品就少,还特么弄了4个菜单(一个水单,一个菜单,一个防霾菜单,一个素菜单),你特么逗比吗?一打开才尼玛几个菜品?弄这么多菜单你们真特么有闲工夫,这个也就是推荐吃吃小吃,不建议朋友聚会去吃,因为菜品种类太少了,几乎没有选择!kqnnamduohaoping,nimenchiguodongximei?meiqizi。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-5022", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "65a2e998191604b655d8a8c43522348408f6ee2ba26b9e00ff6322a8ff2bfa9f", "cursor-grok-4.6-xhigh": "ad66153083311e55490107de6a4ebd3c28a8e61aa34b947b67dd5adfc62fd981", "gpt-5.6-luna-medium": "6c953390e477d386fc7e958bb9fdb45efd0a561f6640b702e415807242e9b591"}, "labelerVotes": {"complaint": 3, "question": 1, "scheduleNegotiation": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-5022", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-5022", "split": "silverCalibration", "task": false, "text": "什么玩意儿,东西贵不说环境也乱哄哄的,看菜单一盘麻豆腐要26,服务员也爱答不理的,你东西再好我也不会再去了。等了50多分钟肉饼,中间问了服务员两回肉饼什么时候上,服务员哪也没去谁也没问就说快了快了,快你大爷。最后肉饼出了竟然给刚到的几桌先上了,你妈啊,真的是什么心情都没了。所幸不吃了结账,还说肉饼排号,排你大爷,我先到的旁边翻2桌了,给刚到的人先上这叫排号排单子,总共一瓶啤酒两个肉串还能给我算错帐,真的想他妈骂人摔东西了,操!真他妈给北京人丢脸。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3431365", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "72c54f5294a36d393cc23ac8c253e975c3137c1c2c09aa79b86e1f11e3cf5aa9", "cursor-grok-4.6-xhigh": "4d07ee22ac085d9e55a59214191d0564da09c83ae3285bb00865876541ad5ea0", "gpt-5.6-luna-medium": "c6fad98753918ad51c0f210cd70667fea5dbde9a7265b9dbab1e6ef066d37360"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3431365", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3431365", "split": "silverCalibration", "task": false, "text": "I sent a letter to evergreen professional asking to remove the collections account. I never received a response I have been making monthly payments ( direct withdrawal ) they take {$50.00} a month from me. It should be paid in full"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3577388", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "fe7c9154dc552c012d7f6616fe10130f17fee8a48496cba729c9447f5be93a68", "cursor-grok-4.6-xhigh": "ec3352cc5ec79f63c4be7b496628a6e5141b2c165ff65a934de80bd8f8d22d87", "gpt-5.6-luna-medium": "71a0dccf1813cff5167bf1453588173d6ef90f9741abdbde5fd6cf53dd9d1137"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3577388", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3577388", "split": "silverCalibration", "task": false, "text": "Hello, Both accounts are passed the 7 year mark to be removed from my credit history. Accounts XXXX and XXXX The last payments made on these accounts were in XX/XX/XXXX. Today 's date is XX/XX/XXXX it been a full 7 years. please remove these accounts fully from my credit reports. As i have written proof from date of last payment for both of these zombie debts.Thank you"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-cfpb-4063938", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "bcc0d85af837508fd1da2eab5d3bcb09535a327582cf50c69b2835499b1276d7", "cursor-grok-4.6-xhigh": "bcc0d85af837508fd1da2eab5d3bcb09535a327582cf50c69b2835499b1276d7", "gpt-5.6-luna-medium": "0e09aa2e1621ca0f421b3e78870394a31f742729b537b40fa80e9612d2b6cbe7"}, "labelerVotes": {"complaint": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-4063938", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4063938", "split": "silverCalibration", "task": false, "text": "Bank of America continues to report that I have a delinquent account with an outstanding balance on a closed account. I never received a bill and it was sent to collections even though I made payments in XXXX and XXXX. I spoke with the company via phone during both years and it now still appears as a derogatory account on my account and no one has helped me. I have disputed the companies claims because they sent me to collections and refused to hear my plea during going through a divorce."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-cfpb-4140786", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f1f22d3522ea83573c115a6e4689077e482033573daff46d2692c29241cf3708", "cursor-grok-4.6-xhigh": "fa5a8f6673498d66613fb970762d1b15f61b1c07919858012c92d97949dfe75d", "gpt-5.6-luna-medium": "fa5a8f6673498d66613fb970762d1b15f61b1c07919858012c92d97949dfe75d"}, "labelerVotes": {"complaint": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-4140786", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4140786", "split": "silverCalibration", "task": false, "text": "I have filed a dispute in regards to the incorrect items on my credit report. It has been well over 30 days and I have not received any investigation results."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-cfpb-4232485", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0137b667f8f4eceb4edb4f068cdac6042c9ec7f23b8300440a9fa8711fee6759", "cursor-grok-4.6-xhigh": "87b8ae3373e445824916d10245315a6327f11805c2fcb97cc14108b97aebc958", "gpt-5.6-luna-medium": "87b8ae3373e445824916d10245315a6327f11805c2fcb97cc14108b97aebc958"}, "labelerVotes": {"complaint": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-4232485", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4232485", "split": "silverCalibration", "task": false, "text": "I have filed a dispute in regards to the incorrect items on my credit report .It has been well over 30 days and I havent reviewed any investigation results."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-5094833", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f5b7a8484d4a553bcb05a51fa2cec15300ec79103553484747512c0598ab03f9", "cursor-grok-4.6-xhigh": "1846a8efd93a17e935abd0042587458fc9302b98afd442a5046f74fe33d6937e", "gpt-5.6-luna-medium": "990fb9ac5e57c92eb9c2d310f7f41d81ada0dff3fe7bba4ed2c4965a8d7b17ad"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5094833", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5094833", "split": "silverCalibration", "task": false, "text": "I'm not swayed that Bureaus efficiently pleased the principles of the Fair Credit Reporting Act in completing their investigation. The Bureaus are reporting inaccurate information on XXXX XXXX. Per FCRA, reporting must be 100 % accurate or the information must be deleted. If this type of information can not be equipped, make sure to erase the item in question immediately."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-6122130", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a2650519f7c1fe3caf7aa1bdd7184084310747a79ece633c4ed3d4f79ae749ef", "cursor-grok-4.6-xhigh": "19a3cfd6bf4336e5f644b096f9e94f69c4efd6cbd5e2a6c6fd85a2718cf7d7e8", "gpt-5.6-luna-medium": "d77dd32fbdeb482607440bd331d160bb4458447afe808bd0ede970a870f0d935"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-6122130", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6122130", "split": "silverCalibration", "task": false, "text": "n accordance with the Fair Credit Reporting act XXXX Account # XXXX, has violated my rights. 15 U.S.C 1681 section 602 A. States I have the right to privacy. 15 U.S.C 1681 Section 604 A Section 2 : It also states a consumer reporting agency can not furnish a account without my written instructions"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-1680", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "3f7e83ac9649499276bba4f3892309f24635a72e3afac5a47976c4a8476fd3c0", "cursor-grok-4.6-xhigh": "4d2ed87e5081e2a0bebc40c1db69aac5bffb5475c4abf36a93adcdd3004c353d", "gpt-5.6-luna-medium": "647cca734c35a30a9603bc1e57b6cd26e1676e447e5e4e227a8396ae57e86b7c"}, "labelerVotes": {"followUpReminder": 2, "question": 2, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-1680", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverCalibration", "task": false, "text": "please inform me when my flight scheduled to board"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-3198", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "fd1d8f94a073453657e2c3aab6bee6294252b63d2e711944b509b35691300dc7", "cursor-grok-4.6-xhigh": "9b65748ce42038bcab4c6e4ea6f70f9f2de810cc5f532998486c4411bdee8769", "gpt-5.6-luna-medium": "7318bd624c12219570e8ca9c5860646f97ec9d66aa39714180262eaee408ea76"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-3198", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverCalibration", "task": false, "text": "so what name do you have for me"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-4832", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7eba90cfac3e526e3d3f77cb7a41fbf1db2717ecd7a986b2e75971ad3e83d79f", "cursor-grok-4.6-xhigh": "3f04c6cbb30e5a3480e301a46304ea05abf951c3e91a6386afaea4a8053ebebf", "gpt-5.6-luna-medium": "903fc79898fc2e998e3bf94b4ecb2b2cc12a105237d48b244ccc2bd0d8bde8c6"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-4832", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverCalibration", "task": false, "text": "is it possible for you to let me know what health plan i'm on"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-6137", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "80b073d5e697054d708c3d2292f4afed887682790e87905755d85f67a177ae0a", "cursor-grok-4.6-xhigh": "ad0c094bd32e20f9a030a063ddcd572d477e7f680a81a313c58845832f10fa0b", "gpt-5.6-luna-medium": "97ef995667b89cbe935c6e1f64ee686ee9aa8a5d96533a5d4ad5341062953478"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-6137", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverCalibration", "task": false, "text": "how many of my vacation days have i depleted"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-1766-14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "450b38cdb53f94e91b0472c54330df801f9ef131b121b465e96ab43d81a6529c", "cursor-grok-4.6-xhigh": "0070ad9994feef9216414e7fafc103d724be5cf3d53bfd460ae0acaab136e50b", "gpt-5.6-luna-medium": "b03c543b934253795ebad98a907dd054524a08cb8bbbc7bbfcf09dd1eac007a7"}, "labelerVotes": {"confirmationDecision": 1, "question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-1766-14", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverCalibration", "task": true, "text": "好的,再帮我推荐一个最低价格200-300元,评分在4.5分以上的酒店,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-338-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "20962411203eb41a959529781b949c81e88ba27de5eb0abb91610b5aae9d83f6", "cursor-grok-4.6-xhigh": "688d6a32484c9b79d79f77611478c306c1600ae3092a28f1cecd78956acb7060", "gpt-5.6-luna-medium": "688d6a32484c9b79d79f77611478c306c1600ae3092a28f1cecd78956acb7060"}, "labelerVotes": {"question": 1, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-338-10", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverCalibration", "task": true, "text": "那麻烦您帮我发一下它的地址,谢谢了。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-6343-2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2624b9ac0ed659759cdc65ac9d9cf44cc4a858be6ff1a6ab846279375f9d334d", "cursor-grok-4.6-xhigh": "929e6d91c9f6181d4ad7af082aee28d742b432379069052b1d1d48d3c39fa743", "gpt-5.6-luna-medium": "5eb2a2f17922aeecd69442a146438e586d71363d958c68712fea6ac22ef7a94c"}, "labelerVotes": {"question": 1, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-6343-2", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverCalibration", "task": true, "text": "不好意思,再帮我找一个价格在400到500元的,有暖气的酒店,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-8169-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ff12a5aafef561d851430534c027bf375430c89a5e3639937faff64858d4f2d4", "cursor-grok-4.6-xhigh": "93d23822c5d9ead01e232a67d37c908ebdbae8453320fe74bb3b42c99fe06340", "gpt-5.6-luna-medium": "93d23822c5d9ead01e232a67d37c908ebdbae8453320fe74bb3b42c99fe06340"}, "labelerVotes": {"question": 3, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-8169-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverCalibration", "task": true, "text": "你好,我要去景点红领巾公园,帮我查询下这个景点的门票和周边餐馆。谢谢。"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": true, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-goemotions-ee0ui7m", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "36182ebfd2c87dcb03b9bc058838b771080a26f18ba35acbdefece0a6b4f8ea1", "cursor-grok-4.6-xhigh": "36182ebfd2c87dcb03b9bc058838b771080a26f18ba35acbdefece0a6b4f8ea1", "gpt-5.6-luna-medium": "7222f3607eb2d42ec8444d0eed9bb754eae8f4a0b9e4d926e53987908f8bf22d"}, "labelerVotes": {"blessing": 3, "question": 1, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-ee0ui7m", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L30860", "split": "silverCalibration", "task": false, "text": "You've got time to turn it around. I promise you. You can get there."}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-goemotions-eeq8ddu", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.85, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "11de20b97f1066a60acb63b0a20d2870cec181e9f42e16d638d7dbf0e7865a5a", "cursor-grok-4.6-xhigh": "d1007e8ea549a60a0249f68b438564404d5b8afc0b693bd6fbe3ec1aac2ab5f0", "gpt-5.6-luna-medium": "f4b4cb244add0b48a42b7ed6791dfe5b33f30acc5997d3921359b4219c7e4815"}, "labelerVotes": {"replyableMessage": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": true, "replyableMessage": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-eeq8ddu", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L16603", "split": "silverCalibration", "task": false, "text": "Lol!!!!!!!!!!!!! I love it."}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-goemotions-eff0egy", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.86, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "73c3f803656dd58dd364c0d0141cf21580a8c2c9aec2882c0e34e3e0e8134a2e", "cursor-grok-4.6-xhigh": "029d7552a1892037ed178e6f97b3a581d8ada601a60a62cace2a36a213781b50", "gpt-5.6-luna-medium": "98fbf0c9545abad7d173da7471a67d0ade565358873e73492975ab4ad049b337"}, "labelerVotes": {"question": 3, "replyableMessage": 2, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-eff0egy", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L41468", "split": "silverCalibration", "task": false, "text": "Please tell me your shop didn't get you in trouble for that D:"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-10167", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "824dd3c867090e4b3253483c032003e5ad232e666d73ef353211dc120b197e31", "cursor-grok-4.6-xhigh": "fba1600aea4757e3f4c54adbf97b47440639cc532814c25ae605795c3758d4c5", "gpt-5.6-luna-medium": "0a14681128eddc1ac1f9ab85cb41622603cb349b06fe7f9593763c92afba5820"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-10167", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": true, "text": "find apple pie recipe"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-en-US-12321", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6b04bf052674c0760a1170eda905c20978e46b0887faa3f9c831d1a0e5e26abf", "cursor-grok-4.6-xhigh": "6689e1fcd776a93e8df50a1bfd90149884d3422090e10f6e663ff57f4a6f6820", "gpt-5.6-luna-medium": "6b04bf052674c0760a1170eda905c20978e46b0887faa3f9c831d1a0e5e26abf"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-12321", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": true, "text": "olly call a taxi"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-en-US-13327", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "16fa3fd2bc96bd8eb9dbe74d399dc5a6b456d117f635870b04397399a13bef6d", "cursor-grok-4.6-xhigh": "2dc2c7cec9da7d45ccf3b82b12a7e732892c670ca498cfc7106ca94623b7732d", "gpt-5.6-luna-medium": "16fa3fd2bc96bd8eb9dbe74d399dc5a6b456d117f635870b04397399a13bef6d"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-13327", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": true, "text": "call the closest mexican restaurant"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-12552", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "21c0d99b2e110781482cba01caa76ffa6d2911b1cc4f47d0c2371dd9c44b9b1f", "cursor-grok-4.6-xhigh": "f5220ddf1da8c296009a7c41ac9495409c874c75aae84258bb7c38218df1dea1", "gpt-5.6-luna-medium": "c63dec2372e372c91c0f7a3399035b992ea9f96736afa6a28d2ac7f94cf9275f"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-12552", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": true, "text": "你能帮我订一辆去目的地的出租车吗"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-4352", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "859c1e72848a130e4bac6b6ff1ababc3fe6e1470aa9a5ad6e676f49b7256dcb4", "cursor-grok-4.6-xhigh": "e0cd2ff9b4af30cc75e75e0466c947801f4a57aa28d4916d58ee6af77de76573", "gpt-5.6-luna-medium": "b9fa7e846c19457a80863ed8df3c56e2e25fe42ea2f15ad81b8d95658ef7122d"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-4352", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": false, "text": "告诉我太平洋标准时间"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-5178", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "ae848239174c78b7ff70a52ec6ac0703012dd733f43e0e047277b0e9808cc5db", "cursor-grok-4.6-xhigh": "ddabfd4be2a46c9d39b35c1057c2ef2a335fcaa3239b6d92a0232f99924c1b42", "gpt-5.6-luna-medium": "e67380e5f4befd42de5bf945d64a384ddd458a4da49edec680e247aedf77065a"}, "labelerVotes": {"confirmationDecision": 1, "question": 3, "replyableMessage": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-5178", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": false, "text": "确认我现在需要伞吗"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-7283", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "0b13d52ffc77a02601bf1b3129ab7fcaf21d0b73b7c3f6dcfc94c2206d51ea76", "cursor-grok-4.6-xhigh": "0b13d52ffc77a02601bf1b3129ab7fcaf21d0b73b7c3f6dcfc94c2206d51ea76", "gpt-5.6-luna-medium": "a975bc07a96d0f8d6b6e7b723c6cd79f75e9f64f8011f4e33eebed7d29ce194a"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-7283", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": true, "text": "删除我的一点半的预约"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-8313", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "7c32d7226723d986101c95cab8dc422946856eb58f169d6991b8ccb09158de48", "cursor-grok-4.6-xhigh": "8a98672e872810e8301b839b8d63f006fb26c47607b164cf395fe88530dcdd90", "gpt-5.6-luna-medium": "774bba55252e1c95bc76182055ee1f98170a63ca5c06b2cb01ac8e152c7da51b"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-8313", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": false, "text": "苏珊的生日是三月一日吗"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-8505", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "668bad91b07daecb71c50a633132f40b16942fb7aa6fbfa66319c1a0f9e6af89", "cursor-grok-4.6-xhigh": "25379c9a49fbb45d111f7647f092ba549c6b5c5af976432cfbf55499ae6ad137", "gpt-5.6-luna-medium": "2af707d4fb6a6d88883884176dd6e48d0382f1a2c2a32db0abc2432630252a1c"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-8505", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": false, "text": "我的本月的日程表安排是什么"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-8845", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "8460a28e6cb61aec78e595ef68fd39b2830069374fbc851c9d7d91bcf8660689", "cursor-grok-4.6-xhigh": "2583c96280b15e7f75987c64d411bbf5935dd817ad5a4424e255ae8ae531f3fd", "gpt-5.6-luna-medium": "72efd95f2338832971c95fe8e62055f1a1fc18313902bf03d59dd612f1640f8c"}, "labelerVotes": {"task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-8845", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverCalibration", "task": true, "text": "清空我的日历"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>3a77afb0-10f7-4399-aed8-58512ae89fc5<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4612420854f87d448a7545da2d7ef5ab1fcc0665a0afdf96b41e9fd200ac0777", "cursor-grok-4.6-xhigh": "aa4a6643612f9f7f1f426f0210c33be8a9756a1f67ac49a689ae0909d1f55638", "gpt-5.6-luna-medium": "3efebab3d15d0f828507cb5abcaea506923ad35ac5919eb954c7045ed51c0aa5"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>3a77afb0-10f7-4399-aed8-58512ae89fc5<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L8868", "split": "silverCalibration", "task": true, "text": "can you check my seat assignment"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-fastfood-<CONV>3468c2d5-b656-4aae-bade-8450dbaa3838<TURN>3", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0f9d905d35a41953458341a805782253dafe127cc23b3723c2f8c1f9102ba4d8", "cursor-grok-4.6-xhigh": "bacf9ab5645d2b4cf6b0f60947fe0644cc602afe8d6ac794cf6399b4070f4362", "gpt-5.6-luna-medium": "a83ddd6e522b79f5c9aeaf85a9cae393cd27a03c7912eb8d16e3e5d0cc3c9c23"}, "labelerVotes": {"confirmationDecision": 3, "question": 2, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-fastfood-<CONV>3468c2d5-b656-4aae-bade-8450dbaa3838<TURN>3", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L8030", "split": "silverCalibration", "task": true, "text": "no thanks but can i get a side of large fries with it"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>8522ed9a-4478-4993-b129-312110d217b6<TURN>11", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "bad3776976a3d6cfbf3137521614bce5e8408caac0c09cfb6ed14d51e2c69bab", "cursor-grok-4.6-xhigh": "12709daaf453562fa2c72ad6fbef5b4bbcd4482b1cb71438459e873a6b1f0884", "gpt-5.6-luna-medium": "73137c92571447b03d9d062251f139489d2e563d3c2d6c91a920c13e471fc4aa"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>8522ed9a-4478-4993-b129-312110d217b6<TURN>11", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L1222", "split": "silverCalibration", "task": false, "text": "thankyou for telling this i want to know banks routing number"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>e8e210ba-ca6e-471a-b9e2-2f84e55ed499<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0a01428793f1ea0ace06360cd74aa6380df180b7929c7f5fb3b9ded1714e25b1", "cursor-grok-4.6-xhigh": "d9c569348fcdac478b76831b88e84f9816a9c7009908dc55601e510065eae970", "gpt-5.6-luna-medium": "5552f269b2162bd69c106c1d67381d4a08bfa168451688288fcfdff3709f13bd"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>e8e210ba-ca6e-471a-b9e2-2f84e55ed499<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L14075", "split": "silverCalibration", "task": true, "text": "find out the banks routing number"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-media-<CONV>3269ff16-32ff-4d8d-8586-b178cd9a68a7<TURN>8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f9c5014f362fe8781bc8b0ff2f9490896ccdf9c3ece61af19107259e01b8b116", "cursor-grok-4.6-xhigh": "8712299c12c2628ce5179a85703b48bcf5d93a753f65a3083656562a3ef88420", "gpt-5.6-luna-medium": "90a388255fe80c816494f8b3b38099cf20874452615b0ea8bfb1981996315453"}, "labelerVotes": {"confirmationDecision": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["confirmationDecision", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-media-<CONV>3269ff16-32ff-4d8d-8586-b178cd9a68a7<TURN>8", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L9312", "split": "silverCalibration", "task": true, "text": "perfect please confirm the plan"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-54b7e34e-93e7-4d80-a366-731d520e7af8-16", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4dfd21156b53d044516171cd9baceba4505d00969839f01db4311bc4b8f646ed", "cursor-grok-4.6-xhigh": "4c6d587b05b6528bde88ecd57d4e5bbdb7ff1e79ef593f4ae98d81826d39e690", "gpt-5.6-luna-medium": "72cb24c55110af1345c9d45027358ed7ce1ea4be2aa0beebed0a27af85ad1a16"}, "labelerVotes": {"confirmationDecision": 3, "question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-54b7e34e-93e7-4d80-a366-731d520e7af8-16", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": true, "text": "Ok can you go ahead and purchase 2?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-873fee8e-332d-43fe-bd42-cf9907e5940c-6", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.89, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "84bf8f46e9415f82e51e28feea8bb99de05ffe27c71445934b7caaa6cc975753", "cursor-grok-4.6-xhigh": "654d48a43f236e1c5ff32a5d09d09b16787b050adae61117f43014948b6c083a", "gpt-5.6-luna-medium": "f388b764164d4bbe2c89caa060afe93cd7dc2fd4d57c6afde556040d30306ec1"}, "labelerVotes": {"confirmationDecision": 2, "question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-873fee8e-332d-43fe-bd42-cf9907e5940c-6", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": false, "text": "I don't like Eggnog, do they have anything else?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "scheduleNegotiation", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-902d28b1-56a1-4249-ad4c-7ff84ea2ca26-8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7c7b3db27b0ee9b322310b7aa07cfd9c8ccf8237dce5e01b890a87d1adfc8a52", "cursor-grok-4.6-xhigh": "38699eb9dc2f9b135aa935499ccd3aa14deea0755167950e24163114f13a407b", "gpt-5.6-luna-medium": "d2f1578063f47e9ec35152e8bc1106cf894e076ad5fb2cff1cdcb8d5edab71a0"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "scheduleNegotiation": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": true, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-902d28b1-56a1-4249-ad4c-7ff84ea2ca26-8", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": false, "text": "How about 6:00 pm?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-ae3eadbe-8577-4a3a-adac-406c0a2a6515-14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7432fe5370ce4588ebc580946a8d8e184cd201b2a0b64f8f132d030a87b9e909", "cursor-grok-4.6-xhigh": "6cddabf8c3bf104041c37d71475305ee1bbeee84f1a1cd377272983740cc8c17", "gpt-5.6-luna-medium": "dc64aeff638d43a72b054411a603e8f6ececaf7edca401bfa3c29fb4b8d5e73c"}, "labelerVotes": {"confirmationDecision": 3, "question": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-ae3eadbe-8577-4a3a-adac-406c0a2a6515-14", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": false, "text": "Yes is there any other fees?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "scheduleNegotiation", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-bc341386-1c38-48f7-9c06-9c7a49355f83-6", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "014fe0dfa2dcea90c3dfe19fb666f5609769a238d4963d6a1de9bda1edc01198", "cursor-grok-4.6-xhigh": "21235ed9b442f9b1d570430127b4fb56cbceb76f66f7948e8ec6fd8a5dccee5c", "gpt-5.6-luna-medium": "ffdfaf6da9d9c4901289d3f320dc73795977aac627b4e1a059adaf25ad2efdb0"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "scheduleNegotiation": 3, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": true, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-bc341386-1c38-48f7-9c06-9c7a49355f83-6", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": true, "text": "I checked with my friend and that is too late for us. Can you look into the movie US, my friend whats to see that one, around 4:00. So we can eat and shop, before the show?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-bf903ea2-2080-4d74-a457-c9a8b7aa5444-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1154bf052842758452f99a9e43eaa9c2528045abf47f646ac4ea25179fc32f04", "cursor-grok-4.6-xhigh": "ed091b83b08f3bd9a571f3925748c1e22d3e7468c3de36171c4e2e09068abb98", "gpt-5.6-luna-medium": "9ca5050f607520fa208e005a9a8569df1efc3f41f1f6a326c8a18633c805cdd4"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "scheduleNegotiation": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-bf903ea2-2080-4d74-a457-c9a8b7aa5444-12", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": false, "text": "What about 7?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-c214b676-2b94-4a58-a2eb-f6dc0c95f5c6-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.78, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "28d9b285dc6e988825cf7e611084f9dfd277345c38c0aeec00e2688e248b66f9", "cursor-grok-4.6-xhigh": "bcff804872421ccbff4227cd807914d522bc35c32fa0c01e5741c0132c7cec13", "gpt-5.6-luna-medium": "2464a2fa8f2fb339452cb460f4f5c6108d62c5b473862f61057eeee49dec2ba5"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-c214b676-2b94-4a58-a2eb-f6dc0c95f5c6-10", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": true, "text": "Can you order Y for me please"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-cb365cb0-98da-47d9-b270-5824b1858ab7-8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.89, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e12bf40d3bd40b2a654d5d3875e61dbd3224c6bc990e783ed887f5f1f625dfb0", "cursor-grok-4.6-xhigh": "b5e9dd9c841a76d7831104137dcda510360b55b4b80eee49e3a64c1cfbf79ceb", "gpt-5.6-luna-medium": "fa54050e3799e6a1eaccd0effdc9047ef6a6150fbcc83f1e31bd14b3540ead9e"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 2, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-cb365cb0-98da-47d9-b270-5824b1858ab7-8", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": true, "text": "Can you tell me times for other locations?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "scheduleNegotiation", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-d37cee1f-7df1-4311-b4a6-34383c25643f-8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "60f1074112da5b3ef8e6bdf0a867809294960b57a1e903df27137a519fe9aac6", "cursor-grok-4.6-xhigh": "777918ce4373116159d6680658c0f9b914da1e7fc95bc070e43f7b4e77fc78fa", "gpt-5.6-luna-medium": "fd7b8a4481f8fe3747668d718538a10cddd1f192e1711db4ce09a0fdb377af03"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": true, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "scheduleNegotiation"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-d37cee1f-7df1-4311-b4a6-34383c25643f-8", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": false, "text": "what time would they have a table"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-f0f8de86-fe25-4a62-87b6-aceb779ca6f4-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b1bd95c69b664f1b7471386c57de8498c8c26844d60db9d4b46cc9f97c9e937c", "cursor-grok-4.6-xhigh": "22ff159e61001fb8ebcfa0b17f8efdca4c19a8f484f3996c84c7b6d6decc7ef5", "gpt-5.6-luna-medium": "5d1dc3b329343b8432e86d102bc377107f7135c36a42da6e08526a527f3a5346"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-f0f8de86-fe25-4a62-87b6-aceb779ca6f4-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": true, "text": "Can you get me tickets for the movie US?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-fb4bb7ce-3cd8-418e-abf8-47c90098e97b-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2a8ddd91cf108891ea251f5fbdc8568bc97aedf16ba65feb2445ae93953a5423", "cursor-grok-4.6-xhigh": "e8dd52c724fd429b2dfa08dfc8c22eb3136e2d0d2495a1ca0e5c733aa2e39da8", "gpt-5.6-luna-medium": "a8677d8a13eb1045bedb1750a986a4a827c0441a6e43f3a7f60f8f7c6dfa28a9"}, "labelerVotes": {"confirmationDecision": 1, "question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-fb4bb7ce-3cd8-418e-abf8-47c90098e97b-10", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverCalibration", "task": false, "text": "Is an UberX listed?"}
ModelTraining/ClipboardSemantics/Consensus/silver-train.jsonl
+223
View File
@@ -0,0 +1,223 @@
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-11481", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "dd55564b3d1f51e8ded6beb666b0b11d7a5eab5532e3433b11beda2e1f5469dd", "cursor-grok-4.6-xhigh": "04ab47fe8a444cca6a18492951e3cfdfd22e362ce09aeab29cb5fd2c15492b9b", "gpt-5.6-luna-medium": "7cf5912ec32dee02cf764d55e0d6854978c701f26ef9b2ee74f90945bfc87874"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-11481", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-11481", "split": "silverTrain", "task": false, "text": "只能说这家店懂得网络营销,盲目的看大众点评真的是人云亦云,看点评来的,榆钱48,以为是本地特色才这个价钱3个人花了270,驴肉黄面特别渣,面软绵绵,菜茄辣西什么的也不好吃而且菜码特小,第二天包车去西线跟好心师傅唠一道,说我们被骗了,沙洲夜市就是糊弄外地人的,本地人都吃顺张,黄面12、3块特好吃,说本地的炒榆钱也就10来块钱,吃手把羊肉也就是本地白条就去靖远,烧烤就董记和老陆。本来还想看点评去老马,师傅说沙洲夜市那些都刷的又贵口味也不正宗。还推荐去腐败一条街的庙街党河边去吃烧烤,说那边好吃不贵,希望能帮到后来的朋友,今天敦煌最后一天了,决定再吃顿靖远或去董记和老陆选一家结束敦煌愉快的旅行!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-1596", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f5abb864790b661573c8a310fb2fafcbfe2dc1aed197c1533be90d5a8df63c68", "cursor-grok-4.6-xhigh": "b52df4010d47d06a26dc0e7b9ff8a1acd55dc984715a8df5e177ceb116dc6014", "gpt-5.6-luna-medium": "3ba710882e8c5b236f40114c0ab871c52de0e4796b5c873da92179ac4e9dc5da"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-1596", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-1596", "split": "silverTrain", "task": false, "text": "一般餐厅里吃北京烤鸭,鸭肉都会被厨师或店家偷挖掉一些来给他们自己加菜或炒别的菜卖,这个应该是大家都知道的,但是你们有听过一条小小的鲈鱼也要被偷肉的吗?点了一份沸腾鱼,看到他们家有活的鲈鱼就要求把冰鲜鱼换成活鱼,他们说换活鱼要贵一点这也是理所当然的啊,后来当着我面捞了一条鲈鱼进厨房,我心里还在想这餐厅应该还是挺靠谱的,没想到菜端出来一吃,全是鱼鳞就算了,里面所有的鱼肉都是带着骨头在骨头边上一点点的肉,要不然就是鱼旗和鱼尾巴,里面就没有一片正常没有带骨头的鱼肉,鱼头也不知道跑那去了,这跟他们反应他们也不会承认的,肯定就说鱼头怕不卫生帮你拿掉了等这种坑爹借口!后来买单的时候还看到他们员工开始要准备吃饭了,这不用猜都知道肯定有鱼吃了!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-2210", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e9b87c25ad1733220e22b8a5f5a56eff8b349759178f4a9b653098b5cffeed53", "cursor-grok-4.6-xhigh": "a0634f2c21aa2147520cb2eadece155e58c9496a53629a6c7a7026849094ea1c", "gpt-5.6-luna-medium": "45035da72933b0d8972b17ad766b2077b6db997abbccc61cd96164172f2a4306"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-2210", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-2210", "split": "silverTrain", "task": false, "text": "下了火车,直奔这里,味道不算多好,跟北京差不多的店味道没有太大差异!汤,味道一般,中规中矩!肉,不太好吃,有点腥味!面,不够劲道,非常一般!辣椒油,还可以,但谈不上多惊艳!鸡蛋,非常不新鲜了,这个可以吃来!如果你没吃过正宗的牛肉面,这里可能会把你唬住!但如果,你后来在当地多吃了几家,你真会觉得这家很一般!服务态度,很恶劣,不跟你解释面条粗细的差异,也不想跟你多说,怎么取餐!可能人家在火车站旁边,根本不愁生意!总之,如果,你跟我一样是个吃货,在意食物,这家不太推荐!如果,你想吃饱,随便吃吃,还可以接受!只是服务不好!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-23523", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e51b613ca882692432217d7a2d179ce7bca44158d8c7546c8860075df10d911a", "cursor-grok-4.6-xhigh": "049e12f43f8230290035b1155d487df08977f424aa4a0d7e26ef11dbc36159ea", "gpt-5.6-luna-medium": "c4906eab024da93e6cf0039642798673719ac65bb1ed8bb20ee411725190ae86"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-23523", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-23523", "split": "silverTrain", "task": false, "text": "我实在不明白那些说好吃的人是怎么想的 说说我个人的看法 前餐 面包所谓好吃的面包 其实也是咸的要死 硬又难吃 !沙拉不用说也是咸 牛排更是咸 我本身是一个会吃咸的人还是完全不能接受 只有那个看起来很炫酷的大虾正常点 但也是非常一般的味道 我问了服务员是不是都那么咸 他自己也说本身就是满咸的 如果有中国人说这里东西好吃话!恭喜你是装逼高手!东西吃了一口勉强第二第三口就实在没办法再下口了 奉劝国人三思而行 !! 刚吃完怀着愤怒的心情点评"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-23742", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7a7603a2cc1b981a27f4e1f52fa30dd98aa901f9838b5b6b6b8d1b5b600a5c38", "cursor-grok-4.6-xhigh": "203460a63b6385fc2dfa35c53c5edea1ebfc3b3001a87d0d00c36572406c9afb", "gpt-5.6-luna-medium": "186cd44a18277a8f50a1c4ac9db96a7b388fdcb1e6d99752ee81e1973048476c"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-23742", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-23742", "split": "silverTrain", "task": false, "text": "我真心觉得这个地方不好吃,就给两颗星吧。多一颗也不想给了。看了菜单是火锅和西餐的融合,我们都点了西餐那边就点的炸肌肉的丸子那种类型裹着面糊就是油炸类的小食,还点了意面跟番茄打卤面差不多了。说说火锅吧我们点的两个咖喱锅两个鲜虾锅,鲜虾锅里的鲜虾很鲜美很好吃汤煮到最后喝了一口还是不错的,咖喱锅没什么特色,觉得菜量一般般点了很多都放进了锅里吃吃就没了。四个人花了三百多用了优惠买单。是一个一般的餐馆不会再来这个点评也是时隔很久才来评价的我们吃完出去的时候外面居然还在排队,服务一般吧觉得服务员有点懵懵懂懂的感觉都是带孩子来吃的环境也是乱糟糟的一个一个锅子那种像呷哺火锅一样,一般般吧。不想再来了。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-26227", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9a10c6860306c28931a7bf83ba2e6bc727a1b09481fbc2a7203a76f226da85b5", "cursor-grok-4.6-xhigh": "7b527171532f8fcd6a073c9958b1353bda32dfa6364e65201d6fe5e30dd4661c", "gpt-5.6-luna-medium": "8bad10636a09ccf986dfb9bd897c4dcdbe62756538952da37b8267bb0a8be7e9"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-26227", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-26227", "split": "silverTrain", "task": false, "text": "最糟糕的一次团购经历。券上写明是提前2小时预约,10点打电话,说好12点到,到了之后店家居然说没听我们预约过,而我打电话的时候第一句话就说是预约498团购,虽然5分钟后店家收回了他们的说法,说是忙昏头忘了,好吧,一开始吃饭的气氛就被破坏了,后面还能好吗?然后就是漫长的等待,从12点等到2点,团购的菜也没上齐,一条鱼是足足等了2个小时才上,大家已经完全没胃口了,最后还是剩盐水鹅和时蔬没上,给孩子单点了一份蛋炒饭,也是快两个小时,经过无数次催促才胡乱炒了一份送上来。螃蟹偏小,吃口不好,其它菜也只能说是马马虎虎,完全不值一提,唯一好一点的还算店家道歉比较积。严重怀疑店家有自己刷榜的嫌疑,这个环境,口味,服务能力(怀疑烧菜厨师数量严重不足,造成上菜时间奇长),说是口碑是附近吃蟹店第一名,简直奇了怪了。最后还有件堵心的事,离店时店家不主动提供停车卡(在这里吃饭停车要店家给停车卡,否则路口要收停车费),害的我只能掉头回去又要了一次。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-27234", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6a586e1817791a36db00349f5621ddaf834e2ab9c90b5bc3fee2cee5c4748a39", "cursor-grok-4.6-xhigh": "7ddf123133cc2e0b6bab4cf9a11a9683c43ad2cdfd2406488ca36189556eb2af", "gpt-5.6-luna-medium": "cf47e161763c10c44f48eaab10d2cb60906fe16bcfa99f21d6668ddf0b05e2a7"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "question": 1, "replyableMessage": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-27234", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-27234", "split": "silverTrain", "task": false, "text": "服务冷淡没激情!周末不可以用团购和各种优惠活动!!面包诱惑,冰淇淋很小,面包烤的焦黑,里面的方块面包都塌陷了!冰镇咕咾肉,招牌菜,菠萝被水泡久了没有味道,咕咾肉和糖醋里脊一样的味道,口感硬,冰块太多,菜品太少!清蒸鲈鱼,鱼非常小,而且酱油味道好重,偏咸!!唯一能吃的是那个炒笋,拿来下饭了!!唯一好的事下单19分钟内没上的菜免单!可能也是因为这个所以后来上的面包诱惑清蒸鲈鱼很难吃!!!即便是送的,也应该对得起你们老板的口号和品质吧?!!最后,如果说一家店你是在卖情怀,卖诚意,那么麻烦把饭菜品质提上去,要不很难有回头客!!一家装修有格调,但是很烂的店"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-30376", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "57e14860067c48b545a85a0cfa120424acc712f91989938623576f83650de19b", "cursor-grok-4.6-xhigh": "57e14860067c48b545a85a0cfa120424acc712f91989938623576f83650de19b", "gpt-5.6-luna-medium": "0b68291ba159b008cbc55d57735d4c1f985fef6c1b02ace3b9ae88887088dd51"}, "labelerVotes": {"complaint": 2, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-30376", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-30376", "split": "silverTrain", "task": false, "text": "猜丁壳位于沙河地铁站附近, 在点评上看到好评很多,慕名而来 !晚上六点来的 ,店里没什么人 ,装修风格还可以,很复古的感觉!本来想团那个套餐的 ,服务员说需要提前两个小时预约!我们点的一个正常的小锅,微辣!还点了几个青菜,腐竹,豆皮,味道一般,特别咸,量很大,而且还不能要半份,这不是浪费么!再来说说主食吧 ,习惯了吃米饭,结果上来的米饭很硬,跟生的差不多,而且还是凉的,没办法,无奈之下又要了一份泡饼!服务也一般,叫半天也没人!这么大的店就一个服务员!总之很不愉快的体验!东西不是很干净,吃完肚子不是很舒服!不想再来这吃饭了! 不推荐这儿! 一颗星都给多了!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-31609", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c2b88b0d7a82d405466b877b46175f7c1df8ec0f488315d1633d2c95e6aa7352", "cursor-grok-4.6-xhigh": "02701b8993f02391083eb810a1f8b52af3714daa5033aac0414525269267f093", "gpt-5.6-luna-medium": "495b67ebf92992852f05361c99b0ff159b7d6bdf6076d76a02e966ca24c9a99e"}, "labelerVotes": {"complaint": 2, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-31609", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-31609", "split": "silverTrain", "task": false, "text": "看到如皋市丁堰镇新开出的这家九门寨石锅鱼忍不住带家人去尝试了一下,结果颠覆了我的整个人生观,图为七斤鱼的量,不新鲜先不说,来说说这个店员素质,在未吃完先买单的情况下,服务员收走了我桌上的手机,在目击证人未出面的情况下,老板拒不承认拿了我的手机,各种调监控啊什么的。然后目击证人华丽丽的出场了,老板娘甩出一句:谁要你的破手机,然后以忙着给人家结账为由说你的手机待会再处理,再三催促下,老板娘又甩出一句:你的手机重要还是老板做生意重要[发呆],又过了若干久,从手底下拿出我的手机,让我若干验证,证明我的手机是我的手机[发呆],今天我彻底被如皋丁堰镇这家九门寨石锅鱼打败了。你腻害[强]"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-31889", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2efec461e8e28c8d63cf3320d59d22865947be48771b7aab8a055cbf22b39af4", "cursor-grok-4.6-xhigh": "6cc3f023f6fb6c1a02dc359f670a2a308e1a699d8f464b14d3edcea50c9aa2b2", "gpt-5.6-luna-medium": "ff60878349ca7bfe6e21a79d7b37331d41c5eaadd84951410a4243c8a9830243"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-31889", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-31889", "split": "silverTrain", "task": false, "text": "真不知道那么多好评都是哪儿来的 一个星都不想给 简直难吃的要死了 点的114元的套餐 里面有年糕火锅 金枪鱼饭团还有半份炸鸡 先说饭团吧 一股酸了的味儿 炸鸡都不如路边摊的炸鸡柳好吃 配的那个酱能不能长点儿心 根本就是李锦记的蒜辣酱 年糕火锅我真的不想吐槽了 吃到最后都没吃出什么味儿 一点儿味道都没有 原来在五道口那边上班 和火炉火比起来简直一个是天上 他们家是地下还下两层 老板倒是会在价格上赚钱 团购有101的 有炸鸡和年糕火锅 到店里服务员就推荐直接点店里的套餐 也就是我们点的114元的 这样既省去了给团购软件的钱又能多卖一份饭 总之永远不会再来了 都不如包装马车好吃!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-31943", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a17bdee47abe18a911b09dbbee881d7b7d3cf483556770cd24a685338c269c3f", "cursor-grok-4.6-xhigh": "7552836c0fe84187518b9656ed9a19b5c4348605957f98c28d67c0c768cb3c2b", "gpt-5.6-luna-medium": "9dd32ad0eec6bc142f1c350e5abc0c4d2d2da0335937be6dda7784aa4e858d43"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-31943", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-31943", "split": "silverTrain", "task": false, "text": "真心是不想再去的店铺。先说排班,开门后每桌只能一个人进去,等位子找好了统一放人进去。简直搞不懂这是为啥!第二,服务员每个都是张臭脸,完全没有服务的感觉。我们居然还被清洁大妈教训,说我们拿多了。请问我四个人拿了五盘菜哪点多了?汤锅直到快吃完了都没烧开锅,找服务员来,人家说你们自己坐的位子不对。我*,还是我们的错!!第三,菜品,只想说没吃到一个新鲜的菜。海鲜就那几样,完全不新鲜。牛排将就,不过有点切不动。没啥好说的了!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-34705", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9e39d1405ee8611e795b780362a2a2240e143ac5dab08c516481517c80414256", "cursor-grok-4.6-xhigh": "7bcfedfaaebf1cc7e5849a94557efc1080a967e5c908847408662c154b8c670e", "gpt-5.6-luna-medium": "05328e17d9702fc3d549191170f8c5ab12d025525bd55d9a52df1bb9bb108076"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-34705", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-34705", "split": "silverTrain", "task": false, "text": "老实说真心不值得。价格不是很贵可是种类比其他自助餐少。连生蚝跟老虎虾都没有,只有便宜的越南虾。熟食选择很少,味道也一般。唯一好的就是蛋糕种类还算多。\\\\n7点半去,基本上一半客人都走了,可是八成的脏桌子都没收,我还要在外面等了15分钟等服务员收桌子。这种服务也说好的真心醉了。而且自助餐应该是送一杯饮料的,可是你要是不问,服务员绝对不提。\\\\n至於环境嘛,畢竟開在威尼斯人,差不了。可问题就是收桌子速度太慢,附近都是脏碟子一大堆,影响食欲。\\\\n大老远来一次澳门还不如多加一两百去吃别的自助餐。这家简直就是浪费了我一餐饭!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-34899", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "52449a34a6fb4dade486fb0ec359f49a726e2ea43b903b3ad0c95897843af692", "cursor-grok-4.6-xhigh": "81ea27061e1f8ae70502212f8bcb11d84b3b131a8c17deffc5cb94993e721346", "gpt-5.6-luna-medium": "d89498c879731c7a30c640ef4b6a88a127feba7bb90cc38f8dca1f63e6b4af6f"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-34899", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-34899", "split": "silverTrain", "task": false, "text": "考完试我老公非要吃这家,我本来要去海底捞的。事实证明他又上当受骗了。不只一次了,人还是不要贪小便宜的好,对于这种喜欢团购的人我只能说无语,不过还好今天吃完这餐他自己说出了他保证这辈子以后再也不团购了。因为什么?因为实在是太难吃了,点评好评的都是托儿。这家日料食材差,报价虚高,然后再折扣。非良心食品,关东煮跟7/11的好炖似的,刺身雪藏的我一口没吃怕拉肚子,寿司姜都是差质量的,寿司长的跟蔫茄子似的。而且团购价也不便宜298/2人,你刚买完团购券服务员就问你要什么饮料啊,有柚子茶etc,记住千万别点因为是另收费的秋后算帐。总之我今晚吃了一碗面算是填饱了我的肚皮,我肯定不会再去,而且我保留投诉大众点评商家自己刷好评的权利。这哪里是诚信社会,这是坑蒙拐骗的社会!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-asap-35476", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "248d1ec1283488f58bd6370956f0c3d3cddfc81e7267ab3f96d926928f806d4c", "cursor-grok-4.6-xhigh": "db9d079c04b2d05559eb0a7fef1c367c662f2c03f5ea8832ec5e77ed59cdeb32", "gpt-5.6-luna-medium": "269bd0a6ae5dccd67b29b194e47ad44771bb1adef10669ab27866d2430d7f7d7"}, "labelerVotes": {"complaint": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-35476", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-35476", "split": "silverTrain", "task": false, "text": "菜品还好但是老板和她弟弟都是凶悍的人,随时可能冲上来和你干架。吓的我都直接报警了,那女老板还叫嚣着你们两个人吃90块还要报警,你这女的真是连90都不值 各种骂人的话。另外这家说和大众点评没有合作,优惠只有美团,和大众点评沟通的时候老板弟弟把手机丢给我,我给放回柜台上后来就被赖着说是我把他手机摔坏了。还有她家端上来的东西你要是没点可就小心了,有的是免费有的不是,她家就靠这个坑钱的。建议要去她家吃的带上几个壮汉,妹子们千万别单独去,去了挨骂是小,挨打就亏了。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-35553", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "cb4831eae0e8183f2a38da117c74ea29b3c0a6b13a104a61fae02b8199203b0a", "cursor-grok-4.6-xhigh": "9865149344e4c70f0307e77443617b8bbd80a04febcd383f90e410c420d5b1de", "gpt-5.6-luna-medium": "02842f45a5caa891687fd01b88797bb12266abeca5f966e0690e574e29e09128"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "question": 1, "replyableMessage": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-35553", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-35553", "split": "silverTrain", "task": false, "text": "菜真的不是新疆口味,当然本人也没去过新疆,但和在别处吃过的新疆人做的比差距还是很大的。茄子这道菜感觉说的过去,茄子有点老,味道还可以。红柳串还行,但价位算高的。烤羊腰里面的筋没剔干净,不能咬断,影响口感。馕丁炒卷心菜太甜,甚至有糖还没有化。奶茶明显不是熬出来的,感觉就是红茶泡好兑上奶,而且兑的奶比例还不够。烤包子都差不多。炒片儿和我吃过的所以炒法都不一样,番茄酱好像没放一样,反正我不喜欢。小油馕是我感觉最好的,像小点心一样,可以给个赞。最后说下大菜烤羊排,真是太失望了,本想大吃一顿,以为要了整个的会吃不了,可菜上来发现块真小,更没辙的是肉还明显是被剔过的,肉少就少点吧味道还不好,烤的都干了,刷油不够,我觉得肉煨的应该也不好。总之这次午餐是很失望的。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-38143", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1f2f504c51b073c310ccbfb108e0afe078a717820b78f2e575354df47acf34be", "cursor-grok-4.6-xhigh": "1d95f885fc915dea1a11225a08db7b48d337addb5aee3dd26d1238f5b3480cf6", "gpt-5.6-luna-medium": "40df4beb009dc46dd275a1e2983278218d84755c8666a50280bd00a0e2d90972"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-38143", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-38143", "split": "silverTrain", "task": false, "text": "这家店在一个不知道什么湖边,超级不好找!老板开始会非常热情,在路边等客人,等我们都坐下后,一会一个电话,根本没有心思帮你搞螃蟹,菜就是普通的家常菜,一个高淳豆腐30元,炒鸡头梗20元,清炒菱角20元,韭菜涨蛋20元总之一句话就是素菜价格不是20元就是30元,价格高也就算了,关键是难吃级了,没有水平麻烦不要开饭店,载你没有商量。一个鱼汤58元,菜品份量很少。螃蟹也普通,90元一对,比较失望,因为很失望,照片我也是难得拍照了,反应下这家宰客现象太突出,请有关部门可以介入调查。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-38238", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2c0816127e1b4e18b47c42c897255ffe8775321130deb25e2b9eb611a0ad99de", "cursor-grok-4.6-xhigh": "2c0816127e1b4e18b47c42c897255ffe8775321130deb25e2b9eb611a0ad99de", "gpt-5.6-luna-medium": "8317a445b48841e8932c2dff85a269ce3a70abf8b00aa82bbfb7a0d942b6fa6a"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-38238", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-38238", "split": "silverTrain", "task": false, "text": "这家店在枫蓝国际的二层 店面很有创意 餐厅整体风格都很复古 很嘻哈 很多都是老旧东西 充满小时候的回忆 进店后服务也很热情 第一印象感觉不错 之后开始点餐 二个人点了七个菜一个酸梅汤 菜量很小 估计一份菜二个人夹不了几筷子就没了 但我们剩下很多 是因为简直太难吃了 可以说我还没吃过这么难吃的餐厅 但这要看个人口味 反正我觉得不好吃 点了杭州酱鸭 很油腻 还有些咸 不好吃 首尔烤肉 特别特别柴 一点肉香味没有 不好吃 葱香大排 就是饭盒装的一块猪排 有关是炖的 没什么味道 不好吃 笨鸡蛋炒虾仁 就是摊鸡蛋弄碎放了几个人指甲盖大的水发虾仁 不好吃 干锅有机菜花 下面一层油 不好吃 开胃肥牛锅仔 这是最难吃的了 肥牛又柴又加生 里面的番茄金针菇就是白水煮出来的味道 不好吃 鲜蘑芝士卷 这个算是里面相对好吃点的了 本来看了大众点评五星过来的 但可能每人口味不一样 我只能给二星了"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-38674", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1c530cc3cc1fda8537c2a5f8fa42522e96639ab641efc1431271e454a507cf90", "cursor-grok-4.6-xhigh": "50d11bb3db390bf7210d9d7c3ff13f1f9b7619a19b5ea44946b24d5dad3f404c", "gpt-5.6-luna-medium": "65282eb8c66c948ebdcbc7bba06cdb718fd641e457fc4e8a57964fbd0b2585de"}, "labelerVotes": {"complaint": 2, "question": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-38674", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-38674", "split": "silverTrain", "task": false, "text": "这家店的菜总体来说还可以,牛蛙和麻辣香锅味道还行,烤鱼实在很一般。但我想说服务实在太差了!!!!!!!非常气氛!!!!!!!服务员的素质极低!!!!!我家娃十个月大,一家人带着娃吃饭,好不容易哄睡了,在我身边的推车里。结果一个女服务员收拾另外桌时把一个大盘子打碎了,声音非常大,宝宝突然被吓着了,盘子不小心掉了就掉了我们不说什么,结果她又双脚踩在盘子上很张狂的蹦了几下,再次制造几声巨响,我们说有婴儿睡觉麻烦轻一点,另外一个男服务员一边收拾桌子一边说难道还要我垫海绵?!你说又这样的一群服务员,别说服务,连起码的公德都没有,这样的店能好吗?总之这样的店千万别去,不够生气的,服务不好还不让说,小心再在菜里放点啥。。。。。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-asap-39659", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6347431ab4db661300cecb2bb684f27880b6972c393d9b5dde334dc4217ed938", "cursor-grok-4.6-xhigh": "c553e2bd6af059406864095c18173da243120f04e0673706e3eeacd761bf5297", "gpt-5.6-luna-medium": "f87c96ba799d28f98fe57094d4c1b11e2bd9626025722742516a036c0e356c98"}, "labelerVotes": {"complaint": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-39659", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-39659", "split": "silverTrain", "task": false, "text": "这次去天津玩,为了图方便就住在了火车站附近,早上起来到火车站广场看看有啥好吃的,无意中看到了庆丰包子铺,当时就想到了***来吃过,所以也就进去看看了。里面吃饭的人还是很多的,排队买早点,各类早点都很齐全,就是真心贵啊,包子是按两卖的~~~俩菜包加一碗稀饭居然5块钱,包子也很小,稀饭的碗也很小,都没敢敞开肚皮吃,敞开了吃估计一个人要十几块钱吧,这要在我们家乡开店早倒闭了,我们那早上一大碗牛肉汤一个馍馍才7块钱。贵就算了,问题是味道也一般啊,还没家里老妈包的包子好吃,不要说穷吃不起,就算吃得起也不会去吃的。难怪以前看***在这吃包子的新闻,好多人下面都回帖吃不起,真TMD贵。反正以后是不会去吃了,就图个新鲜吧。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-41080", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d73915a60b1dad4d07cb8573883ca761b6d8e56eff7045bcb65bb9b6b69a7d79", "cursor-grok-4.6-xhigh": "64b3d23d7bae99cf9eb1f5b96ef0f31f808966068112b2f89f642eee7828c8b3", "gpt-5.6-luna-medium": "51b11d3020965e39852f3563cab282f946c15183a75f4ee71d640338e1d53b62"}, "labelerVotes": {"complaint": 2, "confirmationDecision": 1, "question": 1, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-41080", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-41080", "split": "silverTrain", "task": false, "text": "隔三差五跑去吃,算常客了!但是这服务态度真是一次比一次差!今天坐无烟区,这态度我也是醉了!碰到个女的中年妇女,之前让她催单,后来让她过来结账,刚想开口,她就超级冲的开口「不是催过了吗」这说话口气差,服务态度差!过了会又跑来个男的也态度很不好的问干什么!好像来干架一样!真的搞不懂我们到底谁是客人谁是服务员!必点菜油爆虾的数量也是越来越少了!同样的老板,还是隔壁的全牛捞态度好!真是一颗老鼠屎(服务员)坏了一锅粥!现在这种讲究服务的社会,这样的店真是迟早没戏!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-41822", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "55e067f27ba1b013aa24827b28544a51f91c6f7a4264df2fe0f5054bfd8069de", "cursor-grok-4.6-xhigh": "719cef4257eb34795252c9b62e4072a5926f1fae67c3a323e6914bff32b80683", "gpt-5.6-luna-medium": "417d9c1555781bde2ab241deff14340fc412e7c8b44e7fd2592eb5a6b9f2a03a"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-41822", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-41822", "split": "silverTrain", "task": false, "text": "食物的卖相是挺好的 味道一般 但价钱好贵又不是特别好吃 人均125 而且并没有吃很饱 店里特色的寿司雪糕 不太懂欣赏 个人觉得不好吃 熟扇贝味道不错 感觉很新鲜 三文鱼塔塔一般般 其他的都没什么特别 上菜慢 下单一小时后 才上一份寿司 当时店里面客人也不是特别多 厨师就有十多个 真正在做寿司的只有两三个 其他的都在嬉皮笑脸的聊天 ...... 感觉很没有诚意!!! 这家店不会有下次了!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-45138", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.99, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a60c9ef9a6c6b7dec753114520f05e73400c25b7673eb426575f349af2a85ab5", "cursor-grok-4.6-xhigh": "cfa3983a6f0fdc7f7a51ed37e8288a1c2b45870b331ef9601e624f1146d82153", "gpt-5.6-luna-medium": "fca9056b8ae9db8e7f5b63ffbe37f1a6fa54ad8ef25c40ad6355b18312eb82f3"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "question": 1, "replyableMessage": 1, "task": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-45138", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-45138", "split": "silverTrain", "task": false, "text": "差评!差评!差评!我不清楚这些好的评论是真的还是假的。作为一群七零年代的人,这个饭店的吸引力非常大,所以把同学聚会安排在这里觉得非常有意义。提前一天预订了,结果到店已经被人坐了。交涉后最后确定订座,但是座位不够没人加,餐具不够没人加,叫了半天服务员给了我们一堆碗筷,叫我们自己分,!点了八个冷菜,十二个热菜,一共七百二十。人均70,不算便宜。主要问题是菜。熏鱼是死鱼做的,海蜇是人造的,猪油饭是微波炉叮出来的,硬无味。柠檬虾都是死虾。鱼头也是死鱼,泥味。三鲜汤肉丸鱼丸全是渣。悠咄鲜更是无语。一桌菜居然没有一个菜是好吃的。也是从来没有过的。这样的饭店居然有这么多的好评,不知道是公关还是真的好吃?对于一个吃货来说还是真实的告诉大家,希望大家都有个判断。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-46343", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.82, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "45571811d910c479f411e34a2886cc56f48f054c1ad37e5269b8269bec9ac8dd", "cursor-grok-4.6-xhigh": "241688d1a9fd1d4a975ccd55ece9b0eddabe1c7e0088ac87109a4bb7fc88a688", "gpt-5.6-luna-medium": "5ffe2d63aaacc4525c03736d5c8d636d92f0c43a28a829b4bd517bd80bac674a"}, "labelerVotes": {"complaint": 3, "invitation": 1, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-46343", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-46343", "split": "silverTrain", "task": false, "text": "环境靠河边,还真的不错,微风凉凉,口味一般般,分量小,比浏阳蒸菜的分量少多了。价格不是一般的贵,晚上点了一个口味虾,一个清蒸虾,一份皮蛋,一份海蜇皮,一份毛豆,还有一份土豆丝,十碗猪油拌饭,一共400多,猪油拌饭,男孩子吃,应该差不多5口,份量少的可怜,味道还可以咯,只是味道跟价格不成正比,再说服务,服务本人觉得是可以,但是一起去的朋友觉得很差,去试试口味的,还可以选择,要是注重口味的,还是不用去了。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-6345", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f63b13a67480d744c7332bd007f5474ca8e8ffea0b79859750a2dfcac3d87a78", "cursor-grok-4.6-xhigh": "72a869aa23e37c2dbd869aa02c83e8dd338484f5518bc06b4875c6254e1ab407", "gpt-5.6-luna-medium": "c511bb094bdf586d4052e1a4dcc07e5e1f5c4ffce13597f71c568cf84a4c0ce0"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-6345", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-6345", "split": "silverTrain", "task": false, "text": "以前去过两次感觉还可以,昨天简直太失望了,朋友过生日定的唯一一个单间,低消600,三个人先去的点了十二个菜,四百多,告诉先做,别的朋友来再点,服务员说什么也不给下单子,说必须点到六百才给做,最后点了十六个菜,七百多,又要的白酒,让服务员打酒,服务员说不会打,我们说不会打就退了吧,服务员态度恶劣,真怕把弯弯鸡的汤扣谁脑袋上,九个人十六个菜,菜量太小了,没怎么吃就没有了,羊排肥腻的没有办法吃,香辣虾也就八九个虾,鱼头土腥味很重,总之是一次很扫兴的聚会"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-asap-7730", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "8057eff005ddd00cd1e9c2166845f0013a4bce2461752b1bab0b3bf1bce4a75f", "cursor-grok-4.6-xhigh": "885fab5249664fac9601f3f23ab1cc86f37d5f49633b2f33b18c2fe4d8d9eec2", "gpt-5.6-luna-medium": "a2f5f3558866178692eb08ab4eb5571f8c9ff0a19c6ef491fd560b0f8472287e"}, "labelerVotes": {"complaint": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-7730", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-7730", "split": "silverTrain", "task": false, "text": "住六建30多年不在五棵松路口吃饭、因为离301医院太近。阅兵日单位没早餐,图干净特意上二楼宏状元、没几个人,点了一碗南瓜粥、玻璃保温箱里夹了两根细长软塌榻的油条、一碟小菜(碟子就巴掌大),付款时说19元,我蒙了几秒 为了确定自己没听错又问了一下单价!服务员很淡定: 粥10元、油条3元 剩下那小菜肯定也是3元...没吃!把托盘放桌上我直接退出来了。守着301医院、连餐厅都黑!心疼那些外地来看病的。。。"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-asap-9336", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0784d9e7cbb93d2a5af90323b3c3194f90370dc2f2da9930b6c8de77cc5f037b", "cursor-grok-4.6-xhigh": "0784d9e7cbb93d2a5af90323b3c3194f90370dc2f2da9930b6c8de77cc5f037b", "gpt-5.6-luna-medium": "f7486e096343bf649988df5bb63d126209e2b2644760341534757c2c16b3a329"}, "labelerVotes": {"complaint": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Meituan-Dianping/ASAP", "sourceLabels": ["complaint"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-asap-9336", "sourceRevision": "975122a60065240124df62cb4d5dbfd19ed9ef2c", "sourceURL": "https://github.com/Meituan-Dianping/ASAP/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/train.csv#row-9336", "split": "silverTrain", "task": false, "text": "到广州旅游,去了广州塔,饿到九点半晚饭还没吃,原本以为是个夜宵好去处,看了下菜式以海鲜为准,谁知道价格贵点不算竟然还有隐形消费加工费,另外茶水费说是广州习俗也就算了,两人点了两个大懒尿虾,花螺,蛤蜊,生蚝,原本想点番茄炒蛋谁知道炒个番茄要58加蛋要68,毛血旺才63,这素菜赚到手软了吧,海鲜只能说新鲜点但是味道烧的都一般,但是毛血旺实在让人作恶,咸到醉了,厨师你以为在淹咸蛋啊,叫了经理,让他尝试了下,连她都觉得确实咸,哎 换了一盆上来总感觉已经有阴影而且味道也不入味色面也不好,尝了两口就放弃了,这些菜850,实在性价比不高啊,服务态度也觉得一般,只能斩斩外地游客!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-1777502", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a1159d5f2226423cf64e133728dc64ee0f72946e4d6b03c012468b2d2e5c3558", "cursor-grok-4.6-xhigh": "a33f0010896e1dcea33c1300e008cddcfab3246ee5d5dbf2efb6ce21f99f748f", "gpt-5.6-luna-medium": "ffdc70d7bb66b4dfb15c9a1ec776e73bcc13c0a243580a795576aaa207c90cc8"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-1777502", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/1777502", "split": "silverTrain", "task": false, "text": "took out a {$5000.00} cash advance on my bank account 115.00 % rate could not pay the high cost cash advances is not legal in the state of Arkansas XXXX is reporting these accounts for cash call XXXX XXXX collections"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-2555962", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "3262c3712d2d02404660bedda6e1b0268df94192baa61058f3c164d7afa05196", "cursor-grok-4.6-xhigh": "4f4526f6b5d8a85a452cff783b3a494776700d82477863a48772c276c71ecdf9", "gpt-5.6-luna-medium": "140b439a2e6aaad7da46d62a46c8ad5440db7189068f8f789c90d04ae16f49c3"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-2555962", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2555962", "split": "silverTrain", "task": false, "text": "I am a victim of identity theft and have been a victim of identity theft for well over 11 years. I have an unauthorized and fraudulent account listed on my XXXX XXXX, Equifax and XXXX credit report that 's fraudulent. The following account is fraudulent : XXXX XXXX XXXX account : XXXX. Please permanently delete this fraudulent account from my credit report."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-2701144", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e93175f38c63bce9f9c6dc0344a3bcc7f85477b3ef7808f45e7890c4ec5c1b46", "cursor-grok-4.6-xhigh": "297d060165b803513457331e7d51344be608cbb59a35f481837c91954fcfd2b8", "gpt-5.6-luna-medium": "9f32dfe794c2cc9aff489cbb018305445681e530208ab52c67654b7ae6021561"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-2701144", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2701144", "split": "silverTrain", "task": false, "text": "There is an account on my credit report from GC Services with XXXX. For balance it says XXXX and for high balance it says XXXX the information is incorrect. This account was also removed from my credit report and keeps reappearing. It was removed because of the amount being incorrect."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-2986864", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ddd4b63938d885c4b0b435c76b78149158917f3e0475a8c0898659bb324ef72f", "cursor-grok-4.6-xhigh": "ca3a273dd5a5b67021945e965903d9cb330864e431a9e471b452f2296dfc3218", "gpt-5.6-luna-medium": "3b13b62eb1adf52976467d53f3d3e4e00e89f9af60a820311006001b14cf874f"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-2986864", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2986864", "split": "silverTrain", "task": false, "text": "On XX/XX/XXXX and XX/XX/2017 I received a hard inquiry from XXXX, which I did not authorize. I DID not request to obtain directly or through third party any loan or line of credit or charge card from XXXX in connection with this request ( as I already have one and do not desire anymore at this current time. )"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3001841", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c42e9acbbb4fe7e282e6fb1e93b52d7c5c77e864a023e45aa4a760800a9f6bfa", "cursor-grok-4.6-xhigh": "c42e9acbbb4fe7e282e6fb1e93b52d7c5c77e864a023e45aa4a760800a9f6bfa", "gpt-5.6-luna-medium": "2852b8e2fda6a116f3702dddeddf4796c71cd017adb3720e5ac2872611f888f9"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3001841", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3001841", "split": "silverTrain", "task": false, "text": "I have disputed an error for an account that I had with XXXX XXXX credit card with XXXX, experian & XXXX. I have provided a copy of the check that I paid the account in full to both the credit bureau agencies as well as XXXX directly several times and yet this account is still being reported as late and not paid. Legally they are obligated to correctly report the right information and they refuse to."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3073568", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a4c85c251d4c8770a54ccac7102d06230f9915539e594b2d050f5befef7de8d4", "cursor-grok-4.6-xhigh": "a70f660577cdbf4c1ce3a8a4f78fbca079163985f328b302a25a5a62887111b1", "gpt-5.6-luna-medium": "b95dc58ecfbb8025cebb6f9fff4efd1136b824ff30548f149950acb8c9144bc6"}, "labelerVotes": {"complaint": 2, "confirmationDecision": 1, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3073568", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3073568", "split": "silverTrain", "task": false, "text": "XXXX has been non-compliant with removing the unverified account BANK OF AMERICA which has been deleted by XXXX and XXXX. XXXX and XXXX have both completed their research and determined that BANK OF AMERICA was not established by myself but XXXX keeps verifying this accounts. Also, when I called the company they responded that XXXX did not send them all of the verifying evidence to confirm each account is unverified."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3169526", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "77b4000c814fc73b76ca60a5bbc85be627fe5a0b47c05cd4603489f7983a09cc", "cursor-grok-4.6-xhigh": "cf06553d7a35c561a890082da7087f68e4aebf603bedaca106f65b34008ebfae", "gpt-5.6-luna-medium": "7daa25e09d312e08169c8d4f6ba360065f846f7a0b21d76a01937002900bf583"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3169526", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3169526", "split": "silverTrain", "task": false, "text": "CMRE contacted my sister about my debt XX/XX/XXXX @ XXXX expressing to her that they were going to report the debt to my credit report and they would next garnish my wages she explained that I was not home but the rep insisted that she was in fact me I then called them and they said they were sorry the last rep did that but would I like to set up payments I explained to them this isnt correct and they needed to verify this incorrect bill"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3258718", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "863191672da4845a927d8422fae76054c940228c323d0d91005a7ae9135e3721", "cursor-grok-4.6-xhigh": "863191672da4845a927d8422fae76054c940228c323d0d91005a7ae9135e3721", "gpt-5.6-luna-medium": "171579db3dc52abd9bae9c615c36959c30eaed93575820c5db5940c8a7b24911"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3258718", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3258718", "split": "silverTrain", "task": false, "text": "They would call repeatedly and not say a word. Then they called me once cursing and using offensive language. I told them you have the wrong number and they dont care, they keep calling."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3315833", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "19b346cfd342cd46e546b556ee880547962508729b80b3ec01421328c1769822", "cursor-grok-4.6-xhigh": "a9cd654b33c8e9c9f6a6ab2f0480aac2759d854c0798195f21b6a9802b2fa809", "gpt-5.6-luna-medium": "35080cd9334a7ec73888092273988d38069f72d333289d9f2364149fea159445"}, "labelerVotes": {"complaint": 2, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3315833", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3315833", "split": "silverTrain", "task": false, "text": "CEASE COMMUNICATIONS AND REMOVE ALL CREDIT REPORTING OR BE SUED. FOR XXXX XXXX AND MYSELF."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3558426", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c1afa033c51c8ad069f60e34b5b778cce26a4b939c21c62652137f742fa93969", "cursor-grok-4.6-xhigh": "9f06ea02db77ff0a6060bbfe13255966e22dfe7b13843b4938926c2bdb70ebaa", "gpt-5.6-luna-medium": "9a1d5011fd04816f4ebeab78366417113e43d7da1a23c50cddea9a32516c797b"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3558426", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3558426", "split": "silverTrain", "task": false, "text": "The billing address is incorrect on the billing statement I never stay at the address shown on the bill the account is not mines. I never received notice of any bill due for any service"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3747030", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "54a2c4545d8820afc5f92939bd158512baf0c52edf2ad1b00dc94d6c4ac40442", "cursor-grok-4.6-xhigh": "005c4c24b9c43c2f34d685d949343d747252091f1ef9a7838182db9cb48362a5", "gpt-5.6-luna-medium": "94f0e690c84ab99fe458f85458e88ed636976295f3d9585aada9d499a9871741"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3747030", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3747030", "split": "silverTrain", "task": false, "text": "I was shocked when reviewing my credit report and found late payments on the dates below : 30 days late as of XX/XX/2020 XXXX all 3 bureaus ) 60 days late as of XX/XX/2020 XXXX all 3 bureaus ) I am not sure how this happened. I believe I made my payment to you when I received my statement. My only thought is that my statement did not get to me"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3828096", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d1e067e6d44bdbd8ce738292f97539410cf0d2029effa850ac6b30af4fb66a83", "cursor-grok-4.6-xhigh": "d1e067e6d44bdbd8ce738292f97539410cf0d2029effa850ac6b30af4fb66a83", "gpt-5.6-luna-medium": "99b3f617bc53cb4cf3ae3750a5cd3709405bd4647e9c351948a2e1becc10cb02"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3828096", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3828096", "split": "silverTrain", "task": false, "text": "I have disputed this account and have reached out to the company/creditors MANY times but failed. This account is being reported inaccurately and incorrectly on my credit report."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3858080", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "80f4ea168734b908c1574e75c9e61486acae6f002a504c0bd571a7b9dd383be6", "cursor-grok-4.6-xhigh": "84c053e162fb570f54a265dbce507294cc6bb4bccc60564ae9fa3dae87dfeeb0", "gpt-5.6-luna-medium": "ce848d22b279e633011be47325295184558c4d024034ab73e09a66081129e9b5"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "question": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3858080", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3858080", "split": "silverTrain", "task": false, "text": "This is the second request..I had asked you to remove accounts that I do not recognize that includes addresses, and my name is incorrect. Additionally, there are a ton of inquiries in which I did not approve. Please delete them immediately. Thank you."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-3919922", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0b7984b5fae18ac3a9f8e922e667296c1d6acd904a19c3adc59ca21df76f4c24", "cursor-grok-4.6-xhigh": "44d0ff80f18b20d245559b2355557bab0ab1b6faa2a3694db1cfdf1c60b2fcd3", "gpt-5.6-luna-medium": "69164f596e4a44592bf1b96b1538ea43662bd3a11d8d8093cfacbd0c819ed3bd"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-3919922", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3919922", "split": "silverTrain", "task": false, "text": "Experian is in violation of the fair credit. My understanding is they have 4 days to block the fraudulent items on my credit report. They have failed to do so in that time frame."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-4075299", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6d58d8847675a333fee7d980c40a9a52e1aadc1279f8b07e4969574e35a04b6b", "cursor-grok-4.6-xhigh": "6d58d8847675a333fee7d980c40a9a52e1aadc1279f8b07e4969574e35a04b6b", "gpt-5.6-luna-medium": "1ca8c2d79542f62786ae38c87d4bb19b40e1ea06bf45ffd678e0067adc37f1e5"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-4075299", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4075299", "split": "silverTrain", "task": false, "text": "This account is not accurate CONVERGENT OUTSOURCING # XXXX. My bill was PAID IN FULL XX/XX/2021 directly to XXXX XXXX. I do not have any contracts with CONVERGENT OUTSOURCING. This account has no business being on my credit file."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-4386529", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4a75cac49834b3d0b8951b67e55590d6f2312c71df1cb64e88d92488f9b7757f", "cursor-grok-4.6-xhigh": "0989038d071b4b462052a7567e8ed79c5bf6be54c88c2a3a2f95b7b78e7faf0a", "gpt-5.6-luna-medium": "04749dc3afd74eeb5c16328649c1a19f3b34829939b62a572358c4151d72c2fe"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-4386529", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4386529", "split": "silverTrain", "task": false, "text": "I have disputed the items circled in my attached report and they have failed to address these items in a timely manner. These items are unknown and need to be deleted from my credit file immediately."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-4613745", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "3803575f17446d1ce0ca26dde3c07b5f922e29240fef912804bd2894b0ec10f2", "cursor-grok-4.6-xhigh": "842cc6ad6ef0dc3fb21fae6d45a483329593f9e91a0ade7eda5f7513eb6c37e6", "gpt-5.6-luna-medium": "67938b39f246b1de472a117a7764c95757d4338a85d4203f9a390c2e1898ee61"}, "labelerVotes": {"complaint": 3, "question": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-4613745", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4613745", "split": "silverTrain", "task": false, "text": "I am filing this complaint because Credit Bureaus have ignored my request to provide me with the documents that their company has on file that was used to verify the accounts I disputed. Being that they have gone past the 30 day mark and can not verify these accounts under Section 611 ( 5 ) ( A ) of the FCRA - they are required to. Promptly delete all information which can not be verified. Please resolve this manner as soon as possible thank you"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-4758252", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1124f2a8898e63fd93fd6cce710ad2127412921c54b15e7e2d3eade7b802b050", "cursor-grok-4.6-xhigh": "de6ed86e2949d9226ac048fc6e3375a463d32597d1500f0c3d731c149cf3e341", "gpt-5.6-luna-medium": "be464a3430f4a28486c15647320c89c65617a1b6b3d6e2a640a70a830d3ac806"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-4758252", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4758252", "split": "silverTrain", "task": false, "text": "Received a letter on XX/XX/XXXX from American Coradius International LLC claiming I owe XXXX, XXXX {$9400.00}. This is not my account and XXXX shows a XXXX balance for my account."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-5123759", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "80d1201490fd77217d78c55ea78390df3980d3871c33a055cdfc3eb033df3d4f", "cursor-grok-4.6-xhigh": "80d1201490fd77217d78c55ea78390df3980d3871c33a055cdfc3eb033df3d4f", "gpt-5.6-luna-medium": "6aa8f5e033268a28f38aa127738ae8f3dcb1ee6ed73ee3a559100531f6ab0741"}, "labelerVotes": {"complaint": 3, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5123759", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5123759", "split": "silverTrain", "task": false, "text": "I have paid off the balance to my credit card back in XX/XX/2021 and the credit card company is not reporting correctly to the credit bureaus the balance should be XXXX they are reporting i have a balance of XXXX dollars also they reported the card closed when it shouldn't be closed this has caused me stress time from my job to keep calling and getting refused an apartment"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-5296904", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "581dd8bb7c842a0baf52e15a4700defe74c0bdb790e9e760971dca26ad85ddf3", "cursor-grok-4.6-xhigh": "af1dee871eeae280da3ecfc74b1554bcf250c1b68d58b5b800bef8eba9680892", "gpt-5.6-luna-medium": "ee1721d92a51f1d12d5e0bfc1cd68122b72b2deba348ea9f7c4af23f1664a29c"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5296904", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5296904", "split": "silverTrain", "task": false, "text": "I received a demand letter from Perdue Brandon Fielder Collins & Mott LLP dated XX/XX/XXXX. In XXXX I had an arrest with a restitution. Since that time I have been paying XXXX XXXX XXXX XXXX directly. The letter the \" law firm '' threatened my arrest and or license suspension. Neither of which, according to the courthouse and my used to be probation officer, can happen. Not only claiming I owe them, they are also claiming I owe {$420.00} more than I owe."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-cfpb-5342499", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d1b3826af9d2243e67ca9f6fe4e4935e7503c2f7d172624a8c1b024ed003dc9a", "cursor-grok-4.6-xhigh": "27fd2aca7f5ba67ae3877a0dc088af7657731d1b5567c918f5fe3295bdc136bb", "gpt-5.6-luna-medium": "27fd2aca7f5ba67ae3877a0dc088af7657731d1b5567c918f5fe3295bdc136bb"}, "labelerVotes": {"complaint": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5342499", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5342499", "split": "silverTrain", "task": false, "text": "I have filed a dispute in regards to incorrect items on my credit report. It has been well over 30 days and I haven't received any investigation results."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-5430594", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "aa1c21d6c3b8c741e3e4db69947d2cf292254197c278277f995c715e986c4010", "cursor-grok-4.6-xhigh": "b0d8f2695ab1b133d32719805bcb4b6192fcc44f1d5bd90b5bf951d57b66c3b7", "gpt-5.6-luna-medium": "9e932c2c493d0b1fd4d9d1fce773a88b806535ae2494a36407437e46f0bda3bb"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5430594", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5430594", "split": "silverTrain", "task": false, "text": "XXXX XXXX XXXX {$29.00} Date XX/XX/2018 acct endin XXXX In accordance with the Fair Credit Reporting act XXXX Account # XXXX, has violated my rights. 15 U.S.C 1681 section 602 A. States I have the right to privacy. 15 U.S.C 1681 Section 604 A Section 2 : It also states a consumer reporting agency can not furnish a account without my written instructions"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-5546899", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7f969051c7761a16ad0cd6ddff4a65c446c820d74488274325a76e1a1c2720d1", "cursor-grok-4.6-xhigh": "1f210dcb0222a906a5aa233ab36352e1f0af8dc86d3eee994e6091a24245d736", "gpt-5.6-luna-medium": "f51c1451ebd4e2c9f280c7b7e7f779129d8acde2498f004356be4b08404f7559"}, "labelerVotes": {"complaint": 3, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5546899", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5546899", "split": "silverTrain", "task": false, "text": "Someone opened a XXXX XXXX XXXX account in my name, with my documents, and for years I've submitted an identity theft report to ALL of the major credit bureaus AND the creditor. Each company fails to remove the account from my credit report and fails to acknowledge the identity theft, even though I've submitted a police report and a report from identitytheft.gov"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-5594585", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f595e9a9adeade6bf787fb7a132ad59b732d366d4b29e05891ad3db58b16ea2f", "cursor-grok-4.6-xhigh": "f36f31320148c03ac57a9f673377e0dbc5bec81143d7c46e7188edc9654ad542", "gpt-5.6-luna-medium": "03615dd7c2df6198cc3ab93d20cbe6a05797cce91914efc96b1e23b7461c0770"}, "labelerVotes": {"complaint": 3, "question": 2, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5594585", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5594585", "split": "silverTrain", "task": false, "text": "How did you get my personal information? Who and what gave you the rights to violate my rights to privacy as a federally protected consumer? And Are you aware of the laws youre in violation of by getting an federally protected consumer personal information without consent? Now Im giving you this one opportunity Firstsource Advantage LLC to explain yourself and answer every question mentioned above. Failure to comply will result in fines. Best regards! And the best of luck!"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-5843160", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7fdb72e25adb0ac88932e1d69d978f946f305068561ce475eb0fb21b3ed6508d", "cursor-grok-4.6-xhigh": "889ee367c40521ddf9f2a578eea9fd1f20127fc310e616e1862c3aa121a355a1", "gpt-5.6-luna-medium": "0f4ca08a023a6e109cdf579b56e27cb44077eddb69cbd27ea0e4e55ea7a5cf21"}, "labelerVotes": {"complaint": 3, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-5843160", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5843160", "split": "silverTrain", "task": false, "text": "I want to report Identity Theft that has been going on for years. I never knew much about credit or cared to use it until recently. Now that I'm looking to build my credit I've noticed several things on my report that I have never opened. I've sent dispute letters in the past and have been having a hard time getting everything removed."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-6061472", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "88d1e0044c184fd2d0c5b838e8039a925fbd46d3ce07d02ac2b9e8db155bb39c", "cursor-grok-4.6-xhigh": "9fb3cea47961506d03d48488110b36498555d7bceec007b87f7a390eb515cbff", "gpt-5.6-luna-medium": "06e44755d193ab99a9a302d01a3131d5c81c505a337cfe54406a7329cfcf13a9"}, "labelerVotes": {"complaint": 2, "question": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-6061472", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6061472", "split": "silverTrain", "task": false, "text": "To : Consumer Financial Protection Bureau, XXXX is continuously violating the Federal Law made by the Congress and keep violating my rights as consumer of this Federal Corporation. As the Credit Reporting Boss please I request you to stop them with their misinterpretation of my consumer report. Thank you"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-6461018", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c3eb99576b75fc64133863d7d24f3dfeadba64b1d7c1c78097ba48bf98c9baab", "cursor-grok-4.6-xhigh": "c3eb99576b75fc64133863d7d24f3dfeadba64b1d7c1c78097ba48bf98c9baab", "gpt-5.6-luna-medium": "8c32008e5483c34ca3d8fdaa0c9c55d30d1bf8ae5e7f31141ad0a381469dae3c"}, "labelerVotes": {"complaint": 3, "confirmationDecision": 1, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-6461018", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6461018", "split": "silverTrain", "task": false, "text": "I was scammed by a sophisticated pseudo scam thru XXXX and I disputed 17 charges for which they only claim to do an investigation of which they didn't do and then turn around and agreed with XXXX that it was ok for me to be scam of over 90 thousand dollars."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-6684695", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "231e49f864a20c391457bc5291539be94247be7352ea98e98cebb1af84fe5179", "cursor-grok-4.6-xhigh": "e3756a3450bea3435c1c912b0cffb2b03f7366bde0c183c198e38ba297c01c14", "gpt-5.6-luna-medium": "0a735593c7df607f4e58c2c3d4ea1a014fa384381ccd7aa036484e688bdcf7b4"}, "labelerVotes": {"complaint": 3, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-6684695", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6684695", "split": "silverTrain", "task": false, "text": "Unable to open a new bank account with pnc bank, XXXX, XXXX XXXX XXXX due to accounts being opened fraudulently under my name in the past"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-6977335", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "22f5d40b29c280ad1a80580959ac233d03be538f436fb2475dc070dae70821b0", "cursor-grok-4.6-xhigh": "9ef62b5a57d6e47b253ba60d29c46a09b62ae2f912265528e64a660a0d40813e", "gpt-5.6-luna-medium": "88a63ce7af7bfe7e1e1e69f5e1a5c3256fc5a40355d0c56e25cfa076407e63f3"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-6977335", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6977335", "split": "silverTrain", "task": false, "text": "I did not consent for these consumer reporting agencies to furnish any information disclosed in my FTC report to any person."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 1, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-7054229", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.6, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d9882ed0ba300ae9d6d40d62d40356ea76170f8cb153fdc7f6a983ef73d112c6", "cursor-grok-4.6-xhigh": "f47f8e963b233f211e4fb93c77a277fc66529788638fa9e66ad3cf268cbf4b1c", "gpt-5.6-luna-medium": "7f399f04483bad913c8f51f6fc9ed6623fcb7ca2bbce352bb61622b80ff56195"}, "labelerVotes": {"complaint": 2, "question": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-7054229", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7054229", "split": "silverTrain", "task": false, "text": "Multiple inquiries when applying for vehicle multiple inquiries on XXXX credit card and multiple inquiries by mortgage companies"}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-7352245", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "3bbd2db35983df825c0d61d53834b8e853e13dd042c84fc721fefb1c9ccf0901", "cursor-grok-4.6-xhigh": "0685199894bb98c14afdeee911055d89d1f9dde1e22cfb18c1ae6533a912a614", "gpt-5.6-luna-medium": "419dbb7715ad7ebffc30c0a6c5cf63ecef305893260efbbfb996f0da9dfa7fff"}, "labelerVotes": {"complaint": 3, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-7352245", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7352245", "split": "silverTrain", "task": false, "text": "I submitted a credit repair request to a company, but they failed to respond within the 30-day timeframe required by law. This failure to respond has negatively impacted my credit and caused difficulties for me. I am now considering submitting a complaint to the Consumer Financial Protection Bureau ( CFPB ), in order to address the situation and protect my rights as a consumer."}
{"actionVerifierLabel": "complaintOnly", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-cfpb-7415516", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "18ed7516f7f5e91918a612f1d3f2541e490259fb8d618abb2e6196da35058af3", "cursor-grok-4.6-xhigh": "0546aa66ba6ab8b6beafad8766b71e965c4510ceede6bcceaff5921604f09c75", "gpt-5.6-luna-medium": "b51ab9a43250b67af1e7759c00a2e0e8d471a12a5c6e6bd9fe3dce4795c517c6"}, "labelerVotes": {"complaint": 3, "question": 1, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLabels": ["complaint"], "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceRecordID": "open-cfpb-7415516", "sourceRevision": "e5fec64e1f0688e47699b9cf8c26fe4ed350123a", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7415516", "split": "silverTrain", "task": false, "text": "I am a victim of identity theft. I am writing to request that you block the following fraudulent information from my credit report. I have no idea how the theft took place. I also have no knowledge of any suspects. I did not receive any money, goods, or services as a result of identity theft. Please let me know if you need any other information from me to block this information from my credit report. Thank XXXX XXXX XXXX XXXX XXXX"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-10654", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "36f79a91344d3dc439eb138fbcbc3fa7c34bef1c5df3bc000cad3e5b91b921b8", "cursor-grok-4.6-xhigh": "02e1042d36fd90ddf60727883315aff8c94fd2af21bf9909cd8f36c68ed4a43d", "gpt-5.6-luna-medium": "36f79a91344d3dc439eb138fbcbc3fa7c34bef1c5df3bc000cad3e5b91b921b8"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-10654", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": true, "text": "please find me a hotel room for 4 people from monday to wednesday in lakewood"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-11032", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ea2b5f11d6f9d6957c0d9ba9ddcbf65d454f89de59650fed637ff37815dfc0f9", "cursor-grok-4.6-xhigh": "1b180c9743ce862107597f0513cfcd38821628f583caaf479d7769d257a611a6", "gpt-5.6-luna-medium": "3082c60cece145a1f3d7a693e2d64b4b59abff1b0dfad330ad45b9662d0f6563"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-11032", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "tell me my electric bill minimum payment"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-clinc150-11158", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "455b55470d1abb95730af92f2b2804076b46b1f6ea37a848cf9229fe2f73b022", "cursor-grok-4.6-xhigh": "fb1b044b9e4da18e8ed3d0388717008fcddef1bbbceed7d1478f345efc1ad6a7", "gpt-5.6-luna-medium": "455b55470d1abb95730af92f2b2804076b46b1f6ea37a848cf9229fe2f73b022"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-11158", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": true, "text": "i want you to use whisper voice now"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-11599", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c3505b53f66bf64aedc9f3b97a1008bf990b96377e178dfc61b72fd757917b8b", "cursor-grok-4.6-xhigh": "438717f9153d106c647ad274fd074480b501b9938a5b19e7378ea86107543d79", "gpt-5.6-luna-medium": "d1075c8fd3a7739634e4b3cff1dcb7169216a198972b4efe251119cdacb8ca07"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-11599", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "let me know my vacation time"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-12431", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "024db1a9c925155f12c52472d30662bc8e85f3449f95f9cdbb10ae029d043964", "cursor-grok-4.6-xhigh": "63ed58b1c0965671d080e81c17d11380e26dba8b791b91e090e8b2985656263a", "gpt-5.6-luna-medium": "7e1efe1bd2915cda13540d8a8ce082d778f808aeb0c4418abc70a9d881ebd34c"}, "labelerVotes": {"question": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-12431", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "what sorts of things do you do to have a good time"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-12583", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "74253bd1504f3d2f9fd0d30234eb038b758ea363eefb7adddb4cc83f86d713df", "cursor-grok-4.6-xhigh": "ee83296afcc4113d688860eeed17ce8e2da9ae5546e252222b04270512cf4ae1", "gpt-5.6-luna-medium": "05356a96c06c66f87e04f7641c44ab6015e59e5439005f286cb32683a2616c58"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-12583", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": true, "text": "show me roundtrip flights from dallas to houston for march 7 and march 10"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-12891", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a669763921607fe4ea0e2aee191acf5381e8b1255f11036ccf524c5492d8a7c3", "cursor-grok-4.6-xhigh": "eb5050ec0336e691674b340e59d71b94638369ea887102bc2eb551cc45014538", "gpt-5.6-luna-medium": "0e4e02946e43130ef7d8e215acb9e4eb194607ff15ac5fe0389670f8526075a5"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-12891", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "how much do i have on credit card bill"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-14078", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "626bf18265903a70f1f0f616010384e29d85a1c53e9b73fba0a61a25bad7c3cb", "cursor-grok-4.6-xhigh": "65cec108297aa26a8e3f72a79d798a232ff58052c74588eaa73ab87c310cea73", "gpt-5.6-luna-medium": "61b2c5895120fb94469bf9e7b0290662cd1e372baedbd955cc6caf7d3ced531b"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-14078", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "on what day and date of what year were you born"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-14311", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "288ed23f081d2277d402ba29d770dd6e2589e2f528f40c60f75a5ff955c6e09a", "cursor-grok-4.6-xhigh": "04808ba68f63a87ce488dde9b2e1ddb421829aa7067b66ee4bda90f4f7e84595", "gpt-5.6-luna-medium": "6de72fbeca563ecb4eb7151e496711d0001a2f00fe86ab5b513ce45ba8ebd217"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-14311", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "can you give me a thai meal suggestion"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-14562", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "613c6a7f1474b0e3724732a81ed52d1baf5b79ee6cbdf377e58318fd6d8b27e7", "cursor-grok-4.6-xhigh": "cd4e96a6e0b038b7bf617c3c64329aa2f9c53fc2db4ea48f7220950f0e05e587", "gpt-5.6-luna-medium": "58841a3a8c287ed145e523e44620cb169cfe0cbb5d0bd1e236a75559e197ad10"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-14562", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "what is my current gross salary"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-16", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b0201fea4f9f646ff7f372dd1b0b1fa688af21f428c5d4dd19eb4c050bdfceea", "cursor-grok-4.6-xhigh": "2cbcbd4dc1be6a4350f8a4e4c3676c788f83d5bf3dadc29246f58e10f053946e", "gpt-5.6-luna-medium": "7d7cee41a7878538ff60f69c866c6aa1b7112323feb02ca045799e36bab0e502"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-16", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "if i were english how would i say subway"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-1839", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d2f701825e64b47279946e6380427d5158edc16892405d2a57d1142c174de2c6", "cursor-grok-4.6-xhigh": "6817320466fca407f2926a77dcac49b99d4f7141beb42487eb62dd4f22fefb30", "gpt-5.6-luna-medium": "adecb1b44e8a2b2f166b922f2cdb080cad812a70b06755b041e63f35b66b642c"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-1839", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": true, "text": "can you just start calling me sir"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-clinc150-1890", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "aa117edfc950264e7acf510cd40d891926f06280208c771245ede1a78da45dbe", "cursor-grok-4.6-xhigh": "2ef314d41cce6e27842456324d595e736cd54f8e3b2927262746af8c2f3c06b1", "gpt-5.6-luna-medium": "8700bf3684481d28556a73b7fb88733cd133b99c4a8b0b9ae55f7d6ee9ac109c"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-1890", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": true, "text": "i want you to call me lord"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-3087", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "bb8dd568400efa08a962c2a9a649c4b24a7a771471951af6362ec3eb08aca6c1", "cursor-grok-4.6-xhigh": "a5494c0fb9339969ea37fc70f7fef29fefbe0ad0e86f7fa871daced90b172bee", "gpt-5.6-luna-medium": "30aec17b09850259bde3bff7d059f53d8e68aabdd4b4f409ceb829ca20347e8e"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-3087", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "how long will it take to get to long beach terminal from long beach airport"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-4465", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "616e5bfa2946b6a280509fe6c8afedec7d1f4d49a91a74ac6b12ef17b94f6dad", "cursor-grok-4.6-xhigh": "aa37de7eadedd37f54c956aef45a13ebf661eb07e4c83a07c68f93aaa6394ebc", "gpt-5.6-luna-medium": "2d007c08a78375ca70991b08d8350aee9f7d148f9ce7cda2e93a39499b50dc72"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-4465", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "how good is the fuel usage for this vehicle"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-4518", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "340824d630a80b6c02c2ba4bf8125ad7f7cb14139eacf43f2095682ec709ae1f", "cursor-grok-4.6-xhigh": "62839e17ea8acf9a3e6f94f1b7176e0943da4e0d90c46d8bb9aa2365a6e46d1f", "gpt-5.6-luna-medium": "d4db6061232f1a171999243c912fdca11de44905d213f707b68cbcd9d79ff0c9"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-4518", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "when do i need to change the oil again"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-4707", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1880870ea663ebf3ef6ed164ff5b8b3aefeffcd220ead099d380a1d563f6b30b", "cursor-grok-4.6-xhigh": "a2ee63488ff2f827fcb95639cf472dbfa305969dda5e880e08836057bf17bbe0", "gpt-5.6-luna-medium": "a61928fa8941cbd2a9039cc2fa20c93519ca7940c787753aeaa6fecaf6afbfb5"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-4707", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "what sites are there to see when in evans"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-4834", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0fef6231cf10cb683cedca9c2c9cbe8675bbf30a6b4b4975d958b3ee34eac7b9", "cursor-grok-4.6-xhigh": "13acd6f1154ce06be993153ed5cbc3fbc62bf6573a0aef78ae077f8cd286e02b", "gpt-5.6-luna-medium": "5dc337c268885b1878b19bd294d827d525ba6cd7f520ced1fc35308521f91b74"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-4834", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "list my insurance benefits"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "followUpReminder", "family": "consensus_public", "followUpReminder": true, "fullAgreement": false, "id": "open-clinc150-5082", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "dd0c6d7a71000d68c04cde4517015c26cc97cc50c6cc11aa7f6a79cd83f350f1", "cursor-grok-4.6-xhigh": "1169534b26015a573a6682347e94a0f6851664d0231edff7b7fd16af8d36c4e1", "gpt-5.6-luna-medium": "59355919322a445597d61da14818efa93f71797b324d7b20b44c4f8d09ec68b1"}, "labelerVotes": {"followUpReminder": 2, "question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["followUpReminder"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-5082", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "did i set up a reminder to clean the bathroom"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-5463", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "663423f9f3df3b23d9737228f5706484ff227d08b38c11c40e0857f4cfdd91db", "cursor-grok-4.6-xhigh": "56508a0556c0d665165a28afc1b46969148893577c349b6c54653079d136dc4d", "gpt-5.6-luna-medium": "c4cc2c23c84474c1f2727032b8713e1b5646ab2bc7495751259cbbf6f66f647c"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-5463", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "what's my apr on the credit card i used for a purchase a week ago"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-5959", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "4c435bed42d19f540e3779f505e568ba9533209b627d37c70e67847d1ef9d621", "cursor-grok-4.6-xhigh": "17ac9ab8d61232ff852a03d59386f18b3287b8791d56958a4dfd69d5bdad8e68", "gpt-5.6-luna-medium": "c90bf1ad8fe1b86980297081841e366f60d684f29c377c6aad1d57a066f9ad84"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-5959", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "what is today"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-6065", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7eb4c90f52241bc8ade4fa93163c6ebec0237be92f3cee2e93fcf8c9049a4af5", "cursor-grok-4.6-xhigh": "b1489a7a26c8e111ad8d4b1d07f834092e4cd269977b0632aa0d21b349e8f57b", "gpt-5.6-luna-medium": "e1f945ca157de8e90862ea17629c15bf564d22b49c703db581c6dbe188be48fb"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-6065", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": true, "text": "can you look up the carry-on restrictions for delta"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "followUpReminder", "family": "consensus_public", "followUpReminder": true, "fullAgreement": false, "id": "open-clinc150-7302", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ce391ab1517782b5e263f8424f70e384ab2434f861c1860a1a6f8ef11297603e", "cursor-grok-4.6-xhigh": "2f7f4e1530534648fe716997a3d04f12505c6bf4efc03a1892de7e8a4d0058b5", "gpt-5.6-luna-medium": "d1b6d5cd5876e88ada142ef810eca5aa43b3d0712e647d9452c6734bd9415d3c"}, "labelerVotes": {"followUpReminder": 3, "question": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["task"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-7302", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": true, "text": "make sure my alarm is set for three thirty in the morning"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-7969", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6e243941717b8fe849a80873f05b5c55688bbb8535d7c376501a4c336c9898c5", "cursor-grok-4.6-xhigh": "1ca2d7ffefe2f7a31b08aa429c9eb7a268e631da019620762a9d067e63c5e245", "gpt-5.6-luna-medium": "de926aef70950529fdf374d9ec301eecbdb66c43a84b926327a688373b9dace0"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-7969", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "how to report bent credit card"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-clinc150-8619", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "687549af3f609ec1aadf1e37295ef06044428f8dc1c72d13e0ffe427514a1de4", "cursor-grok-4.6-xhigh": "e2c057f91882a9da33dcffbe92ffb562bdb82910eac07a637b76908a9348b5b3", "gpt-5.6-luna-medium": "ae3f50e00cf7b77e0451fa71e68ec5ba7c288919cd9fea3ba05d63a27522f4ed"}, "labelerVotes": {"followUpReminder": 1, "question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CLINC150 UCI", "sourceLabels": ["question"], "sourceLicense": "CC-BY-3.0", "sourceRecordID": "open-clinc150-8619", "sourceRevision": "UCI-570-2020-05-07", "sourceURL": "https://archive.ics.uci.edu/dataset/570/clinc150", "split": "silverTrain", "task": false, "text": "let me know when should i get my tires changed next"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-10586-8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e995dcf1fcb4df8bba8643c634a1ab5aa075cef76a2ab523385790695cafbb20", "cursor-grok-4.6-xhigh": "f37a60db8373c50bf4065a1fac7ed754020fb10ea3e2e1bb8cbfdbdbfb0e8236", "gpt-5.6-luna-medium": "c5ceedd48866435729489a8134f3df7baf9f5e9d4194f5d7422d5bac58654271"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-10586-8", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你能帮我在格林豪泰酒店北京市首都机场第二店附近找一家评分4.5分以上,游玩的时长是0.3小时 - 0.5小时的景点吗?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-10728-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a87f1d6fe54caa4e463b6596dd247aea2134f547239fff6ee184feb4f2b25a2f", "cursor-grok-4.6-xhigh": "989a91ceb7d5729e221ad0214ae36d59a2bf169d5920c9dbc366cf40fab7c405", "gpt-5.6-luna-medium": "321d99d22f97e8fc986966f3357f671fef7dcaa56677a99578c9882849ad765f"}, "labelerVotes": {"invitation": 1, "question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-10728-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "您好,我和同学想一起出去玩,帮我推荐一个票价是50-100元的、游玩的时长是0.5小时 - 1小时的景点,谢了。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-10871-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "480edd1c00efba40a29682152d3db3a1ee84332bb4507bbf89246d36e83999b0", "cursor-grok-4.6-xhigh": "a9cc7bb1435b8263f34ca953d574397ede138ed92e3c6fa5b1a31c47c93303ae", "gpt-5.6-luna-medium": "4d6253f99937158918505762c7d8c01b1f4bcfbc5a1b2a1cb93a6a26ce814eaa"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-10871-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我想找一家人均消费50-100元吃全家福这道菜,请给我推荐一家餐馆用餐吧。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11012-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "609237ad67c214ad61dc63667dcd3f04475df24a813961fb76053e4ba01ff604", "cursor-grok-4.6-xhigh": "5c2038be0061abfcf1054a462ef779deca265e3fabb578499244d1dd27ce0945", "gpt-5.6-luna-medium": "5c2038be0061abfcf1054a462ef779deca265e3fabb578499244d1dd27ce0945"}, "labelerVotes": {"question": 3, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11012-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我想去景点钟表馆(奉先殿),帮我查询下这个景点的评分,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11109-6", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c9e84bb494d6e0d271de034dea95fe3544bb2ebe39bfccf3fa3fbb2a16fa32a7", "cursor-grok-4.6-xhigh": "b8431405f72e7f1260da54f0bb5c072912a1c5b42b5965b1cd2d8635552c2cbe", "gpt-5.6-luna-medium": "da7856228f93149d0208ffd31b380ce82b9f0a0816c0cb16ee23ede7a8666ed6"}, "labelerVotes": {"confirmationDecision": 2, "followUpReminder": 1, "question": 3, "replyableMessage": 2, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11109-6", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "对啊,谢谢你的提醒,有这个景点的电话吗?不行我还可以给它打电话咨询。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11117-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1ab48f4c679cbdc99c3a907e1dd794470c290ca6119465ffe76f9ab05736f8e3", "cursor-grok-4.6-xhigh": "9fbf94dd9a206f1b898fb738e460a24d2ccaa478b8e0d14752fe473d0ab716ec", "gpt-5.6-luna-medium": "2a763897448a8f9a0eb78a969019afe37dbcb90890224a92b3f1f563d3a71262"}, "labelerVotes": {"confirmationDecision": 2, "question": 3, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11117-12", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "好的,多谢了。另外我还想找个能玩1小时的景点,你帮我看看哪里合适呢?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11374-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "bbbeb79781b99134282ff876d600ab06230aa6ceb2e5cbcc9708ef0025d4fda7", "cursor-grok-4.6-xhigh": "d6d0cccb21516f5cafaa71e95baf41dfdc5bb7565c0d82a2d0a5a68cab9fc2c0", "gpt-5.6-luna-medium": "e9c270633cb75f4f6fb311148aa7edb4abfbcacabf0c7a8fa84c49588c0e8d1d"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11374-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,请帮我推荐一个评分是4.5分以上,人均消费在50-100元的餐馆,谢谢!"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11677-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "3b9a0dbf2a599934e17a1a6bed2036374a687af67dd68b4bfd2897ac4989f981", "cursor-grok-4.6-xhigh": "a5262760e8e4bcceb03ae927d7d8e805ae6f36f263a8ec41747e5ab641c7c2c1", "gpt-5.6-luna-medium": "83ed80c0a9a9c722b394acd8143c7d8d071d83cfbc4dc5813d0ba42d6f0c4841"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11677-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我想去一个评分4.5分以上的,可以游玩时间0.5小时 - 1小时的景点游玩,给我推荐一个吧。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11686-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1045a2019d78ac00c7f9c500ddcd325a777ae5efe2f7d2192e2df5ee1da0cfda", "cursor-grok-4.6-xhigh": "2766aa39b656b23832474f20cdafd5b84a8fa7a0dbc7dce9e8b9f25fdf9ad9e5", "gpt-5.6-luna-medium": "b25fff2784d6e403f0eada549b96d24dc988c047e9350226dacf771b3e06808e"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11686-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,请给我推荐一家评分4.5分以上的餐馆吃南瓜粥这道菜。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11953-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "42737110d1e80869158284c8ce543b5455bb9f83f21f8385ebca116088be9352", "cursor-grok-4.6-xhigh": "731b429f2b76d752e1287a924274dc6925b224bded1219201022f9ac9b03010b", "gpt-5.6-luna-medium": "8bf5badce978e700732e89c8f192c53dfc74edd1ec387b43f4ba031197f9dd48"}, "labelerVotes": {"confirmationDecision": 1, "question": 2, "replyableMessage": 2, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11953-12", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "行,我明白了,最后给我们找个餐馆好好吃一顿吧,人均消费100-150元的就可以,实惠一点的,哈哈!"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-11959-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "83aae6860a0154b59f3e58ed38c4a45fc1d1f4e9bac1f08d81591bec5a4e8fb7", "cursor-grok-4.6-xhigh": "4c7410deeac77219e938d0a7fb2e31d92c29ec35780e1ec6e4958529de6905ae", "gpt-5.6-luna-medium": "5e8081501770068566e33db15973aa75d10ed7f71c61d5fa698bf36cfcaf690f"}, "labelerVotes": {"confirmationDecision": 1, "question": 3, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-11959-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我想入住一个经济型的酒店,还希望评分在4.5分以上,且酒店的最低价格是300-400元。你能给我推荐一个好的吗?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-12429-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "35e22890da684efdc2b4098d6c4e7b1c482d76acddcdf3e7f6e99922928e9cfa", "cursor-grok-4.6-xhigh": "c23f2aee1faeff2495c1abacb2fa84d38ccede7e45eac71220d3be92ecbd6350", "gpt-5.6-luna-medium": "07ed0ad47f4cb047105cfd0647dfaf24bb5d91f3a2de0d9ebdba47c9430760e4"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-12429-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我想带女朋友找一家评分5分人均消费100-150元餐馆吃小笼牛肉,请给我推荐一家餐馆用餐吧。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-1626-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7e4f370876396e02d1239da298e95ae1d444cd8e06d64a2c467878dd17726932", "cursor-grok-4.6-xhigh": "580f263037ac9fff163a16f38569b12ac083e4efceea03a76c1f11b8afcd7186", "gpt-5.6-luna-medium": "cf78a5fe81bddda1acd4e848c3170bd6bbd260d434e0ba90ad861dc59a301c15"}, "labelerVotes": {"invitation": 1, "question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-1626-12", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "真是麻烦您了。再帮我找一家评分是4.5分以上的酒店 吧。并且把酒店的电话和类型一起告诉我吧,谢谢!"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-3595-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "bb83ab1a078baed411d7560b906c7e1ae3d0f164edf91f5fa4d3e68f1fe384a4", "cursor-grok-4.6-xhigh": "104d09cdb903cb2aaca573ccfd9b05b5615775154c9c06dc0d06dace82140c24", "gpt-5.6-luna-medium": "735e3c5d244a0d105db3e2f4772efee49d983f6de8430f889f29dd2b8c6a221f"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-3595-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我要去中央民族大学民族博物馆这个景点游玩,请告诉我景点周边都有哪些酒店啊?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-4220-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "90880da918fcedb8c875a089a9a67dd506f437ffecf3ddc7c8cb831f2438f4b1", "cursor-grok-4.6-xhigh": "9e831bae61abab475eb136366dce5b03a46ee57022bcb45e4133e79654ec57c7", "gpt-5.6-luna-medium": "8f7cd1542f84a3736e03b3d5210fa3234db671f27f410f458abfdd9f3d032812"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-4220-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,请帮我推荐一个最低价格300-400元的酒店,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-5259-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b34e4b612e496d22c851fa5536c52b833798fd1fe8de978bca96ce06834265fb", "cursor-grok-4.6-xhigh": "4c4bb2d67fa39290b561a8951d4110f255bc0c12ed81c0793c5a6ee4d9c6bcf8", "gpt-5.6-luna-medium": "f171539403129e51f70a35054227ad485de1a0388c2c421042342990f422df0f"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-5259-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,麻烦帮我推荐一下评分在4.5分以上的酒店,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-5821-18", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "f65a1069c6ca6234a7386704cd0140723dba17f322493dab62a2c87d9d843573", "cursor-grok-4.6-xhigh": "9885b90fa4ade789e6174a165c58922fe1b187f335ad008cded8519145bcc8e8", "gpt-5.6-luna-medium": "912815d96d9fe64349d2528a6a1c429d39c1a0179f83688d837dd0b3f8fb2703"}, "labelerVotes": {"confirmationDecision": 1, "question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-5821-18", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "哦,那好吧,那你你帮我在古崖居风景区附近找一个评分4.5分以上,人均消费150-500元的餐馆行吗?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-7477-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1cac9df3360754af1108beac34dfa8f74840c4ab28573ff486ba268de814bac9", "cursor-grok-4.6-xhigh": "9dc38d805728d4146d78f9fa432e6c6cc434b780fc5d4ef7eeaff1ea721a881d", "gpt-5.6-luna-medium": "9a2cc16171b58ff2fa6f041c7a975ccb3ed873f217816a96349af39d85ab14ef"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-7477-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "您好,请帮我推荐一个评分是4分以上、游玩的时长是3小时的景点,谢谢!"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-7576-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c603d2a562c575adc4e7e8af1ad6e8f3f68e9528e06ab788dc7651d0d7340956", "cursor-grok-4.6-xhigh": "5c774da4a76b3b129e2c24a082fb9b0a343906d806d0d16a9a2476595aa075dc", "gpt-5.6-luna-medium": "6e5397997bb4c2b0c6756e80f533a3f6b044021e728377dfffcf097becdb0fb1"}, "labelerVotes": {"question": 1, "replyableMessage": 2, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-7576-10", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "嗯,最后您在给我找个免费景点游玩0.5小时 - 1小时。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-7593-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "0d244f8dcbf19a38423b73229eb2bf6b92c6eae4b3190a98659d98124a73bf77", "cursor-grok-4.6-xhigh": "8b15adb549508153e05b255fb8e3fc3ba8c9abb52d5335eb0fb75b06d4e9d5b9", "gpt-5.6-luna-medium": "3b030348375d18dd426564a71c81e89fb965bd1ba0949c32e202d404c559ec05"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-7593-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,请给我推荐一家评分4.5分以上最低价格在100-200元的高档型酒店住宿。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-8242-16", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2e3c855c97f1216437537f16ed548fd32b22d2dc4a4eb3c7c0c534fb4dd36465", "cursor-grok-4.6-xhigh": "94e963d9deaa5c83df3d24d0c738081c98f02af1232fa33a74141d709776c3d9", "gpt-5.6-luna-medium": "17b715390d5ddf30528fec46fc65f7bb15ccbdd95fe9906c25ba1025af24dfe0"}, "labelerVotes": {"confirmationDecision": 1, "question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-8242-16", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "太好了,那在这些酒店中找一家经济型的,评分是4.5分以上的,告诉我地址,我去安排一下,再看看周边有什么景点没?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-8593-14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "73de8c06eef37d1d4996d91505bab6636fea4a7a432f41536c8a942ac55da5a1", "cursor-grok-4.6-xhigh": "97874f57a857366db7ee30fe2078627cf236e61097d4650215ac9a1b72983bb2", "gpt-5.6-luna-medium": "435406ab6ae8739100feb5b856e8893f56ed70e1483d3523fe31e1c29c2fafe8"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-8593-14", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "非常感谢。那请问酒店电话是多少呢?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-8657-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "946287afb3677d6f428a445d0fe90d5b57a447cb731c3ad282c8ea73f519fab9", "cursor-grok-4.6-xhigh": "c502a069cbdc83922c9b8a058056d4c7e0686ad3af685e582d700da37f84a2b4", "gpt-5.6-luna-medium": "54d938059e4e5f53decddc081d607c20e23df75dd036eae0efa2631acc49f1d5"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-8657-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,帮我推荐一家有罗宋汤的餐馆,最好评分在4.5分以上的,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-9158-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7db4752fdf6ffaeb596bfad9626c75dc8dcdd4b65dc5da9e387c420202e240b3", "cursor-grok-4.6-xhigh": "29ac142be1ddd16527e19adae46fc186dd5b9f0c844839d93ec89f4287434398", "gpt-5.6-luna-medium": "110d0d84e50f08177b4587c743648e1b5756fc9c1ac233684700c83bb7fc77ba"}, "labelerVotes": {"question": 2, "replyableMessage": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-9158-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,帮我推荐一个能玩1、2个小时的景点,要没有门票费的,评分在4.5分以上的,谢谢。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-9404-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "cc55f362a523de07443c1b630674419de3fba4e349f74f9cc0d9cc306dcfde55", "cursor-grok-4.6-xhigh": "8175596bec106c4f52fe0a1d75d89d3ff446cc7a9402923f44a8838e8c1dd9c9", "gpt-5.6-luna-medium": "13ab06ae88f133ad2052b0f76c283dbed1cb65a709526efdee7cad49eaf18c91"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-9404-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,请给我推荐一家评分5分人均消费150-500元的餐馆吃豆面丸子汤这道菜。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-9587-8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "debdcd13003d6f6137d87c978591f673039b908c51a5f63bd73ef98b2e6714c5", "cursor-grok-4.6-xhigh": "c7a5e9306fa03474877c4c4d7dce0e0de57fc0512ecc6308262fe43eca8850fc", "gpt-5.6-luna-medium": "2644b2bcf254a3c7c3c71896fff32be9c3ba934b0b4beeb3711779ea7ca32ea5"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-9587-8", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "好,请您在北京语言大学的周边帮我找一个评分4.5分以上的高档型酒店住宿,顺便在查下它周边有什么餐馆。"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-9866-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4b27b1e9f4c51beab3dbaf66aeb3b67af7d843b54eb8c1ae49840821ca5823b3", "cursor-grok-4.6-xhigh": "e1c8e86dfdd5a723a54ecdba35a9604104cd9b0816efd8b756101472d49607f1", "gpt-5.6-luna-medium": "04cd18541f872e869544c0a8d7c42231fa88e515d2a5ab57346677602f2d24ff"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-9866-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我要去亚太花园酒店二层翡翠金阁中餐厅用餐,请告诉我这家餐馆的周边有哪些酒店啊?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-crosswoz-9886-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a0203e5e0c442cb1df0e11a518a1e1774f75b19b03449ab9e6886304f833d0c1", "cursor-grok-4.6-xhigh": "c3c332219d1e64111caa83b3dcc8b17f0a7814b052dd7b5eb8efe377337eff69", "gpt-5.6-luna-medium": "f2d9785a39088b360d528420c097482f61366f3c78321edb61fedcdf96e1a9b4"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "CrossWOZ", "sourceLabels": ["question", "task"], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-crosswoz-9886-0", "sourceRevision": "df82c9fdff91b9b130f2d6b89110d3870ba6260e", "sourceURL": "https://github.com/thu-coai/CrossWOZ/blob/df82c9fdff91b9b130f2d6b89110d3870ba6260e/data/crosswoz/train.json.zip", "split": "silverTrain", "task": true, "text": "你好,我想去排云殿这个景点游玩。这个景点的地址帮我查一下。"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": true, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-goemotions-edm2plp", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.84, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "11e0074ca1308dfdad27053919961ab21f9e7e19b80100f054173b5fae6289e1", "cursor-grok-4.6-xhigh": "53bf23a0a4b068add9800ef7b7f68bb7a202da8771811adfbc2920a8d4c3bd93", "gpt-5.6-luna-medium": "b1dce5b0a0a932c2ff2d020dea97ed444c2689a849bab7aa8f9edb03b2e39027"}, "labelerVotes": {"blessing": 3, "replyableMessage": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": true, "replyableMessage": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-edm2plp", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L38838", "split": "silverTrain", "task": false, "text": "I hope you like it-"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-goemotions-edqmahz", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "579b0e153532dea122b70e6de2fe1edc9c5e9fb52f6467d0bfa4faa73576a8fd", "cursor-grok-4.6-xhigh": "579b0e153532dea122b70e6de2fe1edc9c5e9fb52f6467d0bfa4faa73576a8fd", "gpt-5.6-luna-medium": "99bfd299f4cefb1515910b50444776c2dbb16d7fca5169e5973c254aa988197d"}, "labelerVotes": {"question": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-edqmahz", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L42967", "split": "silverTrain", "task": false, "text": "Why was nobody driving the damn thing? They were all in the backseat. :/"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": true, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-goemotions-ee75sip", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.85, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1884108d46f4aacd57642f04703d02d07e675421040e24b7ba231b11b4751863", "cursor-grok-4.6-xhigh": "ab5b03d924d99f3d1698f66eee619a3d7789826ee053e1b57e4130b2b4f0ec72", "gpt-5.6-luna-medium": "098111bd77ff83eabf7e1e466be16334760b415fa69d6fb8686c5873e22fd8db"}, "labelerVotes": {"blessing": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-ee75sip", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L22896", "split": "silverTrain", "task": false, "text": "Yayyy!!! Go little green bean go!!! Good job trainer!!"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-goemotions-eelizvv", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "fb93294baad5c983e498b48ef52fd46d8f9129e6f68474d8f408fe016dcd6c9a", "cursor-grok-4.6-xhigh": "fb93294baad5c983e498b48ef52fd46d8f9129e6f68474d8f408fe016dcd6c9a", "gpt-5.6-luna-medium": "6cf5ac032d340ae0ce4021db6ff6b60fa20098a9b1bfb58a7c7b033896815cef"}, "labelerVotes": {"replyableMessage": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": true, "replyableMessage": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-eelizvv", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L7322", "split": "silverTrain", "task": false, "text": "Yea the conversation went as expected and now I'm looking for a new job. Thanks to all for the help"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-goemotions-efdl4z2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.87, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e48922f19ee2639f905990c52448282fe80b480bd126bc6a4fd2b0dc7305838c", "cursor-grok-4.6-xhigh": "5f0c01e24bcb2999173dc776fa88b51352261f5d2647ad611a2963b6540e7bc9", "gpt-5.6-luna-medium": "bf8f7b6cb5577853a10dfffbaeceaa1f1a49838910582aaf67ed5bfc4eef334d"}, "labelerVotes": {"replyableMessage": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": true, "replyableMessage": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-efdl4z2", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L33172", "split": "silverTrain", "task": false, "text": "Thanks now I’m insecure again"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-goemotions-efect26", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.87, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "09a383757cbb24380ac6f1365b5506ef5912e088eddad8280458c74b90278bf5", "cursor-grok-4.6-xhigh": "d7ba38f101b5a3d4461cbcb5614a24c40506ba07ce245af450f006872186cd92", "gpt-5.6-luna-medium": "8c8f12becdc740af9ce1667131d865bbd4ad42570d89b0fe02a837148d677919"}, "labelerVotes": {"question": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-efect26", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L28853", "split": "silverTrain", "task": false, "text": "Sorry to link it here but would love to get some opinions on this post"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-goemotions-efg2bx0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.87, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "04b2f880d43b490f0b467f013a96cce4da4a1bc50c0b0f313adba1dec5aca855", "cursor-grok-4.6-xhigh": "a3dd8c7dcb5ec503869321c2726dd29d649fde490f501b735b2eb10c69fdcf8e", "gpt-5.6-luna-medium": "203c7e5444117c4d504c0118cbe133bd91c84a8c853a5afcdb063c6122bde95c"}, "labelerVotes": {"blessing": 1, "replyableMessage": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": true, "replyableMessage": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Research GoEmotions", "sourceLabels": [], "sourceLicense": "Apache-2.0", "sourceRecordID": "open-goemotions-efg2bx0", "sourceRevision": "5d8f4ac97c873bde3a792ba4628f00bb9103d3e6", "sourceURL": "https://github.com/google-research/google-research/blob/5d8f4ac97c873bde3a792ba4628f00bb9103d3e6/goemotions/data/train.tsv#L5356", "split": "silverTrain", "task": false, "text": "Im so sorry"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-10112", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c7b57a3faf590bfe6d39e728030b9e446e16f57de7b5ba9c845ae59e0de8b00b", "cursor-grok-4.6-xhigh": "b357253b141dc848a504bf28a0b65796cba30f9e1d644437aa7efde22b9dd180", "gpt-5.6-luna-medium": "e8738af70bd9f6b33705a433fe10ab2d52c35e5c1595e7f9da3142ea5193fcc4"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-10112", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "how do you cook a good burger"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-10643", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "451bdef06fd3ff72663cab91435dd2419ac7bdeec06560c09c0af44749459700", "cursor-grok-4.6-xhigh": "64dcca4c87fd0f33c7d2e3b7493c96eb4335198cfbf65c4c79ee56647b8ef5b2", "gpt-5.6-luna-medium": "d192c756b17c4cb61952c12d81e23a2b4b393e88ec3898d59677dfbe79681ba2"}, "labelerVotes": {"question": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-10643", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "lose the last item in the list"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-10663", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "70f483094043c9195bf289be09f5a382050f6c713dee6b90f5170299f3109044", "cursor-grok-4.6-xhigh": "0b4f39bb669b31814fa2a3abeee64fbcdb957b1cb0864ec7904b3c9980be9207", "gpt-5.6-luna-medium": "c995ef1f81820f08ba24818bf25138326ec680ca5d00943041ca6e9cd96c99b0"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-10663", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what are my engagements today"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-10874", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "72ef4df4e94c41116ea3bbdf1956c15f3060686426b85f50b22e5e1d57743e90", "cursor-grok-4.6-xhigh": "8dc7d473d7286d3ab8e385235fb9b255b94b6fef630e1c7019ddf5e8809d0617", "gpt-5.6-luna-medium": "425fe15b7c064ea0effb512e842d24c1feb63188eeaf6fa7238207521b42f5d5"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-10874", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "can you remove my to do list"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-11059", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "8b370dbaece3df5d63c4b7df8e0162e02caca77ce84239a3d430f9d8fb870924", "cursor-grok-4.6-xhigh": "05cb935c67fa9a6dabf4edb232c0ab45d79ce50a5dcc86ec53801abace630ecc", "gpt-5.6-luna-medium": "6385fb288eacfd0d758da13a886d557c82bfa9cb67da4254b90ae2fc7891c2c8"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-11059", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "name the lists available"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-11228", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7b6761a45de0f16e1d09946f5d81716932c5674f0b74664fa1468869072bb325", "cursor-grok-4.6-xhigh": "39d01d3d8da2c654f8bd305e25f8660deddaeb16f95e1dd437067598c764e7fb", "gpt-5.6-luna-medium": "f40ac0c83156a3698b7d06037fb6249b526c2686380c8a02a5179c4cce20d441"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-11228", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what is planned today"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-11637", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "40df25ba01f682121d933ad2e0e57e919e0f8b276d29d6674a0723a809a530f3", "cursor-grok-4.6-xhigh": "1418224246bdcaac543b0e4c3604f3c359b4a04d0e34ec4ab9fdd58d15785e99", "gpt-5.6-luna-medium": "f64b71210c7962de4d625be577ff9deb7d2ecb98a5ba2e37606e09b6d9d0e015"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-11637", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "tell me the movie with best i. m. d. b. ratings going on in theaters near me"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-12474", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9cd9fe911ee83e194157fec193dc45b47c5842f3c3092b0c52d24737b6a9e4cb", "cursor-grok-4.6-xhigh": "5e219b3abec2ae4e612d5624bd7b79a5d48c5f5ca2043aadd2aa2edd4706157f", "gpt-5.6-luna-medium": "7caa7d0b8e6934fb9a5276e402f49e328eb3ee1e59e6b28a34a4ccaafc1f5aae"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-12474", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "where is the closest sweet frog"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-1348", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.97, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "22aed8b30a0ad79dc229e90bad26070c0136718dca9b3a7a302e55edbfc7ebfc", "cursor-grok-4.6-xhigh": "f7b849562d5fbaa1d7a21201506821ea60917ce16047b536f630dad7cb730324", "gpt-5.6-luna-medium": "3554207b721828a2edef24fadee7b24cb0895770b50ca26acc8130dcfbc21f15"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-1348", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "can you tell me the current time"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-13889", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c45e8d5859497f448005befe7c3e7c628e125990b44a3f594cf15a8f8beb6ae9", "cursor-grok-4.6-xhigh": "3214848b1ea3cc3bfaefd1cc878a217513c3e13b79a43513ea6b04d547d12401", "gpt-5.6-luna-medium": "c45e8d5859497f448005befe7c3e7c628e125990b44a3f594cf15a8f8beb6ae9"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-13889", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what is the capital of washington"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-13920", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9dcda9b9f224715b5ec87f72daa2b38fc512e58fdfd259a34244f158ef533532", "cursor-grok-4.6-xhigh": "4c708b860d3548d087b113e5cc94116d09adc0fddced3595f468201e624a6c30", "gpt-5.6-luna-medium": "f255317fa215c0df74e6dfe8346fff9b061b896c8ce8d1faf4530bbfcddb9272"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-13920", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what is an orange like"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-14209", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a51c9db5675e9b00fd5b5ad74b87e6693fe8eda5b7f4de030699ae6a05fc1518", "cursor-grok-4.6-xhigh": "c23435479c8758b5cc4d6af13ef8ac92cf375fe966467cee834fccc4bf2b7978", "gpt-5.6-luna-medium": "0bba4fc0929f565d08c6365033da21e427b4e042615d6a2703b8500970c2ecda"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-14209", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "how old was elvis when he died"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-16203", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a2373c61558a3b7a20222a4713600f05518292e3f450bdc4db86e2d41143d17d", "cursor-grok-4.6-xhigh": "1feb4ec419946ba7c44cf770d4cc5ac9cf9d2370c786c62c3770fe18625f8fed", "gpt-5.6-luna-medium": "7834c2f8bf24773539a6e3717c7aadad7e2c54deb9736242864dd683752f5e79"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-16203", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "do i have any new inbox message"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-en-US-16640", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "dc88e17e14b8c609a7b2f2be96191d0d7462995fe3f51d2c606db765b08295b4", "cursor-grok-4.6-xhigh": "02fad81277be9eb77bc97a4d85da3e69746ea20fd92a6409df230a5ce3594dc0", "gpt-5.6-luna-medium": "dc88e17e14b8c609a7b2f2be96191d0d7462995fe3f51d2c606db765b08295b4"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-16640", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "email joe and tell him to hurry"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-1727", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1ab9393d0929d9396a0b47dcf064578ff60e16d0818f050ae4db70e437ee8c79", "cursor-grok-4.6-xhigh": "530134150be6b5748325bf4b899bcb38da294ea1336a694b8b51c062f71610af", "gpt-5.6-luna-medium": "998bc6f2cd0572c86bc2924cf709da76980d41f32d67d16c7de02cb8ed3372b0"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-1727", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "please could you tell me if george's geek restaurant can i order takeaway from there"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-213", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "614b70e099b6844cb256451bb0358e2e7ebdf125aae489b18b2d8f9d4a837520", "cursor-grok-4.6-xhigh": "c56cece1812b43b5a1784e4e10add9b54d4a5a0dec8372ff449fcecdcc6f99ce", "gpt-5.6-luna-medium": "614b70e099b6844cb256451bb0358e2e7ebdf125aae489b18b2d8f9d4a837520"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-213", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what's date today"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-2130", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "163145ef0e2482563d57bed872f8157f7c04f7918dfc363c18bfc952184f579f", "cursor-grok-4.6-xhigh": "317977174ea04c8ded93a5e6efafc74ca170589f5fcf4e659e9869d4cfedff9e", "gpt-5.6-luna-medium": "6ca8e110a7359448f515a9bd4f063d832bbf34e8eb26c3716f30fb7b0225a745"}, "labelerVotes": {"replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-2130", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "a little brighter thanks"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-en-US-2732", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6ba9e685d6875625861868b945fcc4bec753ca857b81894e8c2fab656dff37bb", "cursor-grok-4.6-xhigh": "6ba9e685d6875625861868b945fcc4bec753ca857b81894e8c2fab656dff37bb", "gpt-5.6-luna-medium": "1144644feac64400f345a0288fca861bff89e30df920c0fe327cd2f51dcd3789"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-2732", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "please start me some coffee"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-en-US-2837", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "db5d2d4d2a4663b3f9e2c3a992fd37edea90adebb201e630b6b9038eff56d998", "cursor-grok-4.6-xhigh": "db5d2d4d2a4663b3f9e2c3a992fd37edea90adebb201e630b6b9038eff56d998", "gpt-5.6-luna-medium": "3d41afe44d01e68ceab4a539d41c9436bfb512acf98ee8fdcff7568871f53c62"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-2837", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "change up the light colors at home"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "followUpReminder", "family": "consensus_public", "followUpReminder": true, "fullAgreement": true, "id": "open-massive-en-US-3765", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "16a9c3103034358884f85e16fe5acfdc0a1ab6ea46a627dc212b306efe145974", "cursor-grok-4.6-xhigh": "150a9ed17842758707b18d9c505da0a85d11a6872ed73496d45abad3db04125f", "gpt-5.6-luna-medium": "f1bae8d625b967dbfd58de754284b9bda9b47b7489eee175245b386210233058"}, "labelerVotes": {"followUpReminder": 3, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["followUpReminder"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-3765", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "please set an alarm for me"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "followUpReminder", "family": "consensus_public", "followUpReminder": true, "fullAgreement": true, "id": "open-massive-en-US-417", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e666aee75ab863f4c268640af5d350cc819c4ceada4e4d3be012cae82ed38198", "cursor-grok-4.6-xhigh": "7777a6f92b4cba23dee7d74c2259386fe5b08ea62c8de3363020b871380f6634", "gpt-5.6-luna-medium": "18dc5b01467d5b3784c1dcff3ba506340b404455fd254297aef2bee626a65927"}, "labelerVotes": {"followUpReminder": 3, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["followUpReminder"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-417", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "make an alarm for four p. m."}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-4610", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7b2d7448ed3504834381656831d4ceb051fbfb655e520fd547f0108a52639be5", "cursor-grok-4.6-xhigh": "a501759c8a39054996de58e865204820bd3b52efdc64768c44b0691b2bf16f4c", "gpt-5.6-luna-medium": "c137ce4cd6f2ba354583f9e5e37119db95960db527838d5f28b1cca3a5f94d2b"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-4610", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what time is it in the central time zone"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-en-US-5420", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a620d75b718c51f2eca34bd4cf45a3d86a812c541d90a389c2cbc241c4f80c95", "cursor-grok-4.6-xhigh": "df601b58ea6797f4386d29ae3dd86345865701ed0de41a2c33a007c604a4f5a1", "gpt-5.6-luna-medium": "fa492eb3f1fdeb858794fe816662c1adcec8720a2d587c80061c52302140d45d"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-5420", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "please turn on wemo socket"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-en-US-5470", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "67fd2846141d23d82c3f2afa1cc747ee5180ad7823fd24a53580db409abe2355", "cursor-grok-4.6-xhigh": "6d7fe0a2fc1ff040c29781db687812fd71870650ce65fad67bc7385d115a3c2d", "gpt-5.6-luna-medium": "67fd2846141d23d82c3f2afa1cc747ee5180ad7823fd24a53580db409abe2355"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-5470", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "alexa please turn on the lights"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-5745", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d7ee610b7d28658526b321e3f119a8850f2c7c16d682eecd6c87a7b35f650b04", "cursor-grok-4.6-xhigh": "bbd4032c144ad8f66cd3dcf33440f81d267b0767b40e7a88ae346b68789a677c", "gpt-5.6-luna-medium": "a1a5542a48e73312e0bc348b8c8038555d549a4f64ac477019d89cea4d19189c"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-5745", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "show me what day the thirty first is on"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-5975", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b0c3c8352b8d232f32a852d2032cbcf2794a111825e94d92f7d3b0f9e8f65a73", "cursor-grok-4.6-xhigh": "970a4427597aea134549b9c057af0713de60ae203ebe1f9e2557c84cc126e9db", "gpt-5.6-luna-medium": "e405b39b8ce6fabc50473852ce04e2f91400c1aee54c3acc56b009dea0acc182"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-5975", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "could you tell me what today's date is"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-7478", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "5aa0fe1f20044aecfa46dd64651255e3d92175c21b665f964230b902b6026455", "cursor-grok-4.6-xhigh": "89a49f1ab3a852dbf4359b1d25ac5f6168be273243702c0ba185e9d9a4d1f513", "gpt-5.6-luna-medium": "ff337b086e27504b394be3c9b2fec44a694ea4fe8c21f6e092fffec80459e440"}, "labelerVotes": {"followUpReminder": 1, "question": 3, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-7478", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "tell me all the pending reminders"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-8200", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "88f51fe9d3aa0aada8c6f7b43542c9b2a1bcdb1fae2deccbe88a4cd78a9e3af3", "cursor-grok-4.6-xhigh": "4f4268365754f8cccee461ab6bc91f0b588f9a992e8f388ad123b3a460ccafd7", "gpt-5.6-luna-medium": "cac695aa12dde7d17ed02d16e5a9e40787f755be313e3fb63ccad402d80defdd"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-8200", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what is on my schedule for today"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-8610", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ad5a00bef371b6299960e43af91d52c7f597656d7c4501683ebf5148a2e2ad05", "cursor-grok-4.6-xhigh": "b377ab3b1c2afa1d0065444a6e8d5b2bca2596e47035da1977376c5482faef61", "gpt-5.6-luna-medium": "cfdae24a64bd2ffa5afc5d3974be483fd3fcd050d31c36d06b5235298411bfea"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-8610", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "where the party will take start"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-8616", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.8, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "33b7d807e8eb9b1d43faff158110ec3fb4919c63ac033f363a3f6142eee206ed", "cursor-grok-4.6-xhigh": "a11482b517d2ff515b7a8fd397d075683cb3b1e0e68cbea5fd6dffb1f1bfd62e", "gpt-5.6-luna-medium": "002e8d1a42123855a096b8d9f29ee2371f3c365237404d1a74dc6f197fbb068c"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-8616", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "enter event for mondays only"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-8738", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b3d681e8d6446f9679ae433680a5b194116ac27b89392a7f7104705a526c95aa", "cursor-grok-4.6-xhigh": "3afa243c5c682ee87f5fb85b5bb3ae82a22cd8f7fb257422d9b6a6a965141c53", "gpt-5.6-luna-medium": "90d6570c20147ff9dd6058205cc8514250ca3dc71cf97416df1007a68f699a2f"}, "labelerVotes": {"task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-8738", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "remove the event off the calendar"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-910", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "99d5c8e93522eb045836bbdad8767a389c284e2f8af8fbe5c2aae6fd48015943", "cursor-grok-4.6-xhigh": "00eddf39566fa4671b3e6df762b6e1e72e88fb1589eafbbc2e4516bbbfc259a5", "gpt-5.6-luna-medium": "4c86fb286b7b8eaf1cc03f0ab530ae489b4ecc117ea851af8376a12acee51e95"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-910", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "what time is it right now in new york"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-en-US-9960", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ee30c72ecb246d7eabe6b995e3ac678d61021ea1365ce49a93c3ace5ab959010", "cursor-grok-4.6-xhigh": "f7d3d23e63ab688328a2ad859ff2cd05b8b3b7a8497e10f265f99c08e63f9eb1", "gpt-5.6-luna-medium": "c4e9460f6d5cd60158283b77db9f7c0a828f094065e8a9d022f962b829603061"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-en-US-9960", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "how do i steam rice"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-10782", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "a64c797f2772500b7af7556f23b7e90c1c40cfc10b30b08068425ab8b7512daa", "cursor-grok-4.6-xhigh": "387978a1af01808a330669376be4ba136b1e386e744b64bd55c2eec86cb090cc", "gpt-5.6-luna-medium": "24f27403f2d0ed514a9b20b61fd97b9eb36fc75750ca32a62253069f80c529d7"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-10782", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "我有什么任务"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-11651", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "53e107611b60ca28ca3a58b528968ecb885c0615e3a9c743605e2e7d9d28d833", "cursor-grok-4.6-xhigh": "178b37c0d2467295ce1e62633f9a9fa0a0d40c7f366cea709ea56d25461f3a4b", "gpt-5.6-luna-medium": "1cb6916de51bcb987bb8bc498b1a7a0ab2d0073cc524494058b0f1e7e0863e25"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-11651", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "让我看看周围有什么"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-12151", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "52e3dc6f2df1748394d7278049f42f41ccfceafea5298e5ee3c9a2a454f754ba", "cursor-grok-4.6-xhigh": "5ac75232ba29c494dcfdb0335d41c16b8cb149387b911d1e814d34ebd1e9b46c", "gpt-5.6-luna-medium": "7b6e3e2a5deed83963b20797953477d1351f7997950c36b4c576b173131a8ddd"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-12151", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "帮我订张这周末去北京的中国高铁火车票"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-12228", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "b3b0cc680c3e62094b8ebb25cafc578ecba692622e4d7ded37dc8f73c1c5f08f", "cursor-grok-4.6-xhigh": "b212b3ad8d1e42cb560820e219cda51128b4ed366e62ac390e273b1f753538bf", "gpt-5.6-luna-medium": "54490d9bbb301b8da5facb7ba2fd2985c81addfda6e0f2dae116068cd98d6641"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-12228", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "我现在需要辆出租车"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-12396", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "5b4ed48732674c2065d3199c8bf0c148275d3dae0a3c04d7e2b5798819c87c3c", "cursor-grok-4.6-xhigh": "77c8fd30fa0fb9861a32b4c7439d32eab728fddc3671f524fcfc1eb65f4c2013", "gpt-5.6-luna-medium": "09df31c1f12745d17a3688bcce969a1271d0fc7f79a83a21ba9effbfc3d2399f"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-12396", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "订一张去利兹市的火车票"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-12922", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "40a6b8701b11416d5328a9c98ac3bcceea6dc528b806cd79226bb82a5edec024", "cursor-grok-4.6-xhigh": "0b455aa5003c2c9668aa291bbe349fd1dd56b707e2e3e0794adb4b1fe5d8bfea", "gpt-5.6-luna-medium": "eabd4caf7e3edc68c1f54891610306878f869350258d74101503e31035e48691"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-12922", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "我什么时候能赶上最近的火车"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-1514", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.7}, "labelerResponseHashes": {"composer-2.5-fast": "f6ade08cdf2ed198151440544294625cd94950b9e4443dfacac1fcf0df8af0ef", "cursor-grok-4.6-xhigh": "47dda43f5c59620abe42ad7ddb0240e74a9081fa1e5d453863581d9237766365", "gpt-5.6-luna-medium": "60d79c0c681f98d07322eab34f09ee82786c94ce38beb94dfdb89c90606adf9d"}, "labelerVotes": {"question": 2, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-1514", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "今晚是不是下雨来着"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-15232", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "253b160f222ac2dbcfd056036d55241fff3070580dd855a30b96f0e72a718516", "cursor-grok-4.6-xhigh": "253b160f222ac2dbcfd056036d55241fff3070580dd855a30b96f0e72a718516", "gpt-5.6-luna-medium": "0b72a27bd3f5bb8b679125c92de65cf50c4743ca2fe613040f77021351bc0ca3"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-15232", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "将张三的歌发布到我的微博账户上"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-15526", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.88, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "8959f7166aaf7131ccb16fd79c5db4e5f5593b655fcd500ef81f79e43e4a3f55", "cursor-grok-4.6-xhigh": "0aba6222120792d0cd086f4021420bcfb9eb6203c1935b74f28f15d67024802d", "gpt-5.6-luna-medium": "d2b3b8f3713c3b49131b06f3d0bde71316027ccc92ea97b3bd90e88e896c5dad"}, "labelerVotes": {"complaint": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 1, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-15526", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "用微博发给大润发客服投诉"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-1609", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "875074fa77dc4b8a9f0955db352c3b0d00edcd7fb272d4cac5da8796dadc700d", "cursor-grok-4.6-xhigh": "a3ebd1b176514886cd0ba0ccfa24751fcf861a9560c3ba0d0df2162e20ce1782", "gpt-5.6-luna-medium": "e4375703a6a112596d66742e1b3634833f276ff67ddaf42d3189de7952ba1d99"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-1609", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "请开始煮咖啡"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-massive-zh-CN-16200", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1d748509fbb89f1cfc0441d7a84cf44c8ee720a0dfa5bb543ca50e75449fb779", "cursor-grok-4.6-xhigh": "1d748509fbb89f1cfc0441d7a84cf44c8ee720a0dfa5bb543ca50e75449fb779", "gpt-5.6-luna-medium": "1d748509fbb89f1cfc0441d7a84cf44c8ee720a0dfa5bb543ca50e75449fb779"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-16200", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "请给拉里的新邮箱地址 larrylarry at gmail dot com 发封电子邮件"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-16986", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "cf21fa618a75f8eed1dfecf314ce4743ff7d40ed2de1c2f91c4c0ea111fbebe0", "cursor-grok-4.6-xhigh": "8a07ab00d6c0bad020e3b293827534b61c053a2ca308d26a62a4acd0e1e3ff9a", "gpt-5.6-luna-medium": "49a5931c144448114d1594a57abc64c37993d428714d962bca58325486eff573"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-16986", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "你能查看我是否收到来自家明的电子邮件"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-241", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "7df36d51811b5a8f650b0e4422144985c8e11729e5abe2fe5c745ae1c47e548b", "cursor-grok-4.6-xhigh": "1c1bb26dd6acd03f2ddbe437492306a160ded4f17c1c0e156c22915ba3441761", "gpt-5.6-luna-medium": "6cdc3f6fa652626a0ea030f3ec53f2659ad6c437d305980d5c79f3df9b0d7eb9"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-241", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "外面怎么样"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-5980", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "b0d194d0a41b67b8f53e5adacd67650939fbba7124b5e3c86af9e9c099c7794f", "cursor-grok-4.6-xhigh": "449df665e42cabf9855d449294a69cc332e5240dc1263e376828cb0efd6ecf70", "gpt-5.6-luna-medium": "6ef05db01978c5fd959a920771e62d5f1afc1e4f477f679464c01b935fc77764"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "scheduleNegotiation": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-5980", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "现在澳大利亚几点"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-6418", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "bbf19e8756d3fccab36f1f40518eae49581f8177d6b88c36aa50b8a5b1886653", "cursor-grok-4.6-xhigh": "51d3b4972cc10608e96f1af9de4b400a328340bf088a1ac6f92d1902ebc5574a", "gpt-5.6-luna-medium": "c102b84e3fcf8c1eee284faeafbd346ab5e0cbf217804d633131738a1fc3cdb1"}, "labelerVotes": {"task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-6418", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "打开备忘录记录我的会议"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "followUpReminder", "family": "consensus_public", "followUpReminder": true, "fullAgreement": false, "id": "open-massive-zh-CN-6804", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "f39b1739fe4b40e245088380df62a757adbd83ff7f3451450afac2393515f37c", "cursor-grok-4.6-xhigh": "d0ced9a2d5b409925dff27f4980d45c561f12a89389b8df3db4c0f87d6764ab0", "gpt-5.6-luna-medium": "5f972e2a4db71af20ef2886015c26b588af38d6997e194f423e1ed3b66a6154f"}, "labelerVotes": {"followUpReminder": 3, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-6804", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "每天提醒我要在凌晨一点前睡觉"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-709", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "9961b1e8588bf8ff641fd1d95e41ca6e487205da4c5aed4172afddec87b189fe", "cursor-grok-4.6-xhigh": "8ff810b95657309c15fe8379331c51fe028d615522a56a5ce64b1f40be4c3fd0", "gpt-5.6-luna-medium": "c407588653fd423d4fd1f3dab0f54a3e8870934bf13cb9f29ab33a20f59ef73d"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-709", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "给我看选举投票的最新消息"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "followUpReminder", "family": "consensus_public", "followUpReminder": true, "fullAgreement": false, "id": "open-massive-zh-CN-7172", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "83e6d4030a98eb8cedca71f49c57fd4055e2aa87aa05ce82b82dfb6b696c7b8b", "cursor-grok-4.6-xhigh": "aaddcdb540636646c20ed2a4e19f958aec65994d8b0ed87d98e96194b9d15631", "gpt-5.6-luna-medium": "c0aa41e817c9ec43fb087c57cdcb3eb86f56d833baec425e3402d011a115ed8c"}, "labelerVotes": {"followUpReminder": 3, "question": 2, "replyableMessage": 1, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-7172", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "李雷想周日十一点会面你能在每周周六晚上提醒我吗"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-7466", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "fe28ba73648b3ef40c959e819e6b0f4a42b818f7c459d7b85b071ffb6886a6da", "cursor-grok-4.6-xhigh": "8ed0b38e7539a370589415556f85907f59976e211b85c490d02f55f6240a7c8a", "gpt-5.6-luna-medium": "ad5b3b9340f19dc0bc789c6390c18c43d0f8d732b244092c030cec75abac7661"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 2}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-7466", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "告诉我现在正在发生的事件"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-7874", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "e5878b27c4373e5779116065cd614d1f7194e89088185a82ada37edd0308bfae", "cursor-grok-4.6-xhigh": "54cbf182f08ab06fd3dc08a07de8612984f16b301894e0c84bdacc3faa9f916b", "gpt-5.6-luna-medium": "d6691c3a7c7a93e4f34822056932d875aa211a4d667864e139bc8397cf55d45e"}, "labelerVotes": {"replyableMessage": 1, "scheduleNegotiation": 2, "task": 3}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-7874", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": true, "text": "从现在开始的三天我需要和李强安排一个活动"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-8092", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "8baa62047c2a0494c851c138dcfc80dccc669a03faf52ae9ebed48058c441c58", "cursor-grok-4.6-xhigh": "5c5b969358bb9dbd3455b91272c863cfb1332b563f67ad4ec407d031e3cf23ca", "gpt-5.6-luna-medium": "409b445bba1c3f2a11f53134f33464d2135afd8881257aaea82599b42f130459"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-8092", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "周日白天我有空吗"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-massive-zh-CN-8228", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.72}, "labelerResponseHashes": {"composer-2.5-fast": "501b32bdd945dff4641608fa00b9a15e35551981d74374d30ea0c7ecfc2f4990", "cursor-grok-4.6-xhigh": "b00d8175b37600d0f32010792c77df3cd2b92f110b47b25982aa4fce253fb25c", "gpt-5.6-luna-medium": "aeb9a994539cf6700e806b447758f8c66cd11d323186f55ad08e049ddbe5a647"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 1}, "language": "zh-Hans", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN", "sourceLabels": ["question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-massive-zh-CN-8228", "sourceRevision": "1.1", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive", "split": "silverTrain", "task": false, "text": "我的星期五什么时候开会"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>42d376c2-ebd6-4c9f-8ad0-0859e3d93c60<TURN>6", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "773a7661d2b500bdab4332d0749a3c1fc08919c4d31d75b6e953ec48b966b082", "cursor-grok-4.6-xhigh": "442b437ffee2476c909cdc91222a4c059c04b2d5105bc47bb8d97793a205b75b", "gpt-5.6-luna-medium": "b001b16b032185f887785ce458e178ef9254c8638ddfa846ad568dea02afac11"}, "labelerVotes": {"confirmationDecision": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["confirmationDecision", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>42d376c2-ebd6-4c9f-8ad0-0859e3d93c60<TURN>6", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L542", "split": "silverTrain", "task": true, "text": "wow thats wonderful please gohead and confirm it"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>635cf5fe-c9c5-408c-9652-cff6470ff96e<TURN>1", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b8efa48670aa565346f74e2f9fd5cbdc389eac93b181a549ff4f4a9e4c43ac25", "cursor-grok-4.6-xhigh": "58371161e1b7bbc2f9176a8d4c23244901e442bd5177e8370a349c54bd454540", "gpt-5.6-luna-medium": "9bfe7b08e301552ec6f501302a595a34658125a7ff6875c2d846ab6099fb5fa5"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>635cf5fe-c9c5-408c-9652-cff6470ff96e<TURN>1", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L10103", "split": "silverTrain", "task": true, "text": "can you please tell me what my seat number is my confirmation number is hhd 542"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>7d7eb5fb-daf9-4b77-b00f-336a17ad05ef<TURN>14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.85, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6819faa0c6cc7962f08bd6001fc24a2309953e08dfe03259f80e95ef92ff570e", "cursor-grok-4.6-xhigh": "cbc1981454b49156238a319969d62aeea99bdad19f42b7a9e5da69dcf9d23ce1", "gpt-5.6-luna-medium": "0b2130fbbb06755b833cf716b53876dec16d3fc0dbd79ab74194c69c638f4633"}, "labelerVotes": {"blessing": 1, "confirmationDecision": 1, "replyableMessage": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": true, "replyableMessage": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>7d7eb5fb-daf9-4b77-b00f-336a17ad05ef<TURN>14", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L10945", "split": "silverTrain", "task": false, "text": "have a perfect day good bye"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>96c056ed-0abb-403d-ada5-b81067d9f0e1<TURN>1", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2432efc15936656eb41342f9f38fb7872827c4b1585ab7e027e7ee549dc6bbe5", "cursor-grok-4.6-xhigh": "c745387d223a89297ddb717c0d5889cdb411a14a0154d174181b804e41193d8b", "gpt-5.6-luna-medium": "6d975f6bbc358582c6c435688c03ef017b28af0d18054c063defd853c498412e"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>96c056ed-0abb-403d-ada5-b81067d9f0e1<TURN>1", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L13077", "split": "silverTrain", "task": true, "text": "tell me my seat number"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>cf339b58-1802-4ae6-9428-b5f1b726145b<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "3d02b648a99db70ea5c5a848cab5e80828dc2f4963860ec6d21c5eee7bb8f07d", "cursor-grok-4.6-xhigh": "c58b1b7854bccb6ea4d28453d29ca53a3f4bea3889a4352af619c7c3c2f59f29", "gpt-5.6-luna-medium": "28be1f07ded6b45bc27703736982057116977d9c8b02ee791c8069de05c49060"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>cf339b58-1802-4ae6-9428-b5f1b726145b<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L3790", "split": "silverTrain", "task": true, "text": "check my seat assignment"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>e7168567-9cc0-4852-a10b-6cc9f4bf90f1<TURN>10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "8b7bca9a3e10ddf97e6486857703ca560586f0e8cf9c5cabbad55185b04fe673", "cursor-grok-4.6-xhigh": "01b650fccdbbbb77ff27409be4cc4aa20091c7e292bc643017ebb460e9ebd0f3", "gpt-5.6-luna-medium": "648eaba1f98f98e24283ad447567da13343f4bc09ace5151dab94b9d2f6a33fb"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>e7168567-9cc0-4852-a10b-6cc9f4bf90f1<TURN>10", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L11108", "split": "silverTrain", "task": true, "text": "charlie sorry could you please change to window seat"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-airline-<CONV>ef984b73-87da-43c7-a01d-cf345a2b33a7<TURN>4", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4ce4c028625f526495845ed484738d797d51be30aa8195122d183eb7f2db1f0c", "cursor-grok-4.6-xhigh": "12375d9427d8b9013a8ed3e1f71aa0b88fc0ab614dda69b67f0501216d0025ce", "gpt-5.6-luna-medium": "a94e083275c2bd57449955ce716906e27f82cfe4902fda640a0112d3558570c5"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>ef984b73-87da-43c7-a01d-cf345a2b33a7<TURN>4", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L7057", "split": "silverTrain", "task": true, "text": "can you send it to my email"}
{"actionVerifierLabel": "neither", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": true, "id": "open-multidogo-airline-<CONV>f5483ab2-6ef0-4423-9452-ceaa6567bac2<TURN>16", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.88, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "d6e6efbe1f49dee31a8f56b97e62cc05370da9d0aa0b98066c27a8308a5d841c", "cursor-grok-4.6-xhigh": "65f7fe096ab0333587a4412955ce94831b7c604b2d1f2c8ae140ebb7350b333d", "gpt-5.6-luna-medium": "25d2f56b262e75b89e974d85fce7a84601635db7fa23e2614177757fc0881467"}, "labelerVotes": {"replyableMessage": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": true, "replyableMessage": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-airline-<CONV>f5483ab2-6ef0-4423-9452-ceaa6567bac2<TURN>16", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/airline/train.tsv#L7609", "split": "silverTrain", "task": false, "text": "have a nice daygood bye"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-fastfood-<CONV>691eed09-466e-42a9-aba4-e4f0865627b0<TURN>1", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e31b55465219e4231c728b8c78bf8b009e27b7cc8c15eea9f935710a0d084fbd", "cursor-grok-4.6-xhigh": "ab9dfd98a06d156b1f2410d256626a916336712935f761c35ac7729b584c8abb", "gpt-5.6-luna-medium": "e047ccfe23dccf093e8ed4a1fbe390635eedfee7a2adb6f808ae13c0a12b9b76"}, "labelerVotes": {"replyableMessage": 2, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-fastfood-<CONV>691eed09-466e-42a9-aba4-e4f0865627b0<TURN>1", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L1502", "split": "silverTrain", "task": true, "text": "i like to have a pizza"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-fastfood-<CONV>c8885516-5008-40f0-a83a-8bded8907f1f<TURN>10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "aa767fb24746f246ae3fa6a13e027c27cdbe52ebcc3ede204ea5bc3fef1e0a17", "cursor-grok-4.6-xhigh": "ba0f5d098d0b17b0b0df912b6975ecd12b1a43182386657011607a80f3f1e1c2", "gpt-5.6-luna-medium": "fa663d3d5b29443be58913334daceb84911d5eb8adebcf95b2798c1aa7c784a9"}, "labelerVotes": {"confirmationDecision": 1, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-fastfood-<CONV>c8885516-5008-40f0-a83a-8bded8907f1f<TURN>10", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L8908", "split": "silverTrain", "task": true, "text": "add fries medium with diet coke"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-fastfood-<CONV>cb6a933b-e78e-4f42-9859-072502b2a93d<TURN>9", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.92, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4c452466bb1af387405003f491139dd300447f81e023cf70b07adb3867c325fc", "cursor-grok-4.6-xhigh": "1c8faaa1a7a2a5a4882387b1cab82aead8e56cdc301917ac6a315dfd3dd016b4", "gpt-5.6-luna-medium": "321fc8d4b7b7db980395d6c860ffc35e8bd8c69aaa9c359d572b9329e7939c9c"}, "labelerVotes": {"confirmationDecision": 1, "question": 2, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-fastfood-<CONV>cb6a933b-e78e-4f42-9859-072502b2a93d<TURN>9", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/fastfood/train.tsv#L838", "split": "silverTrain", "task": true, "text": "thatll be all actually can i not have bbq drizzle on my pizza"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>06a5d4bf-582b-4153-9ed9-77174bdf1a3f<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "e7eb65a3042ee8968bf7b1fe06fde8cccdcbf9f57f91034eb4b8440c37682c22", "cursor-grok-4.6-xhigh": "4cc8c4f52e3ed92b0fd37c718011edc29f5abf12fe50ef646f2b7a121df0d253", "gpt-5.6-luna-medium": "84bd282f09933a70f9a77a4a913ece75a504bcaa38ec57cb77d72b53a6e89196"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>06a5d4bf-582b-4153-9ed9-77174bdf1a3f<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L12502", "split": "silverTrain", "task": true, "text": "i want to know my account balance could you please help me with that"}
{"actionVerifierLabel": "both", "ambiguousVotes": 0, "blessing": false, "complaint": true, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>09ea7462-4548-4190-bbf9-c8ef68eff2ff<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.9, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1963e06605e7cd47b33061c01812b226273618dc5c8842765aad2dd78bb841c9", "cursor-grok-4.6-xhigh": "4f72d2f421f5c27281d954fbea73cfdeb31446bfd0ce7177ae3fe62aad26c353", "gpt-5.6-luna-medium": "96e4b719f4fc338eccba62e8e02b1960d21a1a61c104cf7472ee8e9d4fabe94d"}, "labelerVotes": {"complaint": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>09ea7462-4548-4190-bbf9-c8ef68eff2ff<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L4004", "split": "silverTrain", "task": true, "text": "i want remove error bill in my credit card"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>2ddd9985-0297-41dc-bf9b-7da490ad27b2<TURN>4", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2203ad70283231f9cfee355a253677f0e54c77f669d5be4548f962a4c2053a19", "cursor-grok-4.6-xhigh": "70009c7fd6f57f0899c9d99fb12b036943b0cfec095187d6a603b64569eba6ef", "gpt-5.6-luna-medium": "8d4d967a8fc8171cce075dfcceb801de654d4d200189e449f3a16dd9c5141dc5"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>2ddd9985-0297-41dc-bf9b-7da490ad27b2<TURN>4", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L8153", "split": "silverTrain", "task": true, "text": "i need to block and apply the new card"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>4ff7ea74-7bf8-480f-b32e-796f981d4690<TURN>1", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "24ba70477626616a1a8f433c1fd2c24f0cd26320fb497e9b4de54ec9f0f1f1ca", "cursor-grok-4.6-xhigh": "bef0bdbfb10873b01ad4ee37a242f02ddb2510421ff9255844b85db8f8ce384c", "gpt-5.6-luna-medium": "4cb63526a05cf7d4479eef0ae0181a30bcfc672f6b55e6ee450a5522da3ec2a4"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>4ff7ea74-7bf8-480f-b32e-796f981d4690<TURN>1", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L3378", "split": "silverTrain", "task": true, "text": "i want to transfer money from one account to another"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>6a2c2e90-80e3-4bed-b1ae-e46352fad37e<TURN>5", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "b71cf69e9464d42123f7498c8437a9c6a0af129edcab2470ad74ef1ce41e80c0", "cursor-grok-4.6-xhigh": "3b3c10c4cdde823c36c6a4d2984fb14e5be4251cd455be514008ab4c6d0bbb02", "gpt-5.6-luna-medium": "b68227c554f3644e002977e13fb875d02e23c97caadf3543299245cddbf1e526"}, "labelerVotes": {"confirmationDecision": 3, "question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>6a2c2e90-80e3-4bed-b1ae-e46352fad37e<TURN>5", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L1822", "split": "silverTrain", "task": true, "text": "yes please check my account balance of last four digit with 8523"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>768b9755-ae63-4468-b1c3-a7be9cb9de7d<TURN>13", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "70536df4674c50218c723a62075697b53ebf700dc5a7f2d45e228823841c42a6", "cursor-grok-4.6-xhigh": "6735d05777178a01fcf2616ae5d8efd7338243757a32d4a9c92a7c9eafc69042", "gpt-5.6-luna-medium": "24108d74eadaa00c05d6b205222007481d54985d92cd7a0c8afc7f25aae8f6c9"}, "labelerVotes": {"confirmationDecision": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>768b9755-ae63-4468-b1c3-a7be9cb9de7d<TURN>13", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L5877", "split": "silverTrain", "task": true, "text": "yesi need to order checks"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>bad487db-c120-4b3d-bac9-7dc50ce5a70d<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4b514956465885ff2cd99a116de10934bacc0167af980473bf8b6cded3df5e10", "cursor-grok-4.6-xhigh": "8a60a3bb8d764d3fbe64798de555205c4648856fa1cad548c94aac495c72b290", "gpt-5.6-luna-medium": "a8eb454c10403bd6a79e741cb77341e706f53397f18cabd35085b00a6031fea0"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>bad487db-c120-4b3d-bac9-7dc50ce5a70d<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L12784", "split": "silverTrain", "task": true, "text": "can you please order a new credit card because my old one expired"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>d141b9e9-0157-47d4-a642-3378b12f6a9a<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "a2d198c950a88eab927259da3be7a87d75d24a5e5b2ce3244cb08dd5d0103885", "cursor-grok-4.6-xhigh": "26f70276387d0124ee8899ee07cbd8c6cb3a2da319703670a99202c5b2bb3818", "gpt-5.6-luna-medium": "41e91e2579441efa27cb15503f91506ddcb513a8652c8e1324f5679a3c4d50fc"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>d141b9e9-0157-47d4-a642-3378b12f6a9a<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L10475", "split": "silverTrain", "task": true, "text": "my credit card was expiry can i apply new card"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-finance-<CONV>f53cc617-26d4-4eaa-be85-3d13a12c2d2c<TURN>0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1d82b3168bf0b710299b7eb65788e6c5778ccaed42f51bab006bd00f30ea704e", "cursor-grok-4.6-xhigh": "83c4313efe502b8bfd2e3c2af439e32f3ffccfeb5a3d0ec24129e7b43b2b3c0a", "gpt-5.6-luna-medium": "6e81b2fc5782ff62f27ad3f53ec7e0cb66c4c0f18e0f40f7dd1c7af0ec12b705"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-finance-<CONV>f53cc617-26d4-4eaa-be85-3d13a12c2d2c<TURN>0", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/finance/train.tsv#L13213", "split": "silverTrain", "task": true, "text": "hello i would like to check my account balance please"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-media-<CONV>58cd816a-5be6-45f2-9faa-484cd4222398<TURN>2", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "47bd1234185ea4fb6949748ee61ba92e1973765a113675430a504fbfd2897c40", "cursor-grok-4.6-xhigh": "476255d88b51313a5966d8d526ee0c968f25f33e5cb9f79f16b85641e4d7e22e", "gpt-5.6-luna-medium": "6891d5d50cb5e24fc0e061cafc7ff633a9172b2e7808b827b2d98841127a4e16"}, "labelerVotes": {"confirmationDecision": 3, "question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-media-<CONV>58cd816a-5be6-45f2-9faa-484cd4222398<TURN>2", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L3211", "split": "silverTrain", "task": true, "text": "yes can you know me the details about the internet service for my home"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-media-<CONV>8b07e256-f4bd-449a-ae6e-4362ce0ad51f<TURN>9", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "18924ae4b5b77c0c768f04128934b59aaedd0ca16c9489ae78e9a4db544198d6", "cursor-grok-4.6-xhigh": "6092ca0bbc347cd19a0071d9b46bb9d60c9b76c225643af3757165abc06accc2", "gpt-5.6-luna-medium": "a62326418201c59d1c5cf312494fddf2f7acca0f50939b75bb066ed53693f087"}, "labelerVotes": {"replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-media-<CONV>8b07e256-f4bd-449a-ae6e-4362ce0ad51f<TURN>9", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L4315", "split": "silverTrain", "task": true, "text": "make a connection as soon as possible"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-media-<CONV>92aa2085-36e0-416f-b616-c5c26896b6f7<TURN>11", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7aa099df17427d2e29a55e0a510c166584930f47b2b5ac1beb94d504ae41fee6", "cursor-grok-4.6-xhigh": "2ff8e060455f61f0da9cf3128cb3f1b921a3dcd4946980d0b5190296e9adb4c9", "gpt-5.6-luna-medium": "42ae3f2e2c5d095598362372e8f64f407a3fc33ef8ffa41a29fea5e4505b41e0"}, "labelerVotes": {"question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-media-<CONV>92aa2085-36e0-416f-b616-c5c26896b6f7<TURN>11", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/media/train.tsv#L9277", "split": "silverTrain", "task": false, "text": "may i know this plan have internet option"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-software-<CONV>a7ddddb6-ff99-4d40-9f90-09b457f0152e<TURN>9", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6b66046ae5fec36aea29476f47f0c0172b10b9a8496038185f71e6d5be02dd26", "cursor-grok-4.6-xhigh": "0f796a706e254ec6eafc11545177e0ab6e86987d13d7098fe740c292c9ef88b0", "gpt-5.6-luna-medium": "a780fe81cee22f703f977838c1c870cf7b9bbc3fe7dd1f5c37705e88efd64507"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-software-<CONV>a7ddddb6-ff99-4d40-9f90-09b457f0152e<TURN>9", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/software/train.tsv#L12504", "split": "silverTrain", "task": true, "text": "also can you please check the global status of the server"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-multidogo-software-<CONV>d885d685-6c06-4c0b-bee9-8255e87ea7bb<TURN>4", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "5c8a211664dfcc4434204d7bdf29ee8d417eb60d80c91206b6b7b03621351646", "cursor-grok-4.6-xhigh": "ad3f27ed1415a686ccce2f8ea872a1c7a93169c438d6fec23938eafdd0f57af3", "gpt-5.6-luna-medium": "7e84f31a791ed6a17a2278b0239505854eecd00f9497146ad42ab0508aa8de1a"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "MultiDoGO", "sourceLabels": ["question", "task"], "sourceLicense": "CDLA-Permissive-1.0", "sourceRecordID": "open-multidogo-software-<CONV>d885d685-6c06-4c0b-bee9-8255e87ea7bb<TURN>4", "sourceRevision": "baa30639c4b271f394b81443c842193407cdf26d", "sourceURL": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/baa30639c4b271f394b81443c842193407cdf26d/data/paper_splits/splits_annotated_at_turn_level/software/train.tsv#L4004", "split": "silverTrain", "task": true, "text": "please check my clobel status for my softwarews"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-358f37c1-ff58-4a0b-baba-e13d2fd7e91a-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.98, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "c0710fcd3ac359b1837587d3ee51ad67e9d8feaebf4109a68353bfdca6f25381", "cursor-grok-4.6-xhigh": "bdd31b988d071d4565bcd7941ecdd67cca771a33af6751c86b77ed73644d13ec", "gpt-5.6-luna-medium": "e87b22ff8b00ff6c90a12337c5b59a4387cbda696b15dd5ffcf71a78c19ece46"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-358f37c1-ff58-4a0b-baba-e13d2fd7e91a-12", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Could you please send it to my location?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-47a2fdac-9da1-43a8-a3db-9a69ec1f2c7e-16", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "1d4bda7a9795679f135d93cc25505e44b433055b246a5973d66df998b5580186", "cursor-grok-4.6-xhigh": "377d7fd3aea13df0ffff39c771e3f52fe6b71fa1b24db9cd256e46b18e43b391", "gpt-5.6-luna-medium": "d7685bfc35ae60f32e2b89084ee28885dccb426b2eaf8939853b6371ce0e0ce4"}, "labelerVotes": {"confirmationDecision": 3, "question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-47a2fdac-9da1-43a8-a3db-9a69ec1f2c7e-16", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "Okay that's great is the order under my name?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-492c1586-03c4-4369-a672-e0279ffc5e0b-4", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.95, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9919c955ed15186b32c19ef298fa1ea3ba2e8f1b2efe0f67aef0823e645817a9", "cursor-grok-4.6-xhigh": "6f193cee4b73a78d9e36b0f57be045c1008099501ed056e38b15f1a1aa59f5b1", "gpt-5.6-luna-medium": "b9b432bd2a03118bf08962f02ede9e17fdb1cfa9070eb0b80ad05ff98ac17326"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-492c1586-03c4-4369-a672-e0279ffc5e0b-4", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "I have heard good things about The Chophouse. Can you make a reservation for me please?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-4e7f31e8-76dc-4b29-9e2b-f2cd33ec0f42-18", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "bef37f0f0f0d654ef67f1245c9076086141077b1e1003a056d3fb1efba71ab3f", "cursor-grok-4.6-xhigh": "914b144ee7a794da0d06b44bb9cb008b60a8ac1df30e50aa172e1491525f95fb", "gpt-5.6-luna-medium": "14663b30956aaca15d262d3587dea9b7cbcf0ee6abd727edc65ab4e8704b3091"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "scheduleNegotiation"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-4e7f31e8-76dc-4b29-9e2b-f2cd33ec0f42-18", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "What time do they close?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-514731c8-b1f8-4dfd-a576-b77467d3a2b4-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "3aa8a8cc3f0f8e12596e6845f279696d022dce15615a77afed905aac4f197bd8", "cursor-grok-4.6-xhigh": "a0a21138cd9844f2991b1c6f2fd4c95c1436fd558811b273a3c79f4d5139f0ea", "gpt-5.6-luna-medium": "fa9f98a04f2437d5198e91795cad20ac39eebdcf09685b25fbebe28e9ccc8349"}, "labelerVotes": {"confirmationDecision": 1, "question": 3, "replyableMessage": 1, "scheduleNegotiation": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-514731c8-b1f8-4dfd-a576-b77467d3a2b4-10", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "I see, is there an imax showing for Hellboy other than at 6pm?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-5bde0835-4643-4397-ae9d-7866888a62b7-14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6933f140aaa0b47565e8b1bb1a1d6f5ba3997cadae753f99387f98e0fe182b52", "cursor-grok-4.6-xhigh": "aa997270de50209165ed04641e28fe58be47f4027201e67d1d7dc3847f210084", "gpt-5.6-luna-medium": "29b55b678059f7dfb1abaf12929fab03584004cd756229c66dc3d2c50ae4cc44"}, "labelerVotes": {"confirmationDecision": 3, "question": 3, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-5bde0835-4643-4397-ae9d-7866888a62b7-14", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Great can you confirm the order?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 0.6667, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-71869301-e89c-4484-a41f-9a7dde268dee-18", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "821a22645f41b2cca748851ff3b61fcaa139447814e2d420a29292b11a57d9a5", "cursor-grok-4.6-xhigh": "452cd8ebc6e65284210650cd4f7c4501cb67a22c7267fe5d94ae5c89fca74d08", "gpt-5.6-luna-medium": "37409ea757afbf03b9b86157f4bee3303dc5626bc622649e1469d05c4217f90b"}, "labelerVotes": {"confirmationDecision": 1, "question": 2, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-71869301-e89c-4484-a41f-9a7dde268dee-18", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "And can I also get a splash of pink lemonade in that?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-8b5b8bc8-da47-4f86-801d-2c05fa60aa3b-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ad6da1ad190ebdf7efe224ba95012f506f644a4d31a05e75195520466f321fa0", "cursor-grok-4.6-xhigh": "0c49486b8ea0c218dd95c9c2ee1f0be559d3375c4db785737884cfff38b05b72", "gpt-5.6-luna-medium": "5a81cf08cc6732e30708779a433e12e285837bebe6a64902fae219f999fe7522"}, "labelerVotes": {"confirmationDecision": 3, "question": 2, "replyableMessage": 1, "task": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-8b5b8bc8-da47-4f86-801d-2c05fa60aa3b-12", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "Yes. If there's no coconut milk, ask for oat milk. If there's no oat milk, almond milk. Got it?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-970b1696-28b5-4e16-ba83-fb7e31445a30-4", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4a41eea52060e98acf45cf4d7947c955d1928558a9643fe5ea67a8d36f000b56", "cursor-grok-4.6-xhigh": "fd0858b3b07aba16c15af7902e4ed7f4ba7e9407cbddac3f3ff6ea78c4c06b17", "gpt-5.6-luna-medium": "caa3ad24f2f722e6f4040052cc1f7d82cbbcbd62e962ba82f0e663eca0df79c3"}, "labelerVotes": {"confirmationDecision": 1, "question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-970b1696-28b5-4e16-ba83-fb7e31445a30-4", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "I want an X-large supreme pizza please. But instead of green pepper can I get zucchini on that?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "scheduleNegotiation", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-a5a8569f-98b7-4054-94d7-941bbe5a74e7-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "9392ded87edd1e1d012a9de5bcb7bb75885cba6ef532811bb0406b679c8f3e4d", "cursor-grok-4.6-xhigh": "f7b0045babbb643155612f665d605b7f96852d4481009107b56843403dfdba4a", "gpt-5.6-luna-medium": "994a1e983bbaea06d6413239748e788d9eac5fd9e00ecef9a72efbf8648b600e"}, "labelerVotes": {"question": 3, "replyableMessage": 1, "scheduleNegotiation": 3, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": true, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-a5a8569f-98b7-4054-94d7-941bbe5a74e7-10", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "If that doesnt work can you check what other times are available?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-a7a5fb3a-2bbe-4278-9e41-ff968fdd80af-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.89, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4c66f81323420409ecfcfbfaa3c5000bf433e9a66ac71d3ff2c7d8bea65dd162", "cursor-grok-4.6-xhigh": "2111b1d6fb5a3d09f0b42f9122568f6b0966aa57bd0d423b889f4dce78002655", "gpt-5.6-luna-medium": "fe5dfa4d89307aea36bea48361331ec2bdd5706406e5eb149423dd2d69ca11e4"}, "labelerVotes": {"confirmationDecision": 3, "question": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-a7a5fb3a-2bbe-4278-9e41-ff968fdd80af-10", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "Okay. Is there a patio outside?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-ab4f13a3-19ff-4af1-ad84-9bfd8465b25d-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "4f89115a5d0b941ba638cb107d5360d0ab3f40e69addaa690201d35d5ada7a1b", "cursor-grok-4.6-xhigh": "4c612853235063887db8db63c8f1d5f3b2df2d445a23f79f0dc1df6c4ae020d5", "gpt-5.6-luna-medium": "cc29c455f88800e59f0a971bd82d5814d4f5fe479238426a4b3872202e683f49"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-ab4f13a3-19ff-4af1-ad84-9bfd8465b25d-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Hi. I am absolutely starving. Can you order me a pizza?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-b25c11f4-af49-4018-8e90-89ab7201786e-10", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "474733d7a64b136cacfa72c5ad2a7eaf3935820a8b921a9e1b0c11783e63b3ca", "cursor-grok-4.6-xhigh": "b7c2499234f9da45a4ffc3ebdf8aff55881e63ce072eed204151cd79fd5e1a7e", "gpt-5.6-luna-medium": "e081ba55047233a1f304fbfbada5225f88962f1e9b51632222747da7eb80ae29"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "scheduleNegotiation": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-b25c11f4-af49-4018-8e90-89ab7201786e-10", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Could you please ask them to have it ready at 6:00 pm?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-b3d79e61-eb01-4244-a3c2-baec23707a84-8", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.9, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "6d2d48f1c0e0d4db803fb36f22639ef5fb26dd432d58bd7344676c19e9a55933", "cursor-grok-4.6-xhigh": "c0822929decb8fe5eb75eacad27e873d77314e8feaf7ff1464df1e90fa48ee95", "gpt-5.6-luna-medium": "d946a7e004f194059564ad3445099080884b93a60f4a33742c7c6769d3178dd9"}, "labelerVotes": {"confirmationDecision": 3, "question": 2, "replyableMessage": 2, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-b3d79e61-eb01-4244-a3c2-baec23707a84-8", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "True. Okay, how about an iced caffe mocha?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-b6813ffb-6f52-4dcf-be61-dfb7889a5be7-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "be229ad22f7fb81a6b5268aaf5273d2cf5aa7d5f57f5411b00db85be95b070b9", "cursor-grok-4.6-xhigh": "98bc687fbd2d3d38a140abda9663bbb380b8a4dfca7e81e30ee9f7f3d031e56e", "gpt-5.6-luna-medium": "d2c04e2dd5e65734600927e78ab77d74db26ca5076dbe1503736cfdbc08a7d1e"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-b6813ffb-6f52-4dcf-be61-dfb7889a5be7-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Hello, I'm really feeling Starbucks today. Could you please order me a Iced Blonde Cinnamon Cloud Macchiato,?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-c102e26c-1aee-4a65-b5b1-c886b6b91f0d-12", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "7da5d7559448bc31d7bb3f47a4bfb8d6586b1865c9485c356408ff26e9a622d3", "cursor-grok-4.6-xhigh": "1225bc99b1cfa76121683e4fec33b841af6bb082978c14e3bf7ce6bc607bf530", "gpt-5.6-luna-medium": "c81ab65454c459ed8908a5a867ab75cfcb1c7f6ff4e82cef4824181f179e2b7c"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-c102e26c-1aee-4a65-b5b1-c886b6b91f0d-12", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Actually can you change my order to something else?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-c1b054cb-ef63-427f-8f6f-7e68f697787e-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "2715abd75db8fd30dab252de41a9944ea0aa73b78c0071df498b42af1691e3a2", "cursor-grok-4.6-xhigh": "907ab0ae9672101c2c370e9a0bb2d9d8e058c7e648de679c32c143f0c30fd25e", "gpt-5.6-luna-medium": "49bdb56299cdd45c8b7b76628d281ce43aac6ef80e1d3808c69966b9f7c52b1d"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-c1b054cb-ef63-427f-8f6f-7e68f697787e-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Hi I'm running late again and need to pick up supper on my way home. Can you call in a pizza order for me?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "scheduleNegotiation", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-c578ddb3-479f-427f-a614-90e02ff149d5-14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.91, "cursor-grok-4.6-xhigh": 0.94, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "eeb88ac76a87efbe279dd53e2e7d772526eb4aa44ccbd1134daa4ec31d86be7c", "cursor-grok-4.6-xhigh": "9e5f00d22a6ceb2523c1093f7ef8a4d277d2aad81aa7d4e98d8fe7d8ceb02dbd", "gpt-5.6-luna-medium": "29a6caf324ff4b003b97ed16483e050bb1ddb0fc3db24cfbfee1b93c5f9b9520"}, "labelerVotes": {"confirmationDecision": 1, "question": 2, "replyableMessage": 1, "scheduleNegotiation": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": true, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "scheduleNegotiation"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-c578ddb3-479f-427f-a614-90e02ff149d5-14", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "That is too late. What do they have available on Wednesday?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-c5a97940-d02e-4313-b34b-6862b65f56cc-6", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.89, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "5b9dbb053c1d9cf5ad2be51052829aed3e39f3d9e7d708a3922b4cf262b75613", "cursor-grok-4.6-xhigh": "da973b97e7fb1932b4cc70ab826d1dd5154d8e82daa132ebe6c3f3a1f1788c8f", "gpt-5.6-luna-medium": "e50f2820e09c656eb8ed4c12fbc919b69d2313685710b19e173648705bf53528"}, "labelerVotes": {"confirmationDecision": 3, "question": 3, "replyableMessage": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-c5a97940-d02e-4313-b34b-6862b65f56cc-6", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "Yes that would be great! How much is the fare?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-c86eb60b-b858-486f-af8c-957f3287cf51-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "ceaf33325e0759dbb53f1a604c5b1f7cdc14d594ae3deffcd0a72ba2fa3bb220", "cursor-grok-4.6-xhigh": "32232726aed5998633fa85de35046afddc135019467577b3c0ea8c084a80b690", "gpt-5.6-luna-medium": "32232726aed5998633fa85de35046afddc135019467577b3c0ea8c084a80b690"}, "labelerVotes": {"question": 3, "replyableMessage": 2}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-c86eb60b-b858-486f-af8c-957f3287cf51-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "What are some really good Italian restaurants"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-d7abdbb2-d3ad-4506-bfe1-b2d125e82c50-6", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.93, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "8f747a2e32a12d1988267fcf48b5db7fe61aef8d7fcacccb6db21ed78f682690", "cursor-grok-4.6-xhigh": "2c7a92b3a3a32d97436e82445f484f93680951fa8cee57dc08071a390cd1bd13", "gpt-5.6-luna-medium": "b15922acbc3411aa53ac4012500042d1092d2a4a3e0a3279fa21114a357fc1e2"}, "labelerVotes": {"confirmationDecision": 2, "question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-d7abdbb2-d3ad-4506-bfe1-b2d125e82c50-6", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Oh yes. I almost forgot. Can you have them go easy on the sauce?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-dd438d00-2322-435a-9f4a-f1bca8c621c9-14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.92, "cursor-grok-4.6-xhigh": 0.95, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "50a47ad5ffd22a86f7884c5f699978d67f21548564e3c52e642816d930d3b54e", "cursor-grok-4.6-xhigh": "3236a1322370c79ef0846b37f08bba5229c5088f02b24489e6f51fadf8b29f97", "gpt-5.6-luna-medium": "19a98402ca59f3481c7f99cd727d27dc1f1ea01bd18293d53a91ac01d814348a"}, "labelerVotes": {"replyableMessage": 1, "scheduleNegotiation": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": false, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-dd438d00-2322-435a-9f4a-f1bca8c621c9-14", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Have them pick me up at 8 AM please."}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-eb85e2af-9bef-4e79-bc84-88f439100d30-0", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.96, "cursor-grok-4.6-xhigh": 0.97, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "864941f4d87791e56bedc0aad3f0e35d009b6a9b296f2326641536ed11eee02b", "cursor-grok-4.6-xhigh": "c13e944cfc6a53c928817f45b5c88b851ffd05f0a99a4b087752d3b008b6995c", "gpt-5.6-luna-medium": "26c75f5db8ad59e03188fbc4c2672ff4b75bdcf82b7cdf1f3189d743d88c26c4"}, "labelerVotes": {"question": 2, "replyableMessage": 1, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-eb85e2af-9bef-4e79-bc84-88f439100d30-0", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Hello! Can you order me a coffee from Starbucks?"}
{"actionVerifierLabel": "taskOnly", "ambiguousVotes": 0, "blessing": false, "complaint": false, "confirmationDecision": false, "consensusAgreement": 1.0, "coordinationVerifierLabel": "neither", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-eceee47e-a4c9-431b-a730-a593873f8864-14", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.94, "cursor-grok-4.6-xhigh": 0.96, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "cdce2ec1d8d74aac840a12eb55cd18fb72908c1717b181264117863a95592701", "cursor-grok-4.6-xhigh": "6383d76539d18d3a169715843c28a2d5d28f43d1342b409f20f6b7b3f04db02e", "gpt-5.6-luna-medium": "6383d76539d18d3a169715843c28a2d5d28f43d1342b409f20f6b7b3f04db02e"}, "labelerVotes": {"confirmationDecision": 2, "question": 2, "replyableMessage": 2, "task": 3}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["question", "task"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-eceee47e-a4c9-431b-a730-a593873f8864-14", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": true, "text": "Okay, can you text me the details?"}
{"actionVerifierLabel": "questionRequest", "ambiguousVotes": 1, "blessing": false, "complaint": false, "confirmationDecision": true, "consensusAgreement": 1.0, "coordinationVerifierLabel": "confirmationDecision", "family": "consensus_public", "followUpReminder": false, "fullAgreement": false, "id": "open-taskmaster-dlg-fd25ed51-e404-4a9b-bfdb-c86afc8fb09a-24", "invitation": false, "labelerConfidences": {"composer-2.5-fast": 0.82, "cursor-grok-4.6-xhigh": 0.93, "gpt-5.6-luna-medium": 0.96}, "labelerResponseHashes": {"composer-2.5-fast": "323fad176e8331e65208d5899fb3aa1b313b94cb17a91083b5c8b51dcf4fbb80", "cursor-grok-4.6-xhigh": "bf891237b5deb1a60ce4392ee9c329299845309d15d21eae5b480dc98b0edfd7", "gpt-5.6-luna-medium": "09ee7c2ed905ff4cc4637c1d0ab8ad31328169560e513341af4230606fb2cedf"}, "labelerVotes": {"confirmationDecision": 3, "question": 3, "replyableMessage": 1, "task": 1}, "language": "en", "promptVersion": "clipboard-consensus-v1", "question": true, "quotedOrMeta": false, "quotedOrMetaVotes": 0, "replyable": false, "replyableMessage": false, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "Google Taskmaster-1", "sourceLabels": ["confirmationDecision", "question"], "sourceLicense": "CC-BY-4.0", "sourceRecordID": "open-taskmaster-dlg-fd25ed51-e404-4a9b-bfdb-c86afc8fb09a-24", "sourceRevision": "d92cb6af3005f1dc09c39e75e7daf4a04905e00b", "sourceURL": "https://github.com/google-research-datasets/Taskmaster/tree/d92cb6af3005f1dc09c39e75e7daf4a04905e00b/TM-1-2019", "split": "silverTrain", "task": false, "text": "Okay do you think I can use the company card?"}
ModelTraining/ClipboardSemantics/IterativeResearch/EvidenceGateFineTune/macos-replay.json
-629
View File
@@ -1,629 +0,0 @@
{
"automaticPromotionAllowed": false,
"baseCorpus": "ModelTraining/ClipboardSemantics/clipboard_semantic_corpus.jsonl",
"configuration": {
"alpha": 2e-05,
"augmentation": "none",
"char_max": 5,
"char_min": 2,
"external_weight": 0.5700000000000001,
"hard_example_weight": 1.0,
"l1_ratio": 0.0,
"max_char_features": 45000,
"max_word_features": 22000,
"min_df": 2,
"pseudo_weight": 0.16499999999999998,
"round": 1,
"word_max": 2
},
"configurationsByIntent": {
"blessing": {
"alpha": 1.2e-06,
"augmentation": "numeric",
"char_max": 8,
"char_min": 3,
"external_weight": 0.93,
"hard_example_weight": 2.7,
"l1_ratio": 0.25,
"max_char_features": 95000,
"max_word_features": 45000,
"min_df": 1,
"pseudo_weight": 0.43499999999999994,
"round": 19,
"word_max": 3
},
"complaint": {
"alpha": 2e-05,
"augmentation": "none",
"char_max": 5,
"char_min": 2,
"external_weight": 0.5700000000000001,
"hard_example_weight": 1.0,
"l1_ratio": 0.0,
"max_char_features": 45000,
"max_word_features": 22000,
"min_df": 2,
"pseudo_weight": 0.16499999999999998,
"round": 1,
"word_max": 2
},
"confirmationDecision": {
"alpha": 5e-06,
"augmentation": "prefix",
"char_max": 6,
"char_min": 2,
"external_weight": 0.77,
"hard_example_weight": 1.8,
"l1_ratio": 0.1,
"max_char_features": 70000,
"max_word_features": 30000,
"min_df": 2,
"pseudo_weight": 0.31499999999999995,
"round": 11,
"word_max": 2
},
"followUpReminder": {
"alpha": 2.5e-06,
"augmentation": "prefix",
"char_max": 7,
"char_min": 3,
"external_weight": 0.8300000000000001,
"hard_example_weight": 2.2,
"l1_ratio": 0.2,
"max_char_features": 80000,
"max_word_features": 40000,
"min_df": 1,
"pseudo_weight": 0.36,
"round": 14,
"word_max": 3
},
"invitation": {
"alpha": 2e-05,
"augmentation": "none",
"char_max": 5,
"char_min": 2,
"external_weight": 0.5700000000000001,
"hard_example_weight": 1.0,
"l1_ratio": 0.0,
"max_char_features": 45000,
"max_word_features": 22000,
"min_df": 2,
"pseudo_weight": 0.16499999999999998,
"round": 1,
"word_max": 2
},
"question": {
"alpha": 2e-05,
"augmentation": "none",
"char_max": 5,
"char_min": 2,
"external_weight": 0.5700000000000001,
"hard_example_weight": 1.0,
"l1_ratio": 0.0,
"max_char_features": 45000,
"max_word_features": 22000,
"min_df": 2,
"pseudo_weight": 0.16499999999999998,
"round": 1,
"word_max": 2
},
"replyableMessage": {
"alpha": 2e-05,
"augmentation": "none",
"char_max": 5,
"char_min": 2,
"external_weight": 0.5700000000000001,
"hard_example_weight": 1.0,
"l1_ratio": 0.0,
"max_char_features": 45000,
"max_word_features": 22000,
"min_df": 2,
"pseudo_weight": 0.16499999999999998,
"round": 1,
"word_max": 2
},
"scheduleNegotiation": {
"alpha": 6e-06,
"augmentation": "punctuation",
"char_max": 6,
"char_min": 3,
"external_weight": 0.6900000000000001,
"hard_example_weight": 1.5,
"l1_ratio": 0.1,
"max_char_features": 65000,
"max_word_features": 32000,
"min_df": 2,
"pseudo_weight": 0.255,
"round": 7,
"word_max": 3
},
"task": {
"alpha": 2e-05,
"augmentation": "none",
"char_max": 5,
"char_min": 2,
"external_weight": 0.5700000000000001,
"hard_example_weight": 1.0,
"l1_ratio": 0.0,
"max_char_features": 45000,
"max_word_features": 22000,
"min_df": 2,
"pseudo_weight": 0.16499999999999998,
"round": 1,
"word_max": 2
}
},
"openCorpus": "ModelTraining/ClipboardSemantics/open-training-corpus.jsonl",
"reason": "Surrogate feature weights are not deployable NLModel assets and cannot bypass the existing macOS acceptance policy.",
"requiredCommands": [
"python3 Scripts/clipboard_semantics/generate_open_training_corpus.py",
"xcrun swift Scripts/clipboard_semantics/train_models.swift --algorithms maxEnt --corpus ModelTraining/ClipboardSemantics/combined-training-corpus.jsonl",
"xcrun swift Scripts/clipboard_semantics/evaluate_random_holdout.swift --corpus ModelTraining/ClipboardSemantics/random-holdout-corpus.jsonl"
],
"schemaVersion": 1,
"seed": 20260827,
"selectedRound": 1,
"selectedRoundsByIntent": {
"blessing": 19,
"complaint": 1,
"confirmationDecision": 11,
"followUpReminder": 14,
"invitation": 1,
"question": 1,
"replyableMessage": 1,
"scheduleNegotiation": 7,
"task": 1
},
"thresholds": {
"blessing": {
"abstained": true,
"byLanguage": {
"en": {
"abstained": true,
"metrics": {
"f1": 0.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 0.0,
"predictedPositive": 0,
"recall": 0.0,
"total": 0,
"trueNegative": 0,
"truePositive": 0,
"wilsonPrecisionLower95": 0
},
"threshold": 1.0
},
"zh-Hans": {
"abstained": true,
"metrics": {
"f1": 0.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 0.0,
"predictedPositive": 0,
"recall": 0.0,
"total": 0,
"trueNegative": 0,
"truePositive": 0,
"wilsonPrecisionLower95": 0
},
"threshold": 1.0
}
},
"metrics": {
"f1": 0.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 0.0,
"predictedPositive": 0,
"recall": 0.0,
"total": 0,
"trueNegative": 0,
"truePositive": 0,
"wilsonPrecisionLower95": 0
},
"threshold": 1.0
},
"complaint": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 1.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 1.0,
"predictedPositive": 180,
"recall": 1.0,
"total": 1485,
"trueNegative": 1305,
"truePositive": 180,
"wilsonPrecisionLower95": 0.9791
},
"threshold": 0.5
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.9526,
"falseNegative": 9,
"falsePositive": 8,
"precision": 0.9553,
"predictedPositive": 179,
"recall": 0.95,
"total": 1485,
"trueNegative": 1297,
"truePositive": 171,
"wilsonPrecisionLower95": 0.9143
},
"threshold": 0.54
}
},
"metrics": {
"f1": 0.9764,
"falseNegative": 9,
"falsePositive": 8,
"precision": 0.9777,
"predictedPositive": 359,
"recall": 0.975,
"total": 2970,
"trueNegative": 2602,
"truePositive": 351,
"wilsonPrecisionLower95": 0.9567
},
"threshold": 0.54
},
"confirmationDecision": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.931,
"falseNegative": 9,
"falsePositive": 3,
"precision": 0.9643,
"predictedPositive": 84,
"recall": 0.9,
"total": 1485,
"trueNegative": 1392,
"truePositive": 81,
"wilsonPrecisionLower95": 0.9002
},
"threshold": 0.97
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.7222,
"falseNegative": 38,
"falsePositive": 2,
"precision": 0.963,
"predictedPositive": 54,
"recall": 0.5778,
"total": 1485,
"trueNegative": 1393,
"truePositive": 52,
"wilsonPrecisionLower95": 0.8746
},
"threshold": 0.86
}
},
"metrics": {
"f1": 0.8077,
"falseNegative": 54,
"falsePositive": 6,
"precision": 0.9545,
"predictedPositive": 132,
"recall": 0.7,
"total": 2970,
"trueNegative": 2784,
"truePositive": 126,
"wilsonPrecisionLower95": 0.9044
},
"threshold": 0.95
},
"followUpReminder": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.8788,
"falseNegative": 35,
"falsePositive": 5,
"precision": 0.9667,
"predictedPositive": 150,
"recall": 0.8056,
"total": 1485,
"trueNegative": 1300,
"truePositive": 145,
"wilsonPrecisionLower95": 0.9243
},
"threshold": 0.845
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.6113,
"falseNegative": 99,
"falsePositive": 4,
"precision": 0.9529,
"predictedPositive": 85,
"recall": 0.45,
"total": 1485,
"trueNegative": 1301,
"truePositive": 81,
"wilsonPrecisionLower95": 0.8852
},
"threshold": 0.97
}
},
"metrics": {
"f1": 0.7682,
"falseNegative": 128,
"falsePositive": 12,
"precision": 0.9508,
"predictedPositive": 244,
"recall": 0.6444,
"total": 2970,
"trueNegative": 2598,
"truePositive": 232,
"wilsonPrecisionLower95": 0.916
},
"threshold": 0.91
},
"invitation": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.8302,
"falseNegative": 24,
"falsePositive": 3,
"precision": 0.9565,
"predictedPositive": 69,
"recall": 0.7333,
"total": 1485,
"trueNegative": 1392,
"truePositive": 66,
"wilsonPrecisionLower95": 0.8798
},
"threshold": 0.935
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.6765,
"falseNegative": 44,
"falsePositive": 0,
"precision": 1.0,
"predictedPositive": 46,
"recall": 0.5111,
"total": 1485,
"trueNegative": 1395,
"truePositive": 46,
"wilsonPrecisionLower95": 0.9229
},
"threshold": 0.505
}
},
"metrics": {
"f1": 0.5476,
"falseNegative": 111,
"falsePositive": 3,
"precision": 0.9583,
"predictedPositive": 72,
"recall": 0.3833,
"total": 2970,
"trueNegative": 2787,
"truePositive": 69,
"wilsonPrecisionLower95": 0.8845
},
"threshold": 0.935
},
"question": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.8445,
"falseNegative": 76,
"falsePositive": 12,
"precision": 0.9522,
"predictedPositive": 251,
"recall": 0.7587,
"total": 1485,
"trueNegative": 1158,
"truePositive": 239,
"wilsonPrecisionLower95": 0.9183
},
"threshold": 0.725
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.8536,
"falseNegative": 76,
"falsePositive": 6,
"precision": 0.9755,
"predictedPositive": 245,
"recall": 0.7587,
"total": 1485,
"trueNegative": 1164,
"truePositive": 239,
"wilsonPrecisionLower95": 0.9476
},
"threshold": 0.5
}
},
"metrics": {
"f1": 0.8729,
"falseNegative": 122,
"falsePositive": 26,
"precision": 0.9513,
"predictedPositive": 534,
"recall": 0.8063,
"total": 2970,
"trueNegative": 2314,
"truePositive": 508,
"wilsonPrecisionLower95": 0.9296
},
"threshold": 0.515
},
"replyableMessage": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.948,
"falseNegative": 52,
"falsePositive": 46,
"precision": 0.951,
"predictedPositive": 939,
"recall": 0.945,
"total": 1485,
"trueNegative": 494,
"truePositive": 893,
"wilsonPrecisionLower95": 0.9353
},
"threshold": 0.7
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.9424,
"falseNegative": 62,
"falsePositive": 46,
"precision": 0.9505,
"predictedPositive": 929,
"recall": 0.9344,
"total": 1485,
"trueNegative": 494,
"truePositive": 883,
"wilsonPrecisionLower95": 0.9346
},
"threshold": 0.695
}
},
"metrics": {
"f1": 0.9454,
"falseNegative": 115,
"falsePositive": 90,
"precision": 0.9517,
"predictedPositive": 1865,
"recall": 0.9392,
"total": 2970,
"trueNegative": 990,
"truePositive": 1775,
"wilsonPrecisionLower95": 0.9411
},
"threshold": 0.7
},
"scheduleNegotiation": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 1.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 1.0,
"predictedPositive": 45,
"recall": 1.0,
"total": 1485,
"trueNegative": 1440,
"truePositive": 45,
"wilsonPrecisionLower95": 0.9213
},
"threshold": 0.66
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 1.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 1.0,
"predictedPositive": 45,
"recall": 1.0,
"total": 1485,
"trueNegative": 1440,
"truePositive": 45,
"wilsonPrecisionLower95": 0.9213
},
"threshold": 0.55
}
},
"metrics": {
"f1": 1.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 1.0,
"predictedPositive": 90,
"recall": 1.0,
"total": 2970,
"trueNegative": 2880,
"truePositive": 90,
"wilsonPrecisionLower95": 0.9591
},
"threshold": 0.66
},
"task": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.8403,
"falseNegative": 89,
"falsePositive": 14,
"precision": 0.9509,
"predictedPositive": 285,
"recall": 0.7528,
"total": 1485,
"trueNegative": 1111,
"truePositive": 271,
"wilsonPrecisionLower95": 0.9192
},
"threshold": 0.835
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.8278,
"falseNegative": 98,
"falsePositive": 11,
"precision": 0.9597,
"predictedPositive": 273,
"recall": 0.7278,
"total": 1485,
"trueNegative": 1114,
"truePositive": 262,
"wilsonPrecisionLower95": 0.9293
},
"threshold": 0.745
}
},
"metrics": {
"f1": 0.8637,
"falseNegative": 153,
"falsePositive": 26,
"precision": 0.9562,
"predictedPositive": 593,
"recall": 0.7875,
"total": 2970,
"trueNegative": 2224,
"truePositive": 567,
"wilsonPrecisionLower95": 0.9365
},
"threshold": 0.755
}
}
}
ModelTraining/ClipboardSemantics/IterativeResearch/PerIntentFineTune/macos-replay.json
-629
View File
@@ -1,629 +0,0 @@
{
"automaticPromotionAllowed": false,
"baseCorpus": "ModelTraining/ClipboardSemantics/clipboard_semantic_corpus.jsonl",
"configuration": {
"alpha": 2e-05,
"augmentation": "none",
"char_max": 5,
"char_min": 2,
"external_weight": 0.5700000000000001,
"hard_example_weight": 1.0,
"l1_ratio": 0.0,
"max_char_features": 45000,
"max_word_features": 22000,
"min_df": 2,
"pseudo_weight": 0.16499999999999998,
"round": 1,
"word_max": 2
},
"configurationsByIntent": {
"blessing": {
"alpha": 1.2e-06,
"augmentation": "numeric",
"char_max": 8,
"char_min": 3,
"external_weight": 0.93,
"hard_example_weight": 2.7,
"l1_ratio": 0.25,
"max_char_features": 95000,
"max_word_features": 45000,
"min_df": 1,
"pseudo_weight": 0.43499999999999994,
"round": 19,
"word_max": 3
},
"complaint": {
"alpha": 2e-05,
"augmentation": "none",
"char_max": 5,
"char_min": 2,
"external_weight": 0.5700000000000001,
"hard_example_weight": 1.0,
"l1_ratio": 0.0,
"max_char_features": 45000,
"max_word_features": 22000,
"min_df": 2,
"pseudo_weight": 0.16499999999999998,
"round": 1,
"word_max": 2
},
"confirmationDecision": {
"alpha": 1e-05,
"augmentation": "none",
"char_max": 6,
"char_min": 2,
"external_weight": 0.6100000000000001,
"hard_example_weight": 1.2,
"l1_ratio": 0.05,
"max_char_features": 55000,
"max_word_features": 25000,
"min_df": 2,
"pseudo_weight": 0.195,
"round": 3,
"word_max": 2
},
"followUpReminder": {
"alpha": 2e-05,
"augmentation": "none",
"char_max": 5,
"char_min": 2,
"external_weight": 0.5700000000000001,
"hard_example_weight": 1.0,
"l1_ratio": 0.0,
"max_char_features": 45000,
"max_word_features": 22000,
"min_df": 2,
"pseudo_weight": 0.16499999999999998,
"round": 1,
"word_max": 2
},
"invitation": {
"alpha": 2e-05,
"augmentation": "none",
"char_max": 5,
"char_min": 2,
"external_weight": 0.5700000000000001,
"hard_example_weight": 1.0,
"l1_ratio": 0.0,
"max_char_features": 45000,
"max_word_features": 22000,
"min_df": 2,
"pseudo_weight": 0.16499999999999998,
"round": 1,
"word_max": 2
},
"question": {
"alpha": 2e-05,
"augmentation": "none",
"char_max": 5,
"char_min": 2,
"external_weight": 0.5700000000000001,
"hard_example_weight": 1.0,
"l1_ratio": 0.0,
"max_char_features": 45000,
"max_word_features": 22000,
"min_df": 2,
"pseudo_weight": 0.16499999999999998,
"round": 1,
"word_max": 2
},
"replyableMessage": {
"alpha": 2e-05,
"augmentation": "none",
"char_max": 5,
"char_min": 2,
"external_weight": 0.5700000000000001,
"hard_example_weight": 1.0,
"l1_ratio": 0.0,
"max_char_features": 45000,
"max_word_features": 22000,
"min_df": 2,
"pseudo_weight": 0.16499999999999998,
"round": 1,
"word_max": 2
},
"scheduleNegotiation": {
"alpha": 6e-06,
"augmentation": "punctuation",
"char_max": 6,
"char_min": 3,
"external_weight": 0.6900000000000001,
"hard_example_weight": 1.5,
"l1_ratio": 0.1,
"max_char_features": 65000,
"max_word_features": 32000,
"min_df": 2,
"pseudo_weight": 0.255,
"round": 7,
"word_max": 3
},
"task": {
"alpha": 3.5e-06,
"augmentation": "prefix",
"char_max": 6,
"char_min": 2,
"external_weight": 0.8500000000000001,
"hard_example_weight": 2.2,
"l1_ratio": 0.2,
"max_char_features": 85000,
"max_word_features": 42000,
"min_df": 1,
"pseudo_weight": 0.375,
"round": 15,
"word_max": 3
}
},
"openCorpus": "ModelTraining/ClipboardSemantics/open-training-corpus.jsonl",
"reason": "Surrogate feature weights are not deployable NLModel assets and cannot bypass the existing macOS acceptance policy.",
"requiredCommands": [
"python3 Scripts/clipboard_semantics/generate_open_training_corpus.py",
"xcrun swift Scripts/clipboard_semantics/train_models.swift --algorithms maxEnt --corpus ModelTraining/ClipboardSemantics/combined-training-corpus.jsonl",
"xcrun swift Scripts/clipboard_semantics/evaluate_random_holdout.swift --corpus ModelTraining/ClipboardSemantics/random-holdout-corpus.jsonl"
],
"schemaVersion": 1,
"seed": 20260827,
"selectedRound": 1,
"selectedRoundsByIntent": {
"blessing": 19,
"complaint": 1,
"confirmationDecision": 3,
"followUpReminder": 1,
"invitation": 1,
"question": 1,
"replyableMessage": 1,
"scheduleNegotiation": 7,
"task": 15
},
"thresholds": {
"blessing": {
"abstained": true,
"byLanguage": {
"en": {
"abstained": true,
"metrics": {
"f1": 0.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 0.0,
"predictedPositive": 0,
"recall": 0.0,
"total": 0,
"trueNegative": 0,
"truePositive": 0,
"wilsonPrecisionLower95": 0
},
"threshold": 1.0
},
"zh-Hans": {
"abstained": true,
"metrics": {
"f1": 0.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 0.0,
"predictedPositive": 0,
"recall": 0.0,
"total": 0,
"trueNegative": 0,
"truePositive": 0,
"wilsonPrecisionLower95": 0
},
"threshold": 1.0
}
},
"metrics": {
"f1": 0.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 0.0,
"predictedPositive": 0,
"recall": 0.0,
"total": 0,
"trueNegative": 0,
"truePositive": 0,
"wilsonPrecisionLower95": 0
},
"threshold": 1.0
},
"complaint": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 1.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 1.0,
"predictedPositive": 180,
"recall": 1.0,
"total": 1485,
"trueNegative": 1305,
"truePositive": 180,
"wilsonPrecisionLower95": 0.9791
},
"threshold": 0.5
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.9526,
"falseNegative": 9,
"falsePositive": 8,
"precision": 0.9553,
"predictedPositive": 179,
"recall": 0.95,
"total": 1485,
"trueNegative": 1297,
"truePositive": 171,
"wilsonPrecisionLower95": 0.9143
},
"threshold": 0.54
}
},
"metrics": {
"f1": 0.9764,
"falseNegative": 9,
"falsePositive": 8,
"precision": 0.9777,
"predictedPositive": 359,
"recall": 0.975,
"total": 2970,
"trueNegative": 2602,
"truePositive": 351,
"wilsonPrecisionLower95": 0.9567
},
"threshold": 0.54
},
"confirmationDecision": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.9727,
"falseNegative": 1,
"falsePositive": 4,
"precision": 0.957,
"predictedPositive": 93,
"recall": 0.9889,
"total": 1485,
"trueNegative": 1391,
"truePositive": 89,
"wilsonPrecisionLower95": 0.8946
},
"threshold": 0.585
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.7815,
"falseNegative": 31,
"falsePositive": 2,
"precision": 0.9672,
"predictedPositive": 61,
"recall": 0.6556,
"total": 1485,
"trueNegative": 1393,
"truePositive": 59,
"wilsonPrecisionLower95": 0.8881
},
"threshold": 0.5
}
},
"metrics": {
"f1": 0.8701,
"falseNegative": 36,
"falsePositive": 7,
"precision": 0.9536,
"predictedPositive": 151,
"recall": 0.8,
"total": 2970,
"trueNegative": 2783,
"truePositive": 144,
"wilsonPrecisionLower95": 0.9074
},
"threshold": 0.555
},
"followUpReminder": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.8554,
"falseNegative": 41,
"falsePositive": 6,
"precision": 0.9586,
"predictedPositive": 145,
"recall": 0.7722,
"total": 1485,
"trueNegative": 1299,
"truePositive": 139,
"wilsonPrecisionLower95": 0.9127
},
"threshold": 0.83
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.8354,
"falseNegative": 48,
"falsePositive": 4,
"precision": 0.9706,
"predictedPositive": 136,
"recall": 0.7333,
"total": 1485,
"trueNegative": 1301,
"truePositive": 132,
"wilsonPrecisionLower95": 0.9268
},
"threshold": 0.505
}
},
"metrics": {
"f1": 0.7994,
"falseNegative": 113,
"falsePositive": 11,
"precision": 0.9574,
"predictedPositive": 258,
"recall": 0.6861,
"total": 2970,
"trueNegative": 2599,
"truePositive": 247,
"wilsonPrecisionLower95": 0.9253
},
"threshold": 0.815
},
"invitation": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.8302,
"falseNegative": 24,
"falsePositive": 3,
"precision": 0.9565,
"predictedPositive": 69,
"recall": 0.7333,
"total": 1485,
"trueNegative": 1392,
"truePositive": 66,
"wilsonPrecisionLower95": 0.8798
},
"threshold": 0.935
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.6765,
"falseNegative": 44,
"falsePositive": 0,
"precision": 1.0,
"predictedPositive": 46,
"recall": 0.5111,
"total": 1485,
"trueNegative": 1395,
"truePositive": 46,
"wilsonPrecisionLower95": 0.9229
},
"threshold": 0.505
}
},
"metrics": {
"f1": 0.5476,
"falseNegative": 111,
"falsePositive": 3,
"precision": 0.9583,
"predictedPositive": 72,
"recall": 0.3833,
"total": 2970,
"trueNegative": 2787,
"truePositive": 69,
"wilsonPrecisionLower95": 0.8845
},
"threshold": 0.935
},
"question": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.8445,
"falseNegative": 76,
"falsePositive": 12,
"precision": 0.9522,
"predictedPositive": 251,
"recall": 0.7587,
"total": 1485,
"trueNegative": 1158,
"truePositive": 239,
"wilsonPrecisionLower95": 0.9183
},
"threshold": 0.725
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.8536,
"falseNegative": 76,
"falsePositive": 6,
"precision": 0.9755,
"predictedPositive": 245,
"recall": 0.7587,
"total": 1485,
"trueNegative": 1164,
"truePositive": 239,
"wilsonPrecisionLower95": 0.9476
},
"threshold": 0.5
}
},
"metrics": {
"f1": 0.8729,
"falseNegative": 122,
"falsePositive": 26,
"precision": 0.9513,
"predictedPositive": 534,
"recall": 0.8063,
"total": 2970,
"trueNegative": 2314,
"truePositive": 508,
"wilsonPrecisionLower95": 0.9296
},
"threshold": 0.515
},
"replyableMessage": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.948,
"falseNegative": 52,
"falsePositive": 46,
"precision": 0.951,
"predictedPositive": 939,
"recall": 0.945,
"total": 1485,
"trueNegative": 494,
"truePositive": 893,
"wilsonPrecisionLower95": 0.9353
},
"threshold": 0.7
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.9424,
"falseNegative": 62,
"falsePositive": 46,
"precision": 0.9505,
"predictedPositive": 929,
"recall": 0.9344,
"total": 1485,
"trueNegative": 494,
"truePositive": 883,
"wilsonPrecisionLower95": 0.9346
},
"threshold": 0.695
}
},
"metrics": {
"f1": 0.9454,
"falseNegative": 115,
"falsePositive": 90,
"precision": 0.9517,
"predictedPositive": 1865,
"recall": 0.9392,
"total": 2970,
"trueNegative": 990,
"truePositive": 1775,
"wilsonPrecisionLower95": 0.9411
},
"threshold": 0.7
},
"scheduleNegotiation": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 1.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 1.0,
"predictedPositive": 45,
"recall": 1.0,
"total": 1485,
"trueNegative": 1440,
"truePositive": 45,
"wilsonPrecisionLower95": 0.9213
},
"threshold": 0.66
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 1.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 1.0,
"predictedPositive": 45,
"recall": 1.0,
"total": 1485,
"trueNegative": 1440,
"truePositive": 45,
"wilsonPrecisionLower95": 0.9213
},
"threshold": 0.55
}
},
"metrics": {
"f1": 1.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 1.0,
"predictedPositive": 90,
"recall": 1.0,
"total": 2970,
"trueNegative": 2880,
"truePositive": 90,
"wilsonPrecisionLower95": 0.9591
},
"threshold": 0.66
},
"task": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.8593,
"falseNegative": 79,
"falsePositive": 13,
"precision": 0.9558,
"predictedPositive": 294,
"recall": 0.7806,
"total": 1485,
"trueNegative": 1112,
"truePositive": 281,
"wilsonPrecisionLower95": 0.9258
},
"threshold": 0.98
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.8166,
"falseNegative": 104,
"falsePositive": 11,
"precision": 0.9588,
"predictedPositive": 267,
"recall": 0.7111,
"total": 1485,
"trueNegative": 1114,
"truePositive": 256,
"wilsonPrecisionLower95": 0.9277
},
"threshold": 0.96
}
},
"metrics": {
"f1": 0.8434,
"falseNegative": 176,
"falsePositive": 26,
"precision": 0.9544,
"predictedPositive": 570,
"recall": 0.7556,
"total": 2970,
"trueNegative": 2224,
"truePositive": 544,
"wilsonPrecisionLower95": 0.934
},
"threshold": 0.965
}
}
}
ModelTraining/ClipboardSemantics/IterativeResearch/macos-replay.json
-481
View File
@@ -1,481 +0,0 @@
{
"automaticPromotionAllowed": false,
"baseCorpus": "ModelTraining/ClipboardSemantics/clipboard_semantic_corpus.jsonl",
"configuration": {
"alpha": 2e-05,
"augmentation": "none",
"char_max": 5,
"char_min": 2,
"external_weight": 0.5700000000000001,
"hard_example_weight": 1.0,
"l1_ratio": 0.0,
"max_char_features": 45000,
"max_word_features": 22000,
"min_df": 2,
"pseudo_weight": 0.16499999999999998,
"round": 1,
"word_max": 2
},
"openCorpus": "ModelTraining/ClipboardSemantics/open-training-corpus.jsonl",
"reason": "Surrogate feature weights are not deployable NLModel assets and cannot bypass the existing macOS acceptance policy.",
"requiredCommands": [
"python3 Scripts/clipboard_semantics/generate_open_training_corpus.py",
"xcrun swift Scripts/clipboard_semantics/train_models.swift --algorithms maxEnt --corpus ModelTraining/ClipboardSemantics/combined-training-corpus.jsonl",
"xcrun swift Scripts/clipboard_semantics/evaluate_random_holdout.swift --corpus ModelTraining/ClipboardSemantics/random-holdout-corpus.jsonl"
],
"schemaVersion": 1,
"seed": 20260827,
"selectedRound": 1,
"thresholds": {
"blessing": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.9318,
"falseNegative": 4,
"falsePositive": 2,
"precision": 0.9535,
"predictedPositive": 43,
"recall": 0.9111,
"total": 1485,
"trueNegative": 1438,
"truePositive": 41,
"wilsonPrecisionLower95": 0.8454
},
"threshold": 0.915
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.7568,
"falseNegative": 17,
"falsePositive": 1,
"precision": 0.9655,
"predictedPositive": 29,
"recall": 0.6222,
"total": 1485,
"trueNegative": 1439,
"truePositive": 28,
"wilsonPrecisionLower95": 0.8282
},
"threshold": 0.9
}
},
"metrics": {
"f1": 0.8375,
"falseNegative": 23,
"falsePositive": 3,
"precision": 0.9571,
"predictedPositive": 70,
"recall": 0.7444,
"total": 2970,
"trueNegative": 2877,
"truePositive": 67,
"wilsonPrecisionLower95": 0.8814
},
"threshold": 0.915
},
"complaint": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 1.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 1.0,
"predictedPositive": 180,
"recall": 1.0,
"total": 1485,
"trueNegative": 1305,
"truePositive": 180,
"wilsonPrecisionLower95": 0.9791
},
"threshold": 0.5
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.9526,
"falseNegative": 9,
"falsePositive": 8,
"precision": 0.9553,
"predictedPositive": 179,
"recall": 0.95,
"total": 1485,
"trueNegative": 1297,
"truePositive": 171,
"wilsonPrecisionLower95": 0.9143
},
"threshold": 0.54
}
},
"metrics": {
"f1": 0.9764,
"falseNegative": 9,
"falsePositive": 8,
"precision": 0.9777,
"predictedPositive": 359,
"recall": 0.975,
"total": 2970,
"trueNegative": 2602,
"truePositive": 351,
"wilsonPrecisionLower95": 0.9567
},
"threshold": 0.54
},
"confirmationDecision": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.8848,
"falseNegative": 17,
"falsePositive": 2,
"precision": 0.9733,
"predictedPositive": 75,
"recall": 0.8111,
"total": 1485,
"trueNegative": 1393,
"truePositive": 73,
"wilsonPrecisionLower95": 0.9079
},
"threshold": 0.5
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.7947,
"falseNegative": 30,
"falsePositive": 1,
"precision": 0.9836,
"predictedPositive": 61,
"recall": 0.6667,
"total": 1485,
"trueNegative": 1394,
"truePositive": 60,
"wilsonPrecisionLower95": 0.9128
},
"threshold": 0.5
}
},
"metrics": {
"f1": 0.8418,
"falseNegative": 47,
"falsePositive": 3,
"precision": 0.9779,
"predictedPositive": 136,
"recall": 0.7389,
"total": 2970,
"trueNegative": 2787,
"truePositive": 133,
"wilsonPrecisionLower95": 0.9372
},
"threshold": 0.5
},
"followUpReminder": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.8554,
"falseNegative": 41,
"falsePositive": 6,
"precision": 0.9586,
"predictedPositive": 145,
"recall": 0.7722,
"total": 1485,
"trueNegative": 1299,
"truePositive": 139,
"wilsonPrecisionLower95": 0.9127
},
"threshold": 0.83
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.8354,
"falseNegative": 48,
"falsePositive": 4,
"precision": 0.9706,
"predictedPositive": 136,
"recall": 0.7333,
"total": 1485,
"trueNegative": 1301,
"truePositive": 132,
"wilsonPrecisionLower95": 0.9268
},
"threshold": 0.505
}
},
"metrics": {
"f1": 0.7994,
"falseNegative": 113,
"falsePositive": 11,
"precision": 0.9574,
"predictedPositive": 258,
"recall": 0.6861,
"total": 2970,
"trueNegative": 2599,
"truePositive": 247,
"wilsonPrecisionLower95": 0.9253
},
"threshold": 0.815
},
"invitation": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.8302,
"falseNegative": 24,
"falsePositive": 3,
"precision": 0.9565,
"predictedPositive": 69,
"recall": 0.7333,
"total": 1485,
"trueNegative": 1392,
"truePositive": 66,
"wilsonPrecisionLower95": 0.8798
},
"threshold": 0.935
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.6765,
"falseNegative": 44,
"falsePositive": 0,
"precision": 1.0,
"predictedPositive": 46,
"recall": 0.5111,
"total": 1485,
"trueNegative": 1395,
"truePositive": 46,
"wilsonPrecisionLower95": 0.9229
},
"threshold": 0.505
}
},
"metrics": {
"f1": 0.5476,
"falseNegative": 111,
"falsePositive": 3,
"precision": 0.9583,
"predictedPositive": 72,
"recall": 0.3833,
"total": 2970,
"trueNegative": 2787,
"truePositive": 69,
"wilsonPrecisionLower95": 0.8845
},
"threshold": 0.935
},
"question": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.8445,
"falseNegative": 76,
"falsePositive": 12,
"precision": 0.9522,
"predictedPositive": 251,
"recall": 0.7587,
"total": 1485,
"trueNegative": 1158,
"truePositive": 239,
"wilsonPrecisionLower95": 0.9183
},
"threshold": 0.725
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.8536,
"falseNegative": 76,
"falsePositive": 6,
"precision": 0.9755,
"predictedPositive": 245,
"recall": 0.7587,
"total": 1485,
"trueNegative": 1164,
"truePositive": 239,
"wilsonPrecisionLower95": 0.9476
},
"threshold": 0.5
}
},
"metrics": {
"f1": 0.8729,
"falseNegative": 122,
"falsePositive": 26,
"precision": 0.9513,
"predictedPositive": 534,
"recall": 0.8063,
"total": 2970,
"trueNegative": 2314,
"truePositive": 508,
"wilsonPrecisionLower95": 0.9296
},
"threshold": 0.515
},
"replyableMessage": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.948,
"falseNegative": 52,
"falsePositive": 46,
"precision": 0.951,
"predictedPositive": 939,
"recall": 0.945,
"total": 1485,
"trueNegative": 494,
"truePositive": 893,
"wilsonPrecisionLower95": 0.9353
},
"threshold": 0.7
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.9424,
"falseNegative": 62,
"falsePositive": 46,
"precision": 0.9505,
"predictedPositive": 929,
"recall": 0.9344,
"total": 1485,
"trueNegative": 494,
"truePositive": 883,
"wilsonPrecisionLower95": 0.9346
},
"threshold": 0.695
}
},
"metrics": {
"f1": 0.9454,
"falseNegative": 115,
"falsePositive": 90,
"precision": 0.9517,
"predictedPositive": 1865,
"recall": 0.9392,
"total": 2970,
"trueNegative": 990,
"truePositive": 1775,
"wilsonPrecisionLower95": 0.9411
},
"threshold": 0.7
},
"scheduleNegotiation": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 1.0,
"falseNegative": 0,
"falsePositive": 0,
"precision": 1.0,
"predictedPositive": 45,
"recall": 1.0,
"total": 1485,
"trueNegative": 1440,
"truePositive": 45,
"wilsonPrecisionLower95": 0.9213
},
"threshold": 0.5
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.967,
"falseNegative": 1,
"falsePositive": 2,
"precision": 0.9565,
"predictedPositive": 46,
"recall": 0.9778,
"total": 1485,
"trueNegative": 1438,
"truePositive": 44,
"wilsonPrecisionLower95": 0.8547
},
"threshold": 0.93
}
},
"metrics": {
"f1": 0.978,
"falseNegative": 1,
"falsePositive": 3,
"precision": 0.9674,
"predictedPositive": 92,
"recall": 0.9889,
"total": 2970,
"trueNegative": 2877,
"truePositive": 89,
"wilsonPrecisionLower95": 0.9085
},
"threshold": 0.91
},
"task": {
"abstained": false,
"byLanguage": {
"en": {
"abstained": false,
"metrics": {
"f1": 0.8403,
"falseNegative": 89,
"falsePositive": 14,
"precision": 0.9509,
"predictedPositive": 285,
"recall": 0.7528,
"total": 1485,
"trueNegative": 1111,
"truePositive": 271,
"wilsonPrecisionLower95": 0.9192
},
"threshold": 0.835
},
"zh-Hans": {
"abstained": false,
"metrics": {
"f1": 0.8278,
"falseNegative": 98,
"falsePositive": 11,
"precision": 0.9597,
"predictedPositive": 273,
"recall": 0.7278,
"total": 1485,
"trueNegative": 1114,
"truePositive": 262,
"wilsonPrecisionLower95": 0.9293
},
"threshold": 0.745
}
},
"metrics": {
"f1": 0.8637,
"falseNegative": 153,
"falsePositive": 26,
"precision": 0.9562,
"predictedPositive": 593,
"recall": 0.7875,
"total": 2970,
"trueNegative": 2224,
"truePositive": 567,
"wilsonPrecisionLower95": 0.9365
},
"threshold": 0.755
}
}
}
ModelTraining/ClipboardSemantics/IterativeResearch/research-summary.json
-129
View File
@@ -1,129 +0,0 @@
{
"schemaVersion": 1,
"completedResearchRounds": 60,
"requestedCoreRounds": 20,
"seed": 20260827,
"data": {
"baseTrainingRecords": 11500,
"reachableLicensedOpenRecords": 3845,
"holdoutOverlapCounts": {
"comprehensiveOnline": 0,
"random": 0,
"targetedRelease": 0
},
"unavailableSources": [
"MASSIVE",
"CLINC150",
"CFPB"
]
},
"phases": [
{
"name": "shared-configuration-search",
"rounds": 20,
"selectedRound": 1,
"golden": {
"macroPrecision": 0.9366,
"macroRecall": 0.6801,
"macroF1": 0.7711
},
"randomHoldout": {
"macroPrecision": 0.8569,
"macroRecall": 0.4603,
"macroF1": 0.5709
},
"researchOnlyComprehensive": {
"macroPrecision": 0.4398,
"macroRecall": 0.2161,
"macroF1": 0.2383
},
"targetedRelease": {
"macroPrecision": 0.5489,
"macroRecall": 0.3139,
"macroF1": 0.3899
}
},
{
"name": "per-intent-fine-tuning",
"rounds": 20,
"selectedRoundsByIntent": {
"blessing": 19,
"complaint": 1,
"confirmationDecision": 3,
"followUpReminder": 1,
"invitation": 1,
"question": 1,
"replyableMessage": 1,
"scheduleNegotiation": 7,
"task": 15
},
"golden": {
"macroPrecision": 0.9377,
"macroRecall": 0.6819,
"macroF1": 0.7666
},
"randomHoldout": {
"macroPrecision": 0.8701,
"macroRecall": 0.4705,
"macroF1": 0.5770
},
"researchOnlyComprehensive": {
"macroPrecision": 0.4292,
"macroRecall": 0.2250,
"macroF1": 0.2645
},
"targetedRelease": {
"macroPrecision": 0.5467,
"macroRecall": 0.3375,
"macroF1": 0.4095
}
},
{
"name": "explicit-evidence-fine-tuning",
"rounds": 20,
"selectedRound": 1,
"golden": {
"macroPrecision": 0.9877,
"macroRecall": 0.4354,
"macroF1": 0.5476
},
"randomHoldout": {
"macroPrecision": 0.7731,
"macroRecall": 0.3029,
"macroF1": 0.3905
},
"researchOnlyComprehensive": {
"macroPrecision": 0.6097,
"macroRecall": 0.1647,
"macroF1": 0.2325
},
"targetedRelease": {
"macroPrecision": 0.5489,
"macroRecall": 0.2537,
"macroF1": 0.3209
}
}
],
"currentDeployedReference": {
"randomHoldout": {
"macroPrecision": 0.9832,
"macroRecall": 0.6557,
"macroF1": 0.7669
},
"researchOnlyComprehensive": {
"macroPrecision": 0.2948,
"macroRecall": 0.3320,
"macroF1": 0.2783
}
},
"findings": [
"The first low-complexity round generalized better than later self-training rounds.",
"Three-round high-confidence pseudo-labeling amplified source and template bias instead of improving frozen regressions.",
"Per-intent configuration selection improved the research-only comprehensive F1 from 0.2383 to 0.2645 but remained below the deployed reference F1 of 0.2783.",
"Explicit evidence gates raised golden precision to 0.9877 and research-only precision to 0.6097, but recall collapsed and the release gate still failed.",
"No surrogate candidate is eligible to replace or augment the deployed Apple models."
],
"releaseGatePassed": false,
"deploymentDecision": "retain-current-deployed-models",
"platformLimitation": "Linux cannot train, compile, run, or benchmark the deployable Apple Create ML models. These rounds are surrogate research and produce a macOS replay specification, not app-ready model assets."
}
ModelTraining/ClipboardSemantics/README.md
+23 -414
View File
@@ -5,439 +5,48 @@ for OSGKeyboard's fully local clipboard analyzer.
## Scope
The model suite predicts nine independent intents (`task`, `question`,
`invitation`, `complaint`, `scheduleNegotiation`, `confirmationDecision`,
`followUpReminder`, `blessing`, and `replyableMessage`) plus three-way sentiment.
The model suite predicts five independent intents (`task`, `question`,
`invitation`, `complaint`, and `replyableMessage`) plus three-way sentiment.
`replyableMessage` distinguishes messages that invite a response from terminal
acknowledgments, personal notes, quoted questions, and factual notices. Apple
data detectors remain responsible for dates, addresses, phone numbers, and
URLs; `NLTagger` provides best-effort person and organization names.
The generated base corpus contains 17,692 Chinese and English records:
The corpus contains 7,272 Chinese and English records:
- 11,500 generated training records
- 2,970 generated validation records
- 2,970 template-held-out test records
- 252 manually authored golden records
- 4,660 generated training records
- 1,260 generated validation records
- 1,260 template-held-out test records
- 92 manually authored golden records
The generator reserves golden text before expansion, keeps template families
strictly split, and rejects duplicate IDs/text, cross-split text leakage,
unsupported labels, insufficient bilingual golden coverage, and content that
resembles direct contact data or credentials. No user clipboard content is
included.
## Taxonomy v6 candidate contract
The deployed models above remain the historical nine-intent suite. The next
corpus taxonomy is defined by
`Consensus/labeling-instructions-v6.md`: it retains `task`, `question`,
`invitation`, `complaint`, `scheduleNegotiation`, `confirmationDecision`,
`followUpReminder`, `blessing`, and `replyableMessage`, then adds
`assistantCommand`, `informationQuery`, and `systemNotification`. Assistant,
search, and machine-notification text is therefore preserved as explicit
routing data instead of being flattened into legacy negatives or discarded.
Every record also receives one primary domain or `unknown`: `finance`,
`travel`, `calendar`, `communication`, `media`, `smartHome`, `shopping`,
`dining`, `health`, `weather`, `accountService`, or `generalKnowledge`.
`Consensus/adjudication-instructions-v5.md` defines evidence-based resolution
for the expanded fields while retaining the existing queue format.
Intent values remain three-state: `true`, `false`, or `unknown`.
`knownLabels` lists only fields the source actually annotates after an audited
mapping; an absent field is unknown and contributes neither a positive nor a
negative training example. External sources may produce candidates only from a
pinned upstream official `train` split under documented commercial-use terms.
Upstream dev/validation/test data and every local frozen holdout are barred from
training, including normalized near-duplicates.
`chinese-corpus-candidate-audit-v1.json` records the first versioned source
decision. MASSIVE, CrossWOZ, BiToD, MultiDoGO, Taskmaster-1, SNIPS, MInDS-14,
GoEmotions, ASAP, Restaurant8k, and FormosaNLU are admitted to the candidate
audit pipeline subject to their per-source conditions. BANKING77, ABCD,
MultiWOZ, CLINC150, CFPB, `openclaw-zh-greetings`, and LCCC remain quarantined.
Admission is not automatic commercial training approval: revision pinning,
license evidence, attribution, privacy/content review, deterministic mapping,
and holdout deduplication still apply.
Synthetic records are train-only, retain generation and upstream provenance,
use a sample weight no greater than `0.25`, and declare only contractually known
fields. They never enter calibration, evaluation, human gold, or policy-anchor
sets and cannot override conflicting human or licensed non-synthetic evidence.
No user clipboard content is included.
## Reproduce
```bash
python3 Scripts/clipboard_semantics/generate_corpus.py
xcrun swift Scripts/clipboard_semantics/train_models.swift --algorithms maxEnt
python3 Scripts/clipboard_semantics/apply_deployment_policy.py
xcrun swift Scripts/clipboard_semantics/train_models.swift
```
The trainer deterministically balances labels with classifier-specific hard
negatives, trains ten self-contained maxEnt models, calibrates high-precision
global and per-language thresholds on validation data, writes detailed errors
to `evaluation-report.json`, and copies the selected models into
`OSGKeyboardShared/Resources/ClipboardSemantics`. The deployment-policy step
applies thresholds reviewed on the separate development holdout and restores
the preserved schedule-negotiation model, which remained stronger than its
expanded-corpus replacement.
The targeted task/complaint round trains only those classifiers into a
candidate directory, then promotes the reviewed artifacts without replacing
the other eight deployed models:
```bash
xcrun swift Scripts/clipboard_semantics/train_models.swift \
--algorithms maxEnt --classifiers task,complaint \
--candidate-directory /tmp/osg-targeted-candidates \
--resource-directory /tmp/osg-targeted-resources \
--report /tmp/osg-targeted-training-report.json
python3 Scripts/clipboard_semantics/apply_deployment_policy.py \
--candidate-resource-directory /tmp/osg-targeted-resources \
--promote-classifier task --promote-classifier complaint
```
## Licensed open-data training
The reproducible open-data supplement uses official training splits from
MASSIVE, CrossWOZ, GoEmotions, MultiDoGO, Taskmaster-1, CLINC150, CFPB,
and ASAP. It also includes the MIT-licensed `openclaw-zh-greetings` labels and
the pinned MIT blessing templates from `SWHL/WeChat-AutoSendBless`:
```bash
python3 Scripts/clipboard_semantics/generate_open_training_corpus.py
xcrun swift Scripts/clipboard_semantics/train_models.swift \
--algorithms maxEnt \
--corpus ModelTraining/ClipboardSemantics/combined-training-corpus.jsonl \
--candidate-directory ModelTraining/ClipboardSemantics/baselines/open-data/Candidates \
--resource-directory ModelTraining/ClipboardSemantics/baselines/open-data \
--report ModelTraining/ClipboardSemantics/baselines/open-data/training-report.json
```
`open-training-sources.json` pins source revisions and licenses. Each external
record declares `knownLabels`; classifiers ignore labels that the source did
not annotate instead of treating them as negatives. The generator removes
normalized text found in any frozen `*holdout-corpus.jsonl` and leaves the base
validation, test, and golden splits unchanged. Deleted, non-commercial,
license-unclear, ShareAlike-pending, and holdout-only sources are excluded.
CPED is also excluded because the repository license does not establish
commercial rights to the underlying television dialogue; synthetic blessing
datasets without a clear per-record rights chain are excluded as well.
## Broad blessing supplement
`blessing-labeling-guidelines.md` defines the broad product boundary. The
dedicated generator creates equal numbers of positive examples and difficult
negatives such as greeting-only, blessing requests, received thanks,
celebration mentions, quotations, reported wishes, and sarcasm:
```bash
python3 Scripts/clipboard_semantics/generate_blessing_training_corpus.py \
--records-per-language 50000
```
Every generated record declares only `blessing` in `knownLabels`, so unknown
clipboard intents are not treated as false. The generator rejects normalized
base-corpus and frozen-holdout overlap, duplicate text, and common PII shapes.
LCCC may be mined only as an isolated research queue. Although its dataset card
declares MIT, the official CDial-GPT README limits the dataset and pretrained
models to research use. Its source is crawled Weibo dialogue without a complete
underlying content-rights or privacy chain. Download LCCC-base from the official
CDial-GPT link or the `silver/lccc` Hugging Face mirror, then run:
```bash
python3 Scripts/clipboard_semantics/extract_lccc_blessing_candidates.py \
/path/to/LCCC-base.zip \
--output /tmp/lccc-blessing-candidates.jsonl \
--manifest /tmp/lccc-blessing-candidates-manifest.json
```
The resulting unreviewed records are research-only and must not be merged into
a commercial training corpus without legal, privacy, and manual label review.
## Blessing benchmark review
Prepare a blind queue with 3,000 Chinese and 1,500 English records from the
frozen comprehensive holdout:
```bash
python3 Scripts/clipboard_semantics/prepare_blessing_benchmark.py
```
Two different people independently complete `annotator-a.jsonl` and
`annotator-b.jsonl` without seeing `sealed-provenance.jsonl`. Finalization is
strict: incomplete labels, duplicate IDs, reused annotator identity, and
unadjudicated disagreement are fatal.
```bash
python3 Scripts/clipboard_semantics/finalize_blessing_benchmark.py \
--annotator-a-id reviewer-a \
--annotator-b-id reviewer-b
```
`BlessingBenchmark/README.md` defines the stable positive and negative boundary
categories. The finalized calibration/test benchmark remains evaluation-only
and must never enter a training corpus.
## Consensus silver data and joint verifiers
The corpus registry combines the preserved historical product corpus, current
and scaled product generators, licensed open data, and project-owned blessing
data without flattening provenance:
```bash
python3 Scripts/clipboard_semantics/build_corpus_registry.py
```
`corpus-registry-sources.json` is the source-of-truth inventory. Exact duplicate
texts retain every source claim, while any occurrence in calibration or frozen
evaluation data globally bars that text from training. Labels use three states:
`true`, `false`, and `unknown`; a missing source annotation is never converted
to a negative label. LCCC and other research-only or unclear-rights sources are
explicitly excluded.
The v2 blind-labeling pilot samples 1,000 distinct near-duplicate clusters.
Three primary models label every record without seeing source labels. Any
non-unanimous record is sent, still blind, to two review models:
```bash
python3 Scripts/clipboard_semantics/merge_consensus_labels_v2.py \
prepare-review \
--queue ModelTraining/ClipboardSemantics/CorpusRegistry/labeling-pilot.jsonl \
--primary sol=/path/to/primary-sol.jsonl \
--primary grok=/path/to/primary-grok.jsonl \
--primary codex=/path/to/primary-codex.jsonl \
--output /path/to/review-queue.jsonl \
--report /path/to/review-report.json
```
Primary unanimity produces Tier A silver data. Reviewed records require at
least four of five votes for every intent and sentiment field to produce Tier B
silver data at lower training weight. Remaining conflicts, ambiguity, and
positive quoted/meta cases enter a human adjudication queue and never train
automatically. `Consensus/labeling-instructions-v2.md` defines the shared
taxonomy and strict output schema.
The frozen 2026-08-28 pilot used Sol, Grok, and Luna as primary labelers, then
Composer and Claude for blind conflict review. Of 1,000
records, 81 reached Tier A, 290 reached Tier B, and 629 entered human review.
The 0.80 per-language/per-field kappa gate failed, so this pilot is not eligible
for automatic scale-up or model training. `replyableMessage`, `task`,
`question`, and Chinese coordination/blessing boundaries require adjudication
and instruction refinement first.
The 629 unresolved records were then reviewed independently by Claude and Grok
using `Consensus/adjudication-instructions-v1.md`. A record reaches Tier C only
when both adjudicators select the same non-unknown value for every unresolved
field, quote exact supporting text, and report confidence of at least 0.90.
Only 21 records passed; 608 remain unresolved. Tier C keeps a 0.35 sample weight
and remains silver data rather than human gold.
The 608-record remainder was then re-adjudicated with Sol 5.6 and Grok 4.6
using the product-approved boundaries in
`Consensus/labeling-instructions-v3.md` and the disposition-aware schema in
`Consensus/adjudication-instructions-v2.md`. The approved rules exclude clear
device/assistant commands, separate invitation questions from information
questions, treat self-reminders as follow-up only, treat first-person needs as
implicit tasks, require explicit dissatisfaction for complaints, and require
explicit wishes or congratulations for blessings. At the unchanged 0.90
two-model confidence gate, all seven policy-sensitive intent fields were
rechecked even when the old panel had agreed on them. In the final result, 202
additional records reached Tier C, 109 clear device/assistant commands were
isolated, and 297 remained unresolved. A
deterministic language/field/severity-stratified sample of 60 records is the
human product-policy acceptance set; the new silver data must not be promoted
until that sample reaches 95% accuracy. The original per-language/per-field
kappa gate still applies before full-corpus labeling can scale up.
The product owner subsequently labeled 30 high-information anchors for
`replyableMessage`, `task`, and `question`. These decisions are frozen in
`Consensus/product-policy-anchors-v1.json`, and the clarified taxonomy is
documented in `Consensus/labeling-instructions-v5.md`. On a blind replay, Grok
4.6 matched all 63 scored target-field decisions, while Luna 5.6 matched 62 of
63 (98.41%); both pass the 95% target-intent gate. Sol 5.6 was rejected for this
role because it forced low-information fragments into negative labels. The
target fields are eligible for focused re-adjudication, but the broader corpus
is still blocked by the independent ambiguity/disposition and kappa gates.
The original verifier pipeline remains available for reproducing its earlier
three-model study:
```bash
python3 Scripts/clipboard_semantics/generate_consensus_labels.py prepare
python3 Scripts/clipboard_semantics/generate_consensus_labels.py merge \
--labeler gpt=ModelTraining/ClipboardSemantics/Consensus/labeler-gpt.jsonl \
--labeler grok=ModelTraining/ClipboardSemantics/Consensus/labeler-grok.jsonl \
--labeler luna=ModelTraining/ClipboardSemantics/Consensus/labeler-luna.jsonl
xcrun swift Scripts/clipboard_semantics/train_verifiers.swift
```
The merge step preserves source license/revision, prompt version, labeler
confidence, votes, agreement, conflict reason, and Fleiss kappa. Accepted
records are separated into train, calibration, and frozen acceptance splits by
a stable near-duplicate signature, so slot variants cannot cross splits.
`train_verifiers.swift` trains two local maxEnt models:
- Action: `taskOnly`, `complaintOnly`, `both`, `questionRequest`, `neither`
- Coordination: `invitation`, `scheduleNegotiation`,
`confirmationDecision`, `followUpReminder`, `neither`
Candidate manifests use schema version 3 and record confidence plus top-1/top-2
margin thresholds by language. A verifier remains `shadow` unless every routed
label in English and Simplified Chinese has at least 100 acceptance predictions
at 95% consensus-relative precision. The runtime retains schema 1/2
compatibility, evaluates schema 3 shadow verifiers only after a Stage A
candidate, and stores only bounded aggregate disagreement counters without
clipboard text.
Without human-reviewed gold labels, these results measure agreement with the
model committee, not production truth. A passing verifier may enter shadow
deployment, but cannot be described as having 95% real-user precision.
## Iterative weakly supervised research
The portable research harness runs a fixed 20-round matrix over bilingual
character/word n-grams, sparse logistic classifiers, class balancing,
deterministic label-preserving augmentation, hard-example weighting, and
three-round high-confidence self-training consensus:
```bash
python3 -m pip install -r \
Scripts/clipboard_semantics/requirements-research.txt
python3 Scripts/clipboard_semantics/generate_open_training_corpus.py \
--allow-unavailable-sources
python3 Scripts/clipboard_semantics/run_iterative_retraining.py
```
The harness fits thresholds only on the generated validation split. Synthetic
test, golden, random, targeted-release, and comprehensive online corpora never
enter training or threshold calibration. Exact normalized overlap with every
frozen holdout is a fatal error.
The 2026-08-27 study completed the requested 20 rounds and two additional
20-round fine-tuning phases after the first phase missed its release target:
- The shared-configuration phase selected round 1. Random-holdout macro F1 was
`0.5709`; research-only comprehensive macro F1 was `0.2383`.
- Per-intent selection improved those values to `0.5770` and `0.2645`.
- Explicit evidence gates raised golden macro precision to `0.9877` and
research-only precision to `0.6097`, but reduced recall too severely.
- The current deployed reference remains stronger: random-holdout macro F1
`0.7669` and research-only comprehensive macro F1 `0.2783`.
All three phases failed the release gate, so no model was promoted. The compact
study summary and macOS replay instructions are stored under
`IterativeResearch/`; detailed round and evaluation JSON is reproducible and
gitignored.
This harness is deliberately a Linux surrogate. It cannot emit the
`NLModel`-compatible Create ML artifacts used by the keyboard extension.
Deployable training, Core ML compilation, simulator regression, latency, and
memory checks still require macOS with Xcode 26+. A surrogate result can
nominate a data/threshold policy for macOS replay, but cannot authorize
automatic deployment.
## Taxonomy v6 candidate result
The 2026-08-28 v6 run integrated 31,087 license-reviewed open-training
records, 7,200 low-weight bilingual boundary records, and 99 high-confidence
relabels from the former assistant-command exclusion queue. The registry
contains 327,337 canonical records and emits 273,626 train candidates. The
frozen 120-record bilingual product holdout has zero exact overlap with
training.
The additive maxEnt candidate trained `assistantCommand`, `informationQuery`,
`systemNotification`, and the 12-way `domain` classifier. Runtime performance
passed: the four models total 570,083 bytes, load in 49.30 ms, have 0.250 ms
maximum warm p95 latency, and add 25,001,984 bytes of peak RSS in the macOS
benchmark process.
Quality did not pass. Golden new-intent macro F1 is 0.5915, minimum intent
precision is 0.2500, and domain macro F1 is 0.3282, below the 0.90, 0.95, and
0.85 release gates. Only 60 blind records have product-owner labels; the
remaining v6 fields use per-field model consensus and are not human gold.
Therefore the candidate remains staging-only and the deployed models are not
replaced. See `v6-release-gate-report.json` for the machine-readable decision.
The trainer balances labels, trains maxEnt and BERT candidates, calibrates
high-precision thresholds, writes detailed errors to `evaluation-report.json`,
and copies the selected models into
`OSGKeyboardShared/Resources/ClipboardSemantics`.
## Deployment decision
Only maxEnt models are trained and deployed because they are self-contained in
the keyboard extension. Create ML BERT transfer models depend on
`NLContextualEmbedding` assets that are not guaranteed to exist in a simulator
or keyboard-extension runtime.
Only maxEnt models are eligible for keyboard automatic routing. Create ML BERT
transfer models depend on `NLContextualEmbedding` assets that are not guaranteed
to exist in a simulator or keyboard-extension runtime, so they remain evaluation
candidates only.
The deployed manifest remains schema version 2 until a candidate passes its
frozen acceptance gates. Schema version 3 adds optional joint verifiers,
per-language confidence thresholds, top-1/top-2 margins, and an explicit
`shadow` or `automatic` deployment mode. Schema version 4 adds the three
display-only public intent heads and optional domain classifier. Consumers
accept schema versions 1 through 4 and fall back to the current binary routing
behavior when newer classifiers are absent.
All ten deployed models pass the golden precision gate after deployment
policy is applied. The preserved six-model and first nine-model reports are
under `baselines`; `deployment-golden-report.json` records the final deployed
models and thresholds.
The selected intent models passed the automatic-routing precision gates. The
replyable-message model reached 100% test precision and 97.96% golden precision;
its measured recall remains part of release monitoring. The complaint model is
also high precision but remains conservative because golden recall is limited.
Sentiment returns `unknown` unless confidence and top-two margin checks both
pass.
Synthetic results are not treated as production truth. Real opt-in, anonymized
or manually reviewed examples are still required before widening labels or
lowering thresholds.
## Random holdout
The deployment models also have a reproducible random-combination holdout check
whose templates and vocabulary are separate from the training generator:
```bash
python3 Scripts/clipboard_semantics/generate_random_holdout.py
xcrun swift Scripts/clipboard_semantics/evaluate_random_holdout.swift
```
Seed `20260826` produces 680 records across 17 scenario families, split evenly
between English and Simplified Chinese. The corpus has zero exact-text overlap
with the training corpus. It is a development benchmark used for threshold
selection and is never consumed by `train_models.swift`.
The current development report reaches 0.9832 binary macro precision, 0.6557
recall, and 0.7669 macro F1. Runtime-gated sentiment macro F1 is 0.6994.
A separate focused acceptance profile is generated once with seed `20260827`:
```bash
python3 Scripts/clipboard_semantics/generate_random_holdout.py \
--profile fresh --seed 20260827 --samples-per-family 20
xcrun swift Scripts/clipboard_semantics/evaluate_random_holdout.swift \
--corpus ModelTraining/ClipboardSemantics/fresh-metric-holdout-corpus.jsonl \
--seed 20260827 \
--report ModelTraining/ClipboardSemantics/fresh-metric-holdout-report.json
```
This 480-record, zero-overlap holdout now serves as a focused development
benchmark. The deployed task model reaches 1.0000 precision and 0.7500 recall
on English records; complaint reaches 1.0000 precision and 0.6000 recall
overall.
Three later zero-overlap profiles exercise different task and complaint
wording. The final 640-record release gate (seed `20260830`) records 1.0000
precision for English task and complaint, with 0.4000 and 0.5375 recall
respectively. The preceding 600-record confirmation gate also records 1.0000
precision for both, with 0.3000 English-task recall and 0.6056 complaint
recall. This variation is intentional evidence that the 95% precision target
is met conservatively while English-task recall remains the next improvement
target.
At runtime, task results are suppressed when complaint confidence is at least
0.60 and the text contains no explicit assignment/request marker. The same
policy is applied by the holdout evaluator so reported task precision matches
the product behavior.
## Performance snapshot
The ten deployed source models retain the local-inference constraint; the
preserved six-model baseline totals 105,619 bytes. On an iPhone 17 Pro iOS 26.5 simulator, the
debug unit-test harness measured 98.8 ms for the first full analysis and
3.7 ms average across 20 warm analyses. Simulator process memory is not a
substitute for the keyboard extension's physical-device peak RSS; that remains
a release gate before widening automatic routing.
ModelTraining/ClipboardSemantics/VerifierCandidates/ActionIntentVerifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-blessing-v1/BlessingIntentClassifier.mlmodel → ModelTraining/ClipboardSemantics/VerifierCandidates/BlessingIntentClassifier.mlmodel
View File
ModelTraining/ClipboardSemantics/VerifierCandidates/ComplaintIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
OSGKeyboardShared/Resources/ClipboardSemantics/ConfirmationDecisionIntentClassifier.mlmodel → ModelTraining/ClipboardSemantics/VerifierCandidates/ConfirmationDecisionIntentClassifier.mlmodel
View File
ModelTraining/ClipboardSemantics/VerifierCandidates/ConversationalReplyIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/VerifierCandidates/CoordinationIntentVerifier.mlmodel
BIN
View File
Binary file not shown.
OSGKeyboardShared/Resources/ClipboardSemantics/FollowUpReminderIntentClassifier.mlmodel → ModelTraining/ClipboardSemantics/VerifierCandidates/FollowUpReminderIntentClassifier.mlmodel
View File
ModelTraining/ClipboardSemantics/VerifierCandidates/InvitationIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/VerifierCandidates/QuestionIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-26-nine-model-v1/ScheduleNegotiationIntentClassifier.mlmodel → ModelTraining/ClipboardSemantics/VerifierCandidates/ScheduleNegotiationIntentClassifier.mlmodel
View File
ModelTraining/ClipboardSemantics/VerifierCandidates/SentimentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/VerifierCandidates/TaskIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/clipboard-semantic-models.json → ModelTraining/ClipboardSemantics/VerifierCandidates/clipboard-semantic-models.json
+97 -45
View File
@@ -1,12 +1,12 @@
{
"classifiers" : [
{
"acceptedForAutomaticRouting" : false,
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.91,
"confidenceThreshold" : 0.88,
"confidenceThresholdsByLanguage" : {
"en" : 0.92,
"zh-Hans" : 0.91
"en" : 0.88,
"zh-Hans" : 0.72999999999999998
},
"id" : "task",
"labels" : [
@@ -19,10 +19,10 @@
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.99,
"confidenceThreshold" : 0.59999999999999998,
"confidenceThresholdsByLanguage" : {
"en" : 0.99,
"zh-Hans" : 0.99
"en" : 0.59999999999999998,
"zh-Hans" : 0.59999999999999998
},
"id" : "question",
"labels" : [
@@ -35,10 +35,10 @@
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.74,
"confidenceThreshold" : 0.81999999999999995,
"confidenceThresholdsByLanguage" : {
"en" : 0.76,
"zh-Hans" : 0.78
"en" : 0.84999999999999998,
"zh-Hans" : 0.81999999999999995
},
"id" : "invitation",
"labels" : [
@@ -51,10 +51,10 @@
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.7,
"confidenceThreshold" : 0.81999999999999995,
"confidenceThresholdsByLanguage" : {
"en" : 0.81,
"zh-Hans" : 0.75
"en" : 0.83999999999999997,
"zh-Hans" : 0.81999999999999995
},
"id" : "complaint",
"labels" : [
@@ -65,12 +65,12 @@
"positiveLabel" : "complaint"
},
{
"acceptedForAutomaticRouting" : false,
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.5,
"confidenceThreshold" : 0.68000000000000005,
"confidenceThresholdsByLanguage" : {
"en" : 0.5,
"zh-Hans" : 0.5
"en" : 0.68000000000000005,
"zh-Hans" : 0.53000000000000003
},
"id" : "scheduleNegotiation",
"labels" : [
@@ -83,10 +83,10 @@
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.99,
"confidenceThreshold" : 0.71999999999999997,
"confidenceThresholdsByLanguage" : {
"en" : 0.99,
"zh-Hans" : 0.99
"en" : 0.71999999999999997,
"zh-Hans" : 0.71999999999999997
},
"id" : "confirmationDecision",
"labels" : [
@@ -99,10 +99,10 @@
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.95,
"confidenceThreshold" : 0.72999999999999998,
"confidenceThresholdsByLanguage" : {
"en" : 0.95,
"zh-Hans" : 0.96
"en" : 0.72999999999999998,
"zh-Hans" : 0.72999999999999998
},
"id" : "followUpReminder",
"labels" : [
@@ -115,26 +115,10 @@
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.69,
"confidenceThreshold" : 0.75,
"confidenceThresholdsByLanguage" : {
"en" : 0.69,
"zh-Hans" : 0.77
},
"id" : "blessing",
"labels" : [
"notBlessing",
"blessing"
],
"modelFile" : "BlessingIntentClassifier.mlmodel",
"positiveLabel" : "blessing"
},
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.64,
"confidenceThresholdsByLanguage" : {
"en" : 0.64,
"zh-Hans" : 0.74
"en" : 0.75,
"zh-Hans" : 0.79000000000000004
},
"id" : "replyableMessage",
"labels" : [
@@ -154,9 +138,77 @@
"positive"
],
"modelFile" : "SentimentClassifier.mlmodel"
},
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.68999999999999995,
"confidenceThresholdsByLanguage" : {
"en" : 0.68999999999999995,
"zh-Hans" : 0.77000000000000002
},
"id" : "blessing",
"labels" : [
"notBlessing",
"blessing"
],
"modelFile" : "BlessingIntentClassifier.mlmodel",
"positiveLabel" : "blessing",
"trainedAt" : "2026-08-27T01:58:55Z",
"trainingCorpusRecordCount" : 17692
}
],
"corpusRecordCount" : 23918,
"generatedAt" : "2026-08-27T05:29:04Z",
"schemaVersion" : 2
"corpusRecordCount" : 13332,
"generatedAt" : "2026-08-26T15:18:57Z",
"schemaVersion" : 3,
"verifierGeneratedAt" : "2026-08-27T09:25:26Z",
"verifierLabelPolicy" : "multi-model-consensus-without-human-gold",
"verifiers" : [
{
"acceptedForAutomaticRouting" : false,
"confidenceThreshold" : 0.81999999999999995,
"confidenceThresholdsByLanguage" : {
"en" : 0.84999999999999998,
"zh-Hans" : 0.5
},
"deploymentMode" : "shadow",
"id" : "action",
"labels" : [
"taskOnly",
"complaintOnly",
"both",
"questionRequest",
"neither"
],
"minimumMargin" : 0,
"minimumMarginsByLanguage" : {
"en" : 0,
"zh-Hans" : 0
},
"modelFile" : "ActionIntentVerifier.mlmodel"
},
{
"acceptedForAutomaticRouting" : false,
"confidenceThreshold" : 0.5,
"confidenceThresholdsByLanguage" : {
"en" : 0.5,
"zh-Hans" : 1
},
"deploymentMode" : "shadow",
"id" : "coordination",
"labels" : [
"invitation",
"scheduleNegotiation",
"confirmationDecision",
"followUpReminder",
"neither"
],
"minimumMargin" : 0.45000000000000001,
"minimumMarginsByLanguage" : {
"en" : 0.45000000000000001,
"zh-Hans" : 1
},
"modelFile" : "CoordinationIntentVerifier.mlmodel"
}
]
}
ModelTraining/ClipboardSemantics/baselines/2026-08-22-six-model/README.md
-37
View File
@@ -1,37 +0,0 @@
# Six-model clipboard semantics baseline
This directory preserves the complete evaluation report that was deployed before
the three new intent classifiers were added. It is a metrics baseline, not a
second set of deployable model binaries.
- Report generated at: `2026-08-22T09:30:13Z`
- Corpus records: `7,272`
- Models: `task`, `question`, `invitation`, `complaint`, `replyableMessage`,
`sentiment`
- Manifest schema: `1`
- Report SHA-256:
`eaa3c2c3fe4151bd6585bfbe7404f848543e4b7321d9ba4376b9c872d2844fdd`
The original deployment manifest used these global thresholds:
- `task`: `0.60`
- `question`: `0.60`
- `invitation`: `0.77`
- `complaint`: `0.68`
- `replyableMessage`: `0.60`
- `sentiment`: no binary threshold
Deployed asset SHA-256 values:
```text
443ce5406a14e3b2051fb265caec116025ee8db088eff496dadb337535843b24 ComplaintIntentClassifier.mlmodel
b7e2266e0926daa9b37926170da200b150024edc55c6bd7644f4252ecaead07c ConversationalReplyIntentClassifier.mlmodel
e3b9391a5349a43eea511c2e3c7a6697f350510532dc4f190ef707a871a86125 InvitationIntentClassifier.mlmodel
eb0f57da2ea17abcb3847d7c318feb3f50fd0393ffd2ec57c93d9d59bc583dc3 QuestionIntentClassifier.mlmodel
3c7c849cb00163ae0b17d9444f2359aa5f1aecb6d9d65a945b91e9f1d09f9b6d SentimentClassifier.mlmodel
e4f465e1b62da6ad916e3af1be10d1c63487865134857145476143499af408db TaskIntentClassifier.mlmodel
722047dbe2df7d4f73d3f7d75cd8fbd9a05e47cb7fa5ec71cab2981a5b91c6ac clipboard-semantic-models.json
```
See `evaluation-report.json` in this directory for every aggregate,
per-language, and error-example metric from the baseline run.
ModelTraining/ClipboardSemantics/baselines/2026-08-22-six-model/evaluation-report.json
-840
View File
@@ -1,840 +0,0 @@
{
"classifiers" : [
{
"candidates" : [
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"balancedTrainingCount" : 1440,
"balancedValidationCount" : 360,
"binaryByLanguage" : {
"en" : {
"accuracy" : 0.9619,
"f1" : 0.8462,
"falseNegative" : 24,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.7333,
"total" : 630,
"trueNegative" : 540,
"truePositive" : 66
},
"zh-Hans" : {
"accuracy" : 0.9968,
"f1" : 0.9888,
"falseNegative" : 2,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.9778,
"total" : 630,
"trueNegative" : 540,
"truePositive" : 88
}
},
"goldenBinary" : {
"accuracy" : 0.9239,
"f1" : 0.6667,
"falseNegative" : 7,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.5,
"total" : 92,
"trueNegative" : 78,
"truePositive" : 7
},
"goldenFalseNegativeExamples" : [
"[en] Alex owns the meeting notes and should post them in the project channel today. (score=0.5481)",
"[en] Remember to correct the invoice name and submit it again. (score=0.3677)",
"[en] Would you book a meeting room for Wednesday afternoon? (score=0.4118)",
"[zh-Hans] 记得把发票抬头改好以后重新提交。 (score=0.4999)",
"[zh-Hans] 下一步先联系客户确认交付地址，再更新订单。 (score=0.1536)",
"[zh-Hans] 方便帮我约一下周三下午的会议室吗？ (score=0.2326)",
"[zh-Hans] 这些材料可以在月底前准备好吗？ (score=0.5621)"
],
"goldenFalsePositiveExamples" : [
],
"modelBytes" : 17299,
"runtimeAssetIndependent" : true,
"testBinary" : {
"accuracy" : 0.9794,
"f1" : 0.9222,
"falseNegative" : 26,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.8556,
"total" : 1260,
"trueNegative" : 1080,
"truePositive" : 154
},
"testFalseNegativeExamples" : [
"[en] The deadline is by the end of the month; make sure you complete the risk register. (score=0.2401)",
"[en] The deadline is by Friday; make sure you confirm the project timeline. (score=0.4156)",
"[en] The deadline is by Friday; make sure you contact the client. (score=0.3509)",
"[en] The deadline is after you receive this message; make sure you check the invoice details. (score=0.385)",
"[en] The deadline is before 3 PM; make sure you contact the client. (score=0.2883)",
"[en] The deadline is after you receive this message; make sure you send the meeting notes. (score=0.3594)",
"[en] The deadline is by Friday; make sure you summarize the test results. (score=0.3174)",
"[en] The deadline is this week; make sure you share the delivery plan. (score=0.0888)",
"[en] The deadline is tomorrow morning; make sure you share the delivery plan. (score=0.1542)",
"[en] The deadline is this week; make sure you update the quotation. (score=0.1379)",
"[en] The deadline is by the end of the month; make sure you update the quotation. (score=0.2238)",
"[en] The deadline is this week; make sure you confirm the project timeline. (score=0.1903)"
],
"testFalsePositiveExamples" : [
],
"threshold" : 0.6,
"validationBinary" : {
"accuracy" : 0.973,
"f1" : 0.8963,
"falseNegative" : 33,
"falsePositive" : 1,
"precision" : 0.9932,
"recall" : 0.8167,
"total" : 1260,
"trueNegative" : 1079,
"truePositive" : 147
}
}
],
"id" : "task",
"labels" : [
"notTask",
"task"
],
"positiveLabel" : "task",
"selectedAlgorithm" : "maxEnt",
"selectedModelFile" : "TaskIntentClassifier.mlmodel"
},
{
"candidates" : [
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"balancedTrainingCount" : 2880,
"balancedValidationCount" : 720,
"binaryByLanguage" : {
"en" : {
"accuracy" : 1,
"f1" : 1,
"falseNegative" : 0,
"falsePositive" : 0,
"precision" : 1,
"recall" : 1,
"total" : 630,
"trueNegative" : 450,
"truePositive" : 180
},
"zh-Hans" : {
"accuracy" : 0.9841,
"f1" : 0.9714,
"falseNegative" : 10,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.9444,
"total" : 630,
"trueNegative" : 450,
"truePositive" : 170
}
},
"goldenBinary" : {
"accuracy" : 0.9891,
"f1" : 0.9767,
"falseNegative" : 1,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.9545,
"total" : 92,
"trueNegative" : 70,
"truePositive" : 21
},
"goldenFalseNegativeExamples" : [
"[en] Support has not replied for three days. When will this be handled? (score=0.5261)"
],
"goldenFalsePositiveExamples" : [
],
"modelBytes" : 20231,
"runtimeAssetIndependent" : true,
"testBinary" : {
"accuracy" : 0.9921,
"f1" : 0.9859,
"falseNegative" : 10,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.9722,
"total" : 1260,
"trueNegative" : 900,
"truePositive" : 350
},
"testFalseNegativeExamples" : [
"[zh-Hans] 我需要明确答复：文件无法打开，你们准备如何解决？ (score=0.5267)",
"[zh-Hans] 我需要明确答复：订单被重复扣款，你们准备如何解决？ (score=0.5534)",
"[zh-Hans] 我需要明确答复：预约记录消失了，你们准备如何解决？ (score=0.3034)",
"[zh-Hans] 我需要明确答复：消息始终发不出去，你们准备如何解决？ (score=0.556)",
"[zh-Hans] 我需要明确答复：收到的商品有破损，你们准备如何解决？ (score=0.5209)",
"[zh-Hans] 我需要明确答复：页面加载特别慢，你们准备如何解决？ (score=0.5228)",
"[zh-Hans] 我需要明确答复：账号突然被锁定，你们准备如何解决？ (score=0.4902)",
"[zh-Hans] 我需要明确答复：应用一直闪退，你们准备如何解决？ (score=0.5513)",
"[zh-Hans] 我需要明确答复：数据同步失败，你们准备如何解决？ (score=0.4913)",
"[zh-Hans] 我需要明确答复：发票信息写错了，你们准备如何解决？ (score=0.3555)"
],
"testFalsePositiveExamples" : [
],
"threshold" : 0.6,
"validationBinary" : {
"accuracy" : 0.9794,
"f1" : 0.9632,
"falseNegative" : 20,
"falsePositive" : 6,
"precision" : 0.9827,
"recall" : 0.9444,
"total" : 1260,
"trueNegative" : 894,
"truePositive" : 340
}
}
],
"id" : "question",
"labels" : [
"notQuestion",
"question"
],
"positiveLabel" : "question",
"selectedAlgorithm" : "maxEnt",
"selectedModelFile" : "QuestionIntentClassifier.mlmodel"
},
{
"candidates" : [
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"balancedTrainingCount" : 720,
"balancedValidationCount" : 180,
"binaryByLanguage" : {
"en" : {
"accuracy" : 0.9571,
"f1" : 0.5714,
"falseNegative" : 27,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.4,
"total" : 630,
"trueNegative" : 585,
"truePositive" : 18
},
"zh-Hans" : {
"accuracy" : 0.9952,
"f1" : 0.9663,
"falseNegative" : 2,
"falsePositive" : 1,
"precision" : 0.9773,
"recall" : 0.9556,
"total" : 630,
"trueNegative" : 584,
"truePositive" : 43
}
},
"goldenBinary" : {
"accuracy" : 0.9783,
"f1" : 0.8571,
"falseNegative" : 2,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.75,
"total" : 92,
"trueNegative" : 84,
"truePositive" : 6
},
"goldenFalseNegativeExamples" : [
"[en] I'd like to invite you to Monday's project kickoff. Are you available? (score=0.284)",
"[zh-Hans] 周末一起去爬山怎么样？早上九点地铁站见。 (score=0.7468)"
],
"goldenFalsePositiveExamples" : [
],
"modelBytes" : 14987,
"runtimeAssetIndependent" : true,
"testBinary" : {
"accuracy" : 0.9762,
"f1" : 0.8026,
"falseNegative" : 29,
"falsePositive" : 1,
"precision" : 0.9839,
"recall" : 0.6778,
"total" : 1260,
"trueNegative" : 1169,
"truePositive" : 61
},
"testFalseNegativeExamples" : [
"[en] I saved you a spot to meet this weekend after work at the campus cafe. How does that sound? (score=0.366)",
"[en] I saved you a spot to have a quick call next Monday at noon at the station. How does that sound? (score=0.5668)",
"[en] I saved you a spot to visit the client at seven tonight at the Wangjing branch. How does that sound? (score=0.5685)",
"[en] I saved you a spot to have dinner this weekend at the campus cafe. How does that sound? (score=0.4259)",
"[en] I saved you a spot to watch a movie before the end of the month at the campus cafe. How does that sound? (score=0.3009)",
"[en] I saved you a spot to attend the design review Friday morning at Meeting Room 5. How does that sound? (score=0.4253)",
"[en] I saved you a spot to watch a movie Friday morning at the station. How does that sound? (score=0.4304)",
"[en] I saved you a spot to visit the client after work at the station. How does that sound? (score=0.3609)",
"[en] I saved you a spot to have dinner this weekend at the station. How does that sound? (score=0.4006)",
"[en] I saved you a spot to attend the design review Wednesday evening at the online meeting room. How does that sound? (score=0.4223)",
"[en] I saved you a spot to get coffee before the end of the month at Meeting Room 5. How does that sound? (score=0.2489)",
"[en] I saved you a spot to get coffee after work at the Wangjing branch. How does that sound? (score=0.3714)"
],
"testFalsePositiveExamples" : [
"[zh-Hans] 文档记载的喝咖啡定于周三晚上在线上会议室进行。 (score=0.8353)"
],
"threshold" : 0.77,
"validationBinary" : {
"accuracy" : 0.9817,
"f1" : 0.8571,
"falseNegative" : 21,
"falsePositive" : 2,
"precision" : 0.9718,
"recall" : 0.7667,
"total" : 1260,
"trueNegative" : 1168,
"truePositive" : 69
}
}
],
"id" : "invitation",
"labels" : [
"notInvitation",
"invitation"
],
"positiveLabel" : "invitation",
"selectedAlgorithm" : "maxEnt",
"selectedModelFile" : "InvitationIntentClassifier.mlmodel"
},
{
"candidates" : [
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"balancedTrainingCount" : 1440,
"balancedValidationCount" : 360,
"binaryByLanguage" : {
"en" : {
"accuracy" : 0.9508,
"f1" : 0.7919,
"falseNegative" : 31,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.6556,
"total" : 630,
"trueNegative" : 540,
"truePositive" : 59
},
"zh-Hans" : {
"accuracy" : 0.9841,
"f1" : 0.9419,
"falseNegative" : 9,
"falsePositive" : 1,
"precision" : 0.9878,
"recall" : 0.9,
"total" : 630,
"trueNegative" : 539,
"truePositive" : 81
}
},
"goldenBinary" : {
"accuracy" : 0.9239,
"f1" : 0.5882,
"falseNegative" : 7,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.4167,
"total" : 92,
"trueNegative" : 80,
"truePositive" : 5
},
"goldenFalseNegativeExamples" : [
"[en] The app has crashed constantly since the update, and I lost important data. (score=0.5909)",
"[en] I was charged twice for the same order and still have not received a refund. (score=0.4438)",
"[en] The package arrived damaged and the cup inside was broken. (score=0.3134)",
"[en] My account was locked for no reason. Can you restore it today? (score=0.2417)",
"[en] Support has not replied for three days. When will this be handled? (score=0.3498)",
"[zh-Hans] 收到的商品外包装破损，里面的杯子也碎了。 (score=0.2457)",
"[zh-Hans] 客服已经三天没有回复了，请问什么时候能处理？ (score=0.5563)"
],
"goldenFalsePositiveExamples" : [
],
"modelBytes" : 16850,
"runtimeAssetIndependent" : true,
"testBinary" : {
"accuracy" : 0.9675,
"f1" : 0.8723,
"falseNegative" : 40,
"falsePositive" : 1,
"precision" : 0.9929,
"recall" : 0.7778,
"total" : 1260,
"trueNegative" : 1079,
"truePositive" : 140
},
"testFalseNegativeExamples" : [
"[en] I need a clear answer: my reservation disappeared. How are you going to resolve it? (score=0.2123)",
"[en] I need a clear answer: the file will not open. How are you going to resolve it? (score=0.1792)",
"[en] I need a clear answer: the item arrived damaged. How are you going to resolve it? (score=0.202)",
"[en] I need a clear answer: the page loads extremely slowly. How are you going to resolve it? (score=0.21)",
"[en] I need a clear answer: the order was charged twice. How are you going to resolve it? (score=0.186)",
"[en] I need a clear answer: the invoice information is wrong. How are you going to resolve it? (score=0.2094)",
"[en] I need a clear answer: messages never send. How are you going to resolve it? (score=0.1964)",
"[en] I need a clear answer: data synchronization fails. How are you going to resolve it? (score=0.2338)",
"[en] I need a clear answer: my account was suddenly locked. How are you going to resolve it? (score=0.3079)",
"[en] This is not the first time that the file will not open; now support has not resolved it. (score=0.5497)",
"[en] This is not the first time that messages never send; now today's delivery is now at risk. (score=0.4564)",
"[en] This is not the first time that data synchronization fails; now the issue remains after several attempts. (score=0.599)"
],
"testFalsePositiveExamples" : [
"[zh-Hans] 对于订单状态，这次有没有明确答案？ (score=0.7457)"
],
"threshold" : 0.68,
"validationBinary" : {
"accuracy" : 1,
"f1" : 1,
"falseNegative" : 0,
"falsePositive" : 0,
"precision" : 1,
"recall" : 1,
"total" : 1260,
"trueNegative" : 1080,
"truePositive" : 180
}
}
],
"id" : "complaint",
"labels" : [
"notComplaint",
"complaint"
],
"positiveLabel" : "complaint",
"selectedAlgorithm" : "maxEnt",
"selectedModelFile" : "ComplaintIntentClassifier.mlmodel"
},
{
"candidates" : [
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"balancedTrainingCount" : 3560,
"balancedValidationCount" : 1080,
"binaryByLanguage" : {
"en" : {
"accuracy" : 0.9381,
"f1" : 0.9427,
"falseNegative" : 39,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.8917,
"total" : 630,
"trueNegative" : 270,
"truePositive" : 321
},
"zh-Hans" : {
"accuracy" : 1,
"f1" : 1,
"falseNegative" : 0,
"falsePositive" : 0,
"precision" : 1,
"recall" : 1,
"total" : 630,
"trueNegative" : 270,
"truePositive" : 360
}
},
"goldenBinary" : {
"accuracy" : 0.9239,
"f1" : 0.932,
"falseNegative" : 6,
"falsePositive" : 1,
"precision" : 0.9796,
"recall" : 0.8889,
"total" : 92,
"trueNegative" : 37,
"truePositive" : 48
},
"goldenFalseNegativeExamples" : [
"[en] Alex owns the meeting notes and should post them in the project channel today. (score=0.4433)",
"[en] First confirm the delivery address with the client, then update the order. (score=0.4795)",
"[en] Why is the order still marked as under review? (score=0.4847)",
"[zh-Hans] 记得把发票抬头改好以后重新提交。 (score=0.0669)",
"[zh-Hans] 下一步先联系客户确认交付地址，再更新订单。 (score=0.0634)",
"[zh-Hans] 这些材料可以在月底前准备好吗？ (score=0.1104)"
],
"goldenFalsePositiveExamples" : [
"[zh-Hans] 明天我要去财务核对发票，不用你帮忙。 (score=0.9516)"
],
"modelBytes" : 19623,
"runtimeAssetIndependent" : true,
"testBinary" : {
"accuracy" : 0.969,
"f1" : 0.9722,
"falseNegative" : 39,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.9458,
"total" : 1260,
"trueNegative" : 540,
"truePositive" : 681
},
"testFalseNegativeExamples" : [
"[en] This is not the first time that the file will not open; now the issue remains after several attempts. (score=0.4887)",
"[en] A positive review: The keyboard experience solved the problem. Keep it up. (score=0.5028)",
"[en] A positive review: The support response is much more accurate. Keep it up. (score=0.5665)",
"[en] A positive review: This update is easier to use. Keep it up. (score=0.5908)",
"[en] A positive review: The new speech recognition exceeded my expectations. Keep it up. (score=0.4991)",
"[en] A positive review: The latest fix works very smoothly. Keep it up. (score=0.5422)",
"[en] A positive review: The keyboard experience is noticeably more stable. Keep it up. (score=0.5804)",
"[en] A positive review: The interface change is easier to use. Keep it up. (score=0.3015)",
"[en] A positive review: The new speech recognition is much more accurate. Keep it up. (score=0.5761)",
"[en] A positive review: The latest fix solved the problem. Keep it up. (score=0.43)",
"[en] A positive review: The sync speed solved the problem. Keep it up. (score=0.4013)",
"[en] A positive review: The translation result is noticeably more stable. Keep it up. (score=0.5841)"
],
"testFalsePositiveExamples" : [
],
"threshold" : 0.6,
"validationBinary" : {
"accuracy" : 0.95,
"f1" : 0.9555,
"falseNegative" : 43,
"falsePositive" : 20,
"precision" : 0.9713,
"recall" : 0.9403,
"total" : 1260,
"trueNegative" : 520,
"truePositive" : 677
}
}
],
"id" : "replyableMessage",
"labels" : [
"notReplyableMessage",
"replyableMessage"
],
"positiveLabel" : "replyableMessage",
"selectedAlgorithm" : "maxEnt",
"selectedModelFile" : "ConversationalReplyIntentClassifier.mlmodel"
},
{
"candidates" : [
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"balancedTrainingCount" : 1080,
"balancedValidationCount" : 270,
"goldenMulticlass" : {
"accuracy" : 0.8913,
"confusion" : {
"negative" : {
"negative" : 13,
"neutral" : 4,
"positive" : 1
},
"neutral" : {
"negative" : 3,
"neutral" : 64,
"positive" : 1
},
"positive" : {
"negative" : 1,
"neutral" : 0,
"positive" : 5
}
},
"macroF1" : 0.8178,
"perLabel" : {
"negative" : {
"accuracy" : 0.9022,
"f1" : 0.7429,
"falseNegative" : 5,
"falsePositive" : 4,
"precision" : 0.7647,
"recall" : 0.7222,
"total" : 92,
"trueNegative" : 70,
"truePositive" : 13
},
"neutral" : {
"accuracy" : 0.913,
"f1" : 0.9412,
"falseNegative" : 4,
"falsePositive" : 4,
"precision" : 0.9412,
"recall" : 0.9412,
"total" : 92,
"trueNegative" : 20,
"truePositive" : 64
},
"positive" : {
"accuracy" : 0.9674,
"f1" : 0.7692,
"falseNegative" : 1,
"falsePositive" : 2,
"precision" : 0.7143,
"recall" : 0.8333,
"total" : 92,
"trueNegative" : 84,
"truePositive" : 5
}
},
"total" : 92
},
"modelBytes" : 16629,
"multiclassByLanguage" : {
"en" : {
"accuracy" : 0.9778,
"confusion" : {
"negative" : {
"negative" : 121,
"neutral" : 14,
"positive" : 0
},
"neutral" : {
"negative" : 0,
"neutral" : 450,
"positive" : 0
},
"positive" : {
"negative" : 0,
"neutral" : 0,
"positive" : 45
}
},
"macroF1" : 0.9767,
"perLabel" : {
"negative" : {
"accuracy" : 0.9778,
"f1" : 0.9453,
"falseNegative" : 14,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.8963,
"total" : 630,
"trueNegative" : 495,
"truePositive" : 121
},
"neutral" : {
"accuracy" : 0.9778,
"f1" : 0.9847,
"falseNegative" : 0,
"falsePositive" : 14,
"precision" : 0.9698,
"recall" : 1,
"total" : 630,
"trueNegative" : 166,
"truePositive" : 450
},
"positive" : {
"accuracy" : 1,
"f1" : 1,
"falseNegative" : 0,
"falsePositive" : 0,
"precision" : 1,
"recall" : 1,
"total" : 630,
"trueNegative" : 585,
"truePositive" : 45
}
},
"total" : 630
},
"zh-Hans" : {
"accuracy" : 0.9746,
"confusion" : {
"negative" : {
"negative" : 126,
"neutral" : 9,
"positive" : 0
},
"neutral" : {
"negative" : 3,
"neutral" : 443,
"positive" : 4
},
"positive" : {
"negative" : 0,
"neutral" : 0,
"positive" : 45
}
},
"macroF1" : 0.9647,
"perLabel" : {
"negative" : {
"accuracy" : 0.981,
"f1" : 0.9545,
"falseNegative" : 9,
"falsePositive" : 3,
"precision" : 0.9767,
"recall" : 0.9333,
"total" : 630,
"trueNegative" : 492,
"truePositive" : 126
},
"neutral" : {
"accuracy" : 0.9746,
"f1" : 0.9823,
"falseNegative" : 7,
"falsePositive" : 9,
"precision" : 0.9801,
"recall" : 0.9844,
"total" : 630,
"trueNegative" : 171,
"truePositive" : 443
},
"positive" : {
"accuracy" : 0.9937,
"f1" : 0.9574,
"falseNegative" : 0,
"falsePositive" : 4,
"precision" : 0.9184,
"recall" : 1,
"total" : 630,
"trueNegative" : 581,
"truePositive" : 45
}
},
"total" : 630
}
},
"runtimeAssetIndependent" : true,
"testMulticlass" : {
"accuracy" : 0.9762,
"confusion" : {
"negative" : {
"negative" : 247,
"neutral" : 23,
"positive" : 0
},
"neutral" : {
"negative" : 3,
"neutral" : 893,
"positive" : 4
},
"positive" : {
"negative" : 0,
"neutral" : 0,
"positive" : 90
}
},
"macroF1" : 0.9706,
"perLabel" : {
"negative" : {
"accuracy" : 0.9794,
"f1" : 0.95,
"falseNegative" : 23,
"falsePositive" : 3,
"precision" : 0.988,
"recall" : 0.9148,
"total" : 1260,
"trueNegative" : 987,
"truePositive" : 247
},
"neutral" : {
"accuracy" : 0.9762,
"f1" : 0.9835,
"falseNegative" : 7,
"falsePositive" : 23,
"precision" : 0.9749,
"recall" : 0.9922,
"total" : 1260,
"trueNegative" : 337,
"truePositive" : 893
},
"positive" : {
"accuracy" : 0.9968,
"f1" : 0.9783,
"falseNegative" : 0,
"falsePositive" : 4,
"precision" : 0.9574,
"recall" : 1,
"total" : 1260,
"trueNegative" : 1166,
"truePositive" : 90
}
},
"total" : 1260
},
"validationMulticlass" : {
"accuracy" : 0.9754,
"confusion" : {
"negative" : {
"negative" : 262,
"neutral" : 8,
"positive" : 0
},
"neutral" : {
"negative" : 19,
"neutral" : 877,
"positive" : 4
},
"positive" : {
"negative" : 0,
"neutral" : 0,
"positive" : 90
}
},
"macroF1" : 0.9706,
"perLabel" : {
"negative" : {
"accuracy" : 0.9786,
"f1" : 0.951,
"falseNegative" : 8,
"falsePositive" : 19,
"precision" : 0.9324,
"recall" : 0.9704,
"total" : 1260,
"trueNegative" : 971,
"truePositive" : 262
},
"neutral" : {
"accuracy" : 0.9754,
"f1" : 0.9826,
"falseNegative" : 23,
"falsePositive" : 8,
"precision" : 0.991,
"recall" : 0.9744,
"total" : 1260,
"trueNegative" : 352,
"truePositive" : 877
},
"positive" : {
"accuracy" : 0.9968,
"f1" : 0.9783,
"falseNegative" : 0,
"falsePositive" : 4,
"precision" : 0.9574,
"recall" : 1,
"total" : 1260,
"trueNegative" : 1166,
"truePositive" : 90
}
},
"total" : 1260
}
}
],
"id" : "sentiment",
"labels" : [
"negative",
"neutral",
"positive"
],
"selectedAlgorithm" : "maxEnt",
"selectedModelFile" : "SentimentClassifier.mlmodel"
}
],
"corpusCount" : 7272,
"corpusPath" : "ModelTraining/ClipboardSemantics/clipboard_semantic_corpus.jsonl",
"generatedAt" : "2026-08-22T09:30:13Z",
"goldenCount" : 92,
"selectionPolicy" : "Validation only: binary models require precision >= 0.97, then maximize recall; sentiment prioritizes macro-F1. Automatic routing also requires a self-contained maxEnt model because BERT embedding assets are not guaranteed in extensions. Test and golden data gate deployment but never tune model weights.",
"testCount" : 1260,
"trainingCount" : 4660,
"validationCount" : 1260
}
ModelTraining/ClipboardSemantics/baselines/2026-08-26-nine-model-v1/README.md
-15
View File
@@ -1,15 +0,0 @@
# Nine-model v1 baseline
This snapshot predates the second low-recall corpus expansion.
- Training corpus: 11,172 records
- Corrected development holdout: 640 records, zero exact training overlap
- Binary macro precision: 0.9492
- Binary macro recall: 0.5091
- Binary macro F1: 0.6374
- Runtime-gated sentiment macro F1: 0.6228
The holdout is a development benchmark, not a final blind release gate.
`ScheduleNegotiationIntentClassifier.mlmodel` is preserved here because it
outperformed the expanded-corpus replacement and remains the deployed model.
ModelTraining/ClipboardSemantics/baselines/2026-08-26-nine-model-v1/clipboard-semantic-models.json
-146
View File
@@ -1,146 +0,0 @@
{
"classifiers" : [
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.98,
"confidenceThresholdsByLanguage" : {
"en" : 0.99,
"zh-Hans" : 0.98
},
"id" : "task",
"labels" : [
"notTask",
"task"
],
"modelFile" : "TaskIntentClassifier.mlmodel",
"positiveLabel" : "task"
},
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.6,
"confidenceThresholdsByLanguage" : {
"en" : 0.6,
"zh-Hans" : 0.6
},
"id" : "question",
"labels" : [
"notQuestion",
"question"
],
"modelFile" : "QuestionIntentClassifier.mlmodel",
"positiveLabel" : "question"
},
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.79,
"confidenceThresholdsByLanguage" : {
"en" : 0.8,
"zh-Hans" : 0.82
},
"id" : "invitation",
"labels" : [
"notInvitation",
"invitation"
],
"modelFile" : "InvitationIntentClassifier.mlmodel",
"positiveLabel" : "invitation"
},
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.79,
"confidenceThresholdsByLanguage" : {
"en" : 0.79,
"zh-Hans" : 0.79
},
"id" : "complaint",
"labels" : [
"notComplaint",
"complaint"
],
"modelFile" : "ComplaintIntentClassifier.mlmodel",
"positiveLabel" : "complaint"
},
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.53,
"confidenceThresholdsByLanguage" : {
"en" : 0.53,
"zh-Hans" : 0.53
},
"id" : "scheduleNegotiation",
"labels" : [
"notScheduleNegotiation",
"scheduleNegotiation"
],
"modelFile" : "ScheduleNegotiationIntentClassifier.mlmodel",
"positiveLabel" : "scheduleNegotiation"
},
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.77,
"confidenceThresholdsByLanguage" : {
"en" : 0.77,
"zh-Hans" : 0.8
},
"id" : "confirmationDecision",
"labels" : [
"notConfirmationDecision",
"confirmationDecision"
],
"modelFile" : "ConfirmationDecisionIntentClassifier.mlmodel",
"positiveLabel" : "confirmationDecision"
},
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.77,
"confidenceThresholdsByLanguage" : {
"en" : 0.83,
"zh-Hans" : 0.77
},
"id" : "followUpReminder",
"labels" : [
"notFollowUpReminder",
"followUpReminder"
],
"modelFile" : "FollowUpReminderIntentClassifier.mlmodel",
"positiveLabel" : "followUpReminder"
},
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.74,
"confidenceThresholdsByLanguage" : {
"en" : 0.74,
"zh-Hans" : 0.79
},
"id" : "replyableMessage",
"labels" : [
"notReplyableMessage",
"replyableMessage"
],
"modelFile" : "ConversationalReplyIntentClassifier.mlmodel",
"positiveLabel" : "replyableMessage"
},
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"id" : "sentiment",
"labels" : [
"negative",
"neutral",
"positive"
],
"modelFile" : "SentimentClassifier.mlmodel"
}
],
"corpusRecordCount" : 11172,
"generatedAt" : "2026-08-26T10:38:35Z",
"schemaVersion" : 2
}
ModelTraining/ClipboardSemantics/baselines/2026-08-26-nine-model-v1/evaluation-report.json
-1407
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/baselines/2026-08-26-nine-model-v1/random-holdout-report.json
-1448
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/baselines/2026-08-27-blessing-v1/Candidates/BlessingIntentClassifier-maxent.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-blessing-v1/clipboard-semantic-models.json
-23
View File
@@ -1,23 +0,0 @@
{
"classifiers" : [
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"confidenceThreshold" : 0.69,
"confidenceThresholdsByLanguage" : {
"en" : 0.69,
"zh-Hans" : 0.77
},
"id" : "blessing",
"labels" : [
"notBlessing",
"blessing"
],
"modelFile" : "BlessingIntentClassifier.mlmodel",
"positiveLabel" : "blessing"
}
],
"corpusRecordCount" : 17692,
"generatedAt" : "2026-08-27T01:58:55Z",
"schemaVersion" : 2
}
ModelTraining/ClipboardSemantics/baselines/2026-08-27-blessing-v1/evaluation-report.json
-132
View File
@@ -1,132 +0,0 @@
{
"classifiers" : [
{
"candidates" : [
{
"acceptedForAutomaticRouting" : true,
"algorithm" : "maxEnt",
"balancedTrainingCount" : 720,
"balancedValidationCount" : 180,
"binaryByLanguage" : {
"en" : {
"accuracy" : 1,
"f1" : 1,
"falseNegative" : 0,
"falsePositive" : 0,
"precision" : 1,
"recall" : 1,
"total" : 1485,
"trueNegative" : 1440,
"truePositive" : 45
},
"zh-Hans" : {
"accuracy" : 0.9993,
"f1" : 0.9888,
"falseNegative" : 1,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.9778,
"total" : 1485,
"trueNegative" : 1440,
"truePositive" : 44
}
},
"confidenceThresholdsByLanguage" : {
"en" : 0.69,
"zh-Hans" : 0.77
},
"goldenBinary" : {
"accuracy" : 0.9881,
"f1" : 0.9189,
"falseNegative" : 3,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.85,
"total" : 252,
"trueNegative" : 232,
"truePositive" : 17
},
"goldenBinaryByLanguage" : {
"en" : {
"accuracy" : 0.9921,
"f1" : 0.9474,
"falseNegative" : 1,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.9,
"total" : 126,
"trueNegative" : 116,
"truePositive" : 9
},
"zh-Hans" : {
"accuracy" : 0.9841,
"f1" : 0.8889,
"falseNegative" : 2,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.8,
"total" : 126,
"trueNegative" : 116,
"truePositive" : 8
}
},
"goldenFalseNegativeExamples" : [
"[en] Good luck with your exam tomorrow; I hope all your hard work pays off. (score=0.1198)",
"[zh-Hans] 中秋团圆，愿大家所念皆如愿，所行皆坦途。 (score=0.7188)",
"[zh-Hans] 祝宝宝健康成长，也祝新手爸妈每天都有好睡眠。 (score=0.7616)"
],
"goldenFalsePositiveExamples" : [
],
"modelBytes" : 18991,
"runtimeAssetIndependent" : true,
"testBinary" : {
"accuracy" : 0.9997,
"f1" : 0.9944,
"falseNegative" : 1,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.9889,
"total" : 2970,
"trueNegative" : 2880,
"truePositive" : 89
},
"testFalseNegativeExamples" : [
"[zh-Hans] 顺便说一下，中秋节之际，祝阿杰万事如意。 (score=0.7458)"
],
"testFalsePositiveExamples" : [
],
"threshold" : 0.69,
"validationBinary" : {
"accuracy" : 0.999,
"f1" : 0.9834,
"falseNegative" : 1,
"falsePositive" : 2,
"precision" : 0.978,
"recall" : 0.9889,
"total" : 2970,
"trueNegative" : 2878,
"truePositive" : 89
}
}
],
"id" : "blessing",
"labels" : [
"notBlessing",
"blessing"
],
"positiveLabel" : "blessing",
"selectedAlgorithm" : "maxEnt",
"selectedModelFile" : "BlessingIntentClassifier.mlmodel"
}
],
"corpusCount" : 17692,
"corpusPath" : "ModelTraining/ClipboardSemantics/clipboard_semantic_corpus.jsonl",
"generatedAt" : "2026-08-27T01:58:55Z",
"goldenCount" : 252,
"selectionPolicy" : "Validation only: global and per-language binary thresholds require precision >= 0.97, then maximize recall; languages with fewer than 20 examples per class fall back to the global threshold. sentiment prioritizes macro-F1. Automatic routing also requires a self-contained maxEnt model because BERT embedding assets are not guaranteed in extensions. Test and golden data gate deployment but never tune model weights.",
"testCount" : 2970,
"trainingCount" : 11500,
"validationCount" : 2970
}
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/BlessingIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/Candidates/BlessingIntentClassifier-maxent.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/Candidates/ComplaintIntentClassifier-maxent.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/Candidates/ConfirmationDecisionIntentClassifier-maxent.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/Candidates/ConversationalReplyIntentClassifier-maxent.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/Candidates/FollowUpReminderIntentClassifier-maxent.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/Candidates/InvitationIntentClassifier-maxent.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/Candidates/QuestionIntentClassifier-maxent.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/Candidates/ScheduleNegotiationIntentClassifier-maxent.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/Candidates/SentimentClassifier-maxent.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/Candidates/TaskIntentClassifier-maxent.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/ComplaintIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/ConfirmationDecisionIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/ConversationalReplyIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/FollowUpReminderIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/InvitationIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/QuestionIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/ScheduleNegotiationIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/SentimentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/TaskIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/comprehensive-online-report.json
-2265
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/random-holdout-report.json
-3443
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/runtime-golden-report.json
-4006
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/targeted-release-report.json
-2039
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/baselines/2026-08-27-open-data-v3-license-safe/training-report.json
-1566
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/baselines/2026-08-27-targeted-v2/ComplaintIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-targeted-v2/README.md
-12
View File
@@ -1,12 +0,0 @@
# Targeted v2 baseline
This snapshot predates the English-task and complaint specialization round.
Focused 480-record holdout:
- Task: precision 0.9386, recall 0.6688, F1 0.7810
- English task: precision 0.9333, recall 0.5250, F1 0.6720
- Complaint: precision 0.9744, recall 0.4750, F1 0.6387
The deployed model files, manifest, focused holdout report, and golden report
are preserved for rollback and same-input comparison.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-targeted-v2/TaskIntentClassifier.mlmodel
BIN
View File
Binary file not shown.
ModelTraining/ClipboardSemantics/baselines/2026-08-27-targeted-v2/clipboard-semantic-models.json
-146
View File
@@ -1,146 +0,0 @@
{
"classifiers": [
{
"acceptedForAutomaticRouting": true,
"algorithm": "maxEnt",
"confidenceThreshold": 0.81,
"confidenceThresholdsByLanguage": {
"en": 0.81,
"zh-Hans": 0.81
},
"id": "task",
"labels": [
"notTask",
"task"
],
"modelFile": "TaskIntentClassifier.mlmodel",
"positiveLabel": "task"
},
{
"acceptedForAutomaticRouting": true,
"algorithm": "maxEnt",
"confidenceThreshold": 0.6,
"confidenceThresholdsByLanguage": {
"en": 0.6,
"zh-Hans": 0.6
},
"id": "question",
"labels": [
"notQuestion",
"question"
],
"modelFile": "QuestionIntentClassifier.mlmodel",
"positiveLabel": "question"
},
{
"acceptedForAutomaticRouting": true,
"algorithm": "maxEnt",
"confidenceThreshold": 0.82,
"confidenceThresholdsByLanguage": {
"en": 0.85,
"zh-Hans": 0.82
},
"id": "invitation",
"labels": [
"notInvitation",
"invitation"
],
"modelFile": "InvitationIntentClassifier.mlmodel",
"positiveLabel": "invitation"
},
{
"acceptedForAutomaticRouting": true,
"algorithm": "maxEnt",
"confidenceThreshold": 0.91,
"confidenceThresholdsByLanguage": {
"en": 0.76,
"zh-Hans": 0.91
},
"id": "complaint",
"labels": [
"notComplaint",
"complaint"
],
"modelFile": "ComplaintIntentClassifier.mlmodel",
"positiveLabel": "complaint"
},
{
"acceptedForAutomaticRouting": true,
"algorithm": "maxEnt",
"confidenceThreshold": 0.68,
"confidenceThresholdsByLanguage": {
"en": 0.68,
"zh-Hans": 0.53
},
"id": "scheduleNegotiation",
"labels": [
"notScheduleNegotiation",
"scheduleNegotiation"
],
"modelFile": "ScheduleNegotiationIntentClassifier.mlmodel",
"positiveLabel": "scheduleNegotiation"
},
{
"acceptedForAutomaticRouting": true,
"algorithm": "maxEnt",
"confidenceThreshold": 0.72,
"confidenceThresholdsByLanguage": {
"en": 0.72,
"zh-Hans": 0.72
},
"id": "confirmationDecision",
"labels": [
"notConfirmationDecision",
"confirmationDecision"
],
"modelFile": "ConfirmationDecisionIntentClassifier.mlmodel",
"positiveLabel": "confirmationDecision"
},
{
"acceptedForAutomaticRouting": true,
"algorithm": "maxEnt",
"confidenceThreshold": 0.73,
"confidenceThresholdsByLanguage": {
"en": 0.73,
"zh-Hans": 0.73
},
"id": "followUpReminder",
"labels": [
"notFollowUpReminder",
"followUpReminder"
],
"modelFile": "FollowUpReminderIntentClassifier.mlmodel",
"positiveLabel": "followUpReminder"
},
{
"acceptedForAutomaticRouting": true,
"algorithm": "maxEnt",
"confidenceThreshold": 0.75,
"confidenceThresholdsByLanguage": {
"en": 0.75,
"zh-Hans": 0.79
},
"id": "replyableMessage",
"labels": [
"notReplyableMessage",
"replyableMessage"
],
"modelFile": "ConversationalReplyIntentClassifier.mlmodel",
"positiveLabel": "replyableMessage"
},
{
"acceptedForAutomaticRouting": true,
"algorithm": "maxEnt",
"id": "sentiment",
"labels": [
"negative",
"neutral",
"positive"
],
"modelFile": "SentimentClassifier.mlmodel"
}
],
"corpusRecordCount": 13332,
"generatedAt": "2026-08-26T15:18:57Z",
"schemaVersion": 2
}
ModelTraining/ClipboardSemantics/baselines/2026-08-27-targeted-v2/deployment-golden-report.json
-1398
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/baselines/2026-08-27-targeted-v2/fresh-metric-holdout-report.json
-1271
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/blessing-labeling-guidelines.md
-70
View File
@@ -1,70 +0,0 @@
# Blessing intent labeling guidelines
## Definition
Label `blessing = true` when the author directly expresses a good wish,
congratulation, prayer, or hope for a recipient. The recipient may be the
reader, a named third party, a group, or the author.
The label is intentionally broad. It includes:
- Festival, birthday, wedding, anniversary, graduation, promotion, new-job,
housewarming, newborn, and retirement wishes.
- Short congratulations such as `恭喜`, `恭喜发财`, `Congratulations`, and
`Congrats`.
- Health, recovery, travel, safety, exam, competition, career, and general
good-luck wishes.
- Good-night and good-day wishes when they express a desired outcome, such as
`祝你好梦` or `Hope you have a wonderful day`.
- Religious or spiritual prayers directed toward a recipient.
- Wishes expressed for a third person, such as `我衷心祝愿她早日康复`.
## Negative boundaries
Label `blessing = false` when the text only:
- Requests, searches for, or discusses how to write a blessing.
- Thanks someone for a blessing already received.
- Mentions that other people sent blessings.
- Describes a celebration without wishing anyone well.
- Quotes or documents a blessing as an example.
- Greets someone without expressing a desired outcome.
- Gives positive feedback or praise without a wish or congratulation.
- Contains a lexical collision such as a title, name, product, or historical
reference that happens to include a blessing keyword.
## Context-dependent cases
Annotators must use surrounding context when available:
- Sarcastic congratulations are negative unless the product intentionally
treats the surface utterance as reply-worthy congratulations.
- `祝我好运` and equivalent self-directed wishes are positive.
- Conditional or unrealized intent such as `等会儿再祝他生日快乐` is negative
until the text actually expresses the wish.
- A message may be both `blessing` and another intent. For example, a wedding
invitation containing `祝你们幸福` is both an invitation and a blessing.
## Annotation process
1. Normalize only invisible whitespace; preserve wording, punctuation, and
emoji for labeling.
2. Two annotators label every golden-set record independently.
3. Disagreements are adjudicated by a third reviewer using this document.
4. Record the boundary category and adjudication reason, not only the binary
label.
5. Keep all evaluation examples isolated from generation prompts, training
sources, and active-learning exports.
## Release evaluation
The dedicated blessing benchmark must contain:
- At least 3,000 Chinese and 1,500 English human-reviewed records.
- Equal positive and hard-negative strata for diagnostic metrics.
- A separate natural-prevalence calibration set for threshold selection.
- At least 100 records for each major positive and negative boundary category.
The release gate is precision at least 0.95, recall at least 0.85, and F1 at
least 0.90 on the adjudicated benchmark, with no major boundary category below
0.80 F1.
ModelTraining/ClipboardSemantics/chinese-corpus-candidate-audit-v1.json
-235
View File
@@ -1,235 +0,0 @@
{
"schemaVersion": 1,
"auditVersion": "chinese-corpus-candidate-audit-v1",
"reviewedAt": "2026-08-28",
"taxonomyVersion": "clipboard-consensus-v6",
"scope": "面向简体中文、繁体中文及配套英文边界样本的 taxonomy 语料候选准入审计。",
"policy": {
"admittedMeaning": "准入仅允许来源进入候选抽取、映射和清洗队列，不代表已经进入商业训练集。",
"splitBoundary": "只允许上游官方明确标识的 train 数据产生训练候选；dev、validation、test、challenge、hidden test 和本地冻结 holdout 一律不得训练。",
"commercialBoundary": "导入前必须固定上游 revision、保存许可证及 attribution、确认数据本体而非仅代码受该许可证覆盖，并完成隐私、内容安全和重复检查。",
"knownLabelsBoundary": "每条记录只声明来源实际标注且经过确定性映射审计的 knownLabels；未声明字段保持 unknown，不得作为负例。",
"syntheticBoundary": "合成语料仅用于 train，必须记录生成与上游 provenance，sampleWeight 不得高于 0.35，不得进入校准、评估、人类 gold 或 policy anchors，也不得覆盖冲突的真人或许可非合成样本。",
"holdoutBoundary": "与任一冻结 holdout 精确或归一化近重复的文本全局禁止训练。"
},
"admittedSources": [
{
"id": "MASSIVE",
"status": "admitted",
"languages": [
"zh-CN",
"en-US"
],
"license": "CC-BY-4.0",
"commercialUse": "允许，须署名并保留许可证与修改说明。",
"url": "https://huggingface.co/datasets/AmazonScience/massive",
"licenseUrl": "https://huggingface.co/datasets/AmazonScience/massive/blob/main/LICENSE",
"trainBoundary": "仅固定 revision 的官方 train split；dev/test 禁止训练。",
"synthetic": false,
"reason": "覆盖中英文助手意图与多领域表达，标签结构适合映射 assistantCommand、informationQuery 和 domain；需避免把源 intent 扩展为其他 taxonomy 字段的负例。"
},
{
"id": "CrossWOZ",
"status": "admitted",
"languages": [
"zh-CN"
],
"license": "Apache-2.0",
"commercialUse": "允许，须保留许可证和 NOTICE 要求。",
"url": "https://github.com/thu-coai/CrossWOZ",
"licenseUrl": "https://github.com/thu-coai/CrossWOZ/blob/master/LICENSE",
"trainBoundary": "仅 data/crosswoz/train.json.zip 的固定官方 revision；val/test 禁止训练。",
"synthetic": false,
"reason": "中文跨领域任务对话可补充 travel、dining、calendar 等边界；只抽取当前轮可独立判断的文本，依赖隐藏对话状态的记录保持 unknown 或丢弃。"
},
{
"id": "BiToD",
"status": "admitted",
"languages": [
"zh-CN",
"en"
],
"license": "Apache-2.0",
"commercialUse": "允许，须保留许可证和 NOTICE 要求。",
"url": "https://github.com/HLTCHKUST/BiToD",
"licenseUrl": "https://github.com/HLTCHKUST/BiToD/blob/main/LICENSE",
"trainBoundary": "仅官方 zh_train/en_train 数据；valid/test 和 cross-lingual evaluation split 禁止训练。",
"synthetic": false,
"reason": "官方提供中英双语和明确切分，可用于 travel、dining、calendar 与 assistant 路由映射；只保留脱离上下文仍有稳定语义的轮次。"
},
{
"id": "MultiDoGO",
"status": "admitted",
"languages": [
"en"
],
"license": "CDLA-Permissive-1.0",
"commercialUse": "允许，按数据许可证保留来源和许可记录。",
"url": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset",
"licenseUrl": "https://github.com/awslabs/multi-domain-goal-oriented-dialogues-dataset/blob/master/LICENSE.txt",
"trainBoundary": "仅 data/paper_splits 下官方 train.tsv；dev/test 禁止训练。",
"synthetic": false,
"reason": "金融、媒体、软件等域的 turn-level intent 可补充英文边界与跨语言对照；只映射明确源标签，不推断其余 intent。"
},
{
"id": "Taskmaster-1",
"status": "admitted",
"languages": [
"en"
],
"license": "CC-BY-4.0（数据；代码 Apache-2.0）",
"commercialUse": "允许，数据须署名并记录修改。",
"url": "https://github.com/google-research-datasets/Taskmaster/tree/master/TM-1-2019",
"licenseUrl": "https://creativecommons.org/licenses/by/4.0/legalcode",
"trainBoundary": "只使用官方训练用途文件并固定清单；任何官方 evaluation/test 文件禁止训练。",
"synthetic": false,
"reason": "可补充服务预订、计划和确认边界；Wizard/self-dialogue 风格需单独标记 provenance，并过滤依赖多轮上下文的 utterance。"
},
{
"id": "SNIPS",
"status": "admitted",
"languages": [
"en"
],
"license": "CC0-1.0",
"commercialUse": "允许；保留数据集来源、固定 revision 和修改记录。",
"url": "https://github.com/sonos/nlu-benchmark",
"licenseUrl": "https://github.com/sonos/nlu-benchmark/blob/master/LICENSE",
"trainBoundary": "仅 sonos/nlu-benchmark 固定 revision 的 train_*_full.json；validate 文件和第三方镜像不得导入。",
"synthetic": false,
"reason": "可提供 assistantCommand 与媒体、天气、smartHome 等清晰边界；准入不延伸到来源和许可不一致的第三方 SNIPS 镜像。"
},
{
"id": "MInDS-14",
"status": "admitted",
"languages": [
"zh-CN",
"en-US",
"en-GB",
"en-AU"
],
"license": "CC-BY-4.0",
"commercialUse": "允许，须署名并记录转录文本的处理。",
"url": "https://huggingface.co/datasets/PolyAI/minds14",
"licenseUrl": "https://creativecommons.org/licenses/by/4.0/legalcode",
"trainBoundary": "上游每个 config 仅发布 train；这些记录只能产生训练候选，不能充当 OSGKeyboard 校准或评估真值。",
"synthetic": false,
"reason": "中英文银行意图可补充 finance、accountService 和 informationQuery；只使用转录文本，音频不进入本项目。"
},
{
"id": "GoEmotions",
"status": "admitted",
"languages": [
"en"
],
"license": "Apache-2.0",
"commercialUse": "允许，须保留许可证和 NOTICE；导入时保存固定 revision 的许可证证据。",
"url": "https://github.com/google-research/google-research/tree/master/goemotions",
"licenseUrl": "https://github.com/google-research/google-research/blob/master/LICENSE",
"trainBoundary": "仅官方 train.tsv；dev/test 禁止训练。",
"synthetic": false,
"reason": "只用于 sentiment 的已审计映射，不从情绪标签推断 complaint、blessing 或 replyableMessage；Reddit 文本须经过隐私与内容安全过滤。"
},
{
"id": "ASAP",
"status": "admitted",
"languages": [
"zh-CN"
],
"license": "Apache-2.0",
"commercialUse": "允许，须保留许可证和 notices。",
"url": "https://github.com/Meituan-Dianping/ASAP",
"licenseUrl": "https://github.com/Meituan-Dianping/ASAP/blob/master/LICENSE",
"trainBoundary": "仅 data/train.csv；dev/test 禁止训练。",
"synthetic": false,
"reason": "中文餐饮评价可补充 dining、sentiment 与显式 complaint 边界；负面 aspect 或低评分不能自动映射为 complaint。"
},
{
"id": "Restaurant8k",
"status": "admitted",
"languages": [
"en"
],
"license": "CC-BY-4.0",
"commercialUse": "允许，须署名并记录修改。",
"url": "https://github.com/PolyAI-LDN/task-specific-datasets/tree/master/span_extraction/restaurant8k",
"licenseUrl": "https://github.com/PolyAI-LDN/task-specific-datasets/blob/master/LICENSE",
"trainBoundary": "仅 train_0.json 作为完整官方训练集；其下采样副本不得重复导入，test.json 禁止训练。",
"synthetic": false,
"reason": "可补充 dining domain 和餐饮查询边界；span 标注只使经审计映射的字段 known，不使十二个 intent 全部已知。"
},
{
"id": "FormosaNLU-Synth-v1",
"status": "admitted",
"languages": [
"zh-TW"
],
"license": "CC-BY-4.0（合成数据及 MASSIVE zh-TW seed）",
"commercialUse": "允许，须同时署名 MASSIVE 与 FormosaNLU Synth，并说明合成和过滤修改。",
"url": "https://huggingface.co/datasets/steven0226/formosa-nlu-synth-v1",
"licenseUrl": "https://huggingface.co/datasets/steven0226/formosa-nlu-synth-v1/blob/main/LICENSE",
"trainBoundary": "仅固定 release manifest 对应的 train；不得作为校准、评估或人工 gold。",
"synthetic": true,
"maximumSampleWeight": 0.35,
"reason": "可补充繁体中文和台湾表达，但必须保留双重 attribution、生成 provenance 与 synthetic 标记；只声明生成契约保证的 knownLabels。"
}
],
"quarantinedSources": [
{
"id": "BANKING77",
"status": "quarantined",
"license": "CC-BY-4.0",
"commercialUse": "许可证允许商业使用，但当前不准进入训练。",
"url": "https://huggingface.co/datasets/PolyAI/banking77",
"reason": "与 MInDS-14 的 finance/accountService 覆盖高度重叠，且大量短查询会放大 informationQuery 与低信息 fragment 偏差；待完成去重、源域平衡和独立边界审计。"
},
{
"id": "ABCD",
"status": "quarantined",
"license": "MIT",
"commercialUse": "许可证允许商业使用，但当前不准进入训练。",
"url": "https://github.com/asappresearch/abcd",
"reason": "虚构零售客服的多轮 action dialogue 强依赖角色与上下文，直接抽取会污染单条 clipboard 的 task、confirmationDecision 和 systemNotification 边界。"
},
{
"id": "MultiWOZ",
"status": "quarantined",
"license": "MIT（官方仓库）",
"commercialUse": "许可证允许商业使用，但当前不准进入训练。",
"url": "https://github.com/budzianowski/multiwoz",
"reason": "版本多、历史标注错误和修订差异明显，且多轮状态依赖强；在固定唯一版本、验证官方 train 和完成 turn-level 质量审计前隔离。"
},
{
"id": "CLINC150",
"status": "quarantined",
"license": "CC-BY-4.0（UCI 官方分发）",
"commercialUse": "许可证允许商业使用，但当前不准进入 v6 新训练。",
"url": "https://archive.ics.uci.edu/dataset/570/clinc150",
"reason": "以虚拟助手和 OOS 检测为目标，短命令分布会主导新增路由标签；历史实验及 holdout 已使用相关文本，须先完成全局泄漏审计和旧产物隔离。"
},
{
"id": "CFPB",
"status": "quarantined",
"license": "CC0-1.0",
"commercialUse": "许可证允许商业使用，但真实投诉叙述当前不准进入训练。",
"url": "https://www.consumerfinance.gov/data-research/consumer-complaints/",
"reason": "真实消费者投诉可能包含敏感财务、身份和叙事隐私信息，且 2026 年官方停止主动发布投诉 narratives；即使是 CC0，也需法律、隐私和历史快照来源审查。"
},
{
"id": "openclaw-zh-greetings",
"status": "quarantined",
"license": "MIT（数据卡声明）",
"commercialUse": "许可声明表面允许，但当前证据不足以批准商业训练。",
"url": "https://huggingface.co/datasets/trytax/openclaw-zh-greetings",
"reason": "小型非官方示例集缺少稳定上游、版本化生成过程和逐条权利链；仓库/软件的 MIT 许可不能替代对数据文本本体的 provenance 审计。"
},
{
"id": "LCCC",
"status": "quarantined",
"license": "MIT 仓库标识与官方“仅限科研用途”说明并存",
"commercialUse": "禁止用于当前商业训练。",
"url": "https://github.com/thu-coai/CDial-GPT",
"reason": "官方 README 明确限定科研用途，语料来自抓取的微博对话，缺少完整底层内容权利与隐私链；只能在隔离研究队列中审阅。"
}
]
}
ModelTraining/ClipboardSemantics/clipboard_semantic_corpus.jsonl
+7272 -17692
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/combined-training-corpus.jsonl
+23918
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/comprehensive-online-holdout-corpus.jsonl
-41195
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/comprehensive-online-holdout-report.json
-2403
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/comprehensive-online-holdout-sources.json
-166
View File
@@ -1,166 +0,0 @@
{
"containsProjectUserClipboardData": false,
"corpusSHA256": "34387615f5721dc645edcc7c7feb2bd30b27c362a314aad6159fbc9e5baadf8c",
"coverage": {
"blessing": {
"en": {
"negative": 13107,
"positive": 69
},
"zh-Hans": {
"negative": 28002,
"positive": 17
}
},
"complaint": {
"en": {
"negative": 12742,
"positive": 434
},
"zh-Hans": {
"negative": 27749,
"positive": 270
}
},
"confirmationDecision": {
"en": {
"negative": 13164,
"positive": 12
},
"zh-Hans": {
"negative": 27962,
"positive": 57
}
},
"followUpReminder": {
"en": {
"negative": 13051,
"positive": 125
},
"zh-Hans": {
"negative": 27754,
"positive": 265
}
},
"invitation": {
"en": {
"negative": 13115,
"positive": 61
},
"zh-Hans": {
"negative": 27946,
"positive": 73
}
},
"question": {
"en": {
"negative": 10520,
"positive": 2656
},
"zh-Hans": {
"negative": 20835,
"positive": 7184
}
},
"replyable": {
"en": {
"negative": 2295,
"positive": 10881
},
"zh-Hans": {
"negative": 1593,
"positive": 26426
}
},
"scheduleNegotiation": {
"en": {
"negative": 13109,
"positive": 67
},
"zh-Hans": {
"negative": 28015,
"positive": 4
}
},
"task": {
"en": {
"negative": 12057,
"positive": 1119
},
"zh-Hans": {
"negative": 27360,
"positive": 659
}
}
},
"generatedFromOnlineSources": true,
"holdoutPolicy": "Frozen online evaluation only. These records are excluded from training, model selection, and threshold calibration.",
"labelCorrection": {
"reason": "An initial prelabel audit found obvious surface questions, invitations, schedule alternatives, reminders, and wishes that source intent schemas did not encode. A second audit removed quoted, sarcastic, and substring-only blessing matches. Deterministic label rules were corrected before the frozen evaluation.",
"supersededCorpusSHA256": [
"36f736f69e0c9ac42262d2b57640f9889534ffdc6e70da67fda6f41d7211b2f9",
"baffdfff4b5436810c45d92d28c5885d8ed475b878531220852ae6f2a55011e4"
]
},
"labelingMethod": "Original dataset labels are retained where available. Product intents not present in source schemas use conservative lexical mapping; metrics must therefore be read with per-source results and label-coverage counts.",
"profile": "comprehensive",
"recordCount": 41195,
"seed": 20260831,
"sentimentCoverage": {
"en": {
"negative": 1605,
"neutral": 9578,
"positive": 1993
},
"zh-Hans": {
"negative": 11934,
"neutral": 10191,
"positive": 5894
}
},
"sources": [
{
"dataset": "CFPB via hpe-ai/customer-complaints",
"license": "CC0-1.0 source / Apache-2.0 mirror",
"records": 250,
"url": "https://huggingface.co/datasets/hpe-ai/customer-complaints"
},
{
"dataset": "Meituan-Dianping/ASAP",
"license": "Apache-2.0",
"records": 120,
"revision": "975122a60065240124df62cb4d5dbfd19ed9ef2c",
"url": "https://github.com/Meituan-Dianping/asap"
},
{
"dataset": "AmazonScience/MASSIVE",
"license": "CC-BY-4.0",
"records": 5817,
"url": "https://huggingface.co/datasets/AmazonScience/massive"
},
{
"dataset": "Verified Enron Intent Dataset",
"license": "MIT / public Enron source corpus",
"records": 3537,
"url": "https://github.com/vseledkin/enron_intent_dataset_verified"
},
{
"dataset": "CPED",
"license": "Apache-2.0",
"records": 25049,
"url": "https://github.com/qftie/CPED"
},
{
"dataset": "Google Research GoEmotions",
"license": "Apache-2.0",
"records": 5418,
"url": "https://huggingface.co/datasets/google-research-datasets/go_emotions"
},
{
"dataset": "Sulak2020 GitHub issues multi-repo dataset",
"license": "CC-BY-4.0 with per-record attribution",
"records": 1004,
"url": "https://huggingface.co/datasets/Sulak2020/github-issues-multirepo-datasets-Sulakshana"
}
]
}
ModelTraining/ClipboardSemantics/corpus-registry-sources.json
-302
View File
@@ -1,302 +0,0 @@
{
"schemaVersion": 2,
"policy": "Only license-safe sources may produce train candidates. Any text seen in calibration or evaluation data is globally barred from training.",
"intentLabels": [
"task",
"question",
"invitation",
"complaint",
"scheduleNegotiation",
"confirmationDecision",
"followUpReminder",
"blessing",
"replyableMessage",
"assistantCommand",
"informationQuery",
"systemNotification"
],
"domains": [
"finance",
"travel",
"calendar",
"communication",
"media",
"smartHome",
"shopping",
"dining",
"health",
"weather",
"accountService",
"generalKnowledge"
],
"legacyFullyKnownIntentLabels": [
"task",
"question",
"invitation",
"complaint",
"scheduleNegotiation",
"confirmationDecision",
"followUpReminder",
"blessing",
"replyableMessage"
],
"sources": [
{
"id": "historical-nine-model-v1",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/Generated/historical-nine-model-v1.jsonl",
"license": "OSGKeyboard project license",
"defaultUse": "by-split",
"sourceType": "project-generated",
"allIntentLabelsKnown": true,
"knownIntentLabels": ["task", "question", "invitation", "complaint", "scheduleNegotiation", "confirmationDecision", "followUpReminder", "blessing", "replyableMessage"],
"sentimentKnown": true,
"weight": 1.0,
"required": true
},
{
"id": "current-product-corpus",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/clipboard_semantic_corpus.jsonl",
"license": "OSGKeyboard project license",
"defaultUse": "by-split",
"sourceType": "project-generated",
"allIntentLabelsKnown": true,
"knownIntentLabels": ["task", "question", "invitation", "complaint", "scheduleNegotiation", "confirmationDecision", "followUpReminder", "blessing", "replyableMessage"],
"sentimentKnown": true,
"weight": 1.0,
"required": true
},
{
"id": "product-corpus-16x",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/Generated/product-corpus-16x.jsonl",
"license": "OSGKeyboard project license",
"defaultUse": "by-split",
"sourceType": "project-generated",
"allIntentLabelsKnown": true,
"knownIntentLabels": ["task", "question", "invitation", "complaint", "scheduleNegotiation", "confirmationDecision", "followUpReminder", "blessing", "replyableMessage"],
"sentimentKnown": true,
"weight": 1.0,
"required": true
},
{
"id": "licensed-open-training",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/open-training-corpus.jsonl",
"license": "mixed per-record commercial licenses",
"defaultUse": "train",
"sourceType": "licensed-open-data",
"allIntentLabelsKnown": false,
"sentimentKnown": false,
"weight": 1.0,
"required": true
},
{
"id": "v6-boundary-synthetic",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/v6-boundary-training-supplement.jsonl",
"license": "OSGKeyboard project license",
"defaultUse": "train",
"sourceType": "project-generated-synthetic",
"allIntentLabelsKnown": false,
"sentimentKnown": false,
"weight": 1.0,
"required": true
},
{
"id": "v6-migration-tier-a",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/CorpusRegistry/Labels/V6Migration/tier-a.jsonl",
"license": "OSGKeyboard project license",
"defaultUse": "train",
"sourceType": "model-consensus",
"allIntentLabelsKnown": false,
"sentimentKnown": false,
"weight": 1.0,
"required": true
},
{
"id": "v6-migration-tier-b",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/CorpusRegistry/Labels/V6Migration/tier-b.jsonl",
"license": "OSGKeyboard project license",
"defaultUse": "train",
"sourceType": "model-consensus",
"allIntentLabelsKnown": false,
"sentimentKnown": false,
"weight": 1.0,
"required": true
},
{
"id": "v6-migration-adjudicated",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/CorpusRegistry/Labels/V6Migration/adjudicated.jsonl",
"license": "OSGKeyboard project license",
"defaultUse": "train",
"sourceType": "model-adjudicated",
"allIntentLabelsKnown": false,
"sentimentKnown": false,
"weight": 1.0,
"required": true
},
{
"id": "v6-blind-evaluation",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/v6-blind-evaluation-corpus.jsonl",
"license": "OSGKeyboard project license",
"defaultUse": "by-split",
"sourceType": "frozen-holdout",
"allIntentLabelsKnown": false,
"sentimentKnown": false,
"weight": 1.0,
"required": true
},
{
"id": "blessing-synthetic-100k",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/Generated/blessing-synthetic-100k.jsonl",
"license": "OSGKeyboard project license",
"defaultUse": "train",
"sourceType": "project-generated",
"allIntentLabelsKnown": false,
"sentimentKnown": false,
"weight": 0.35,
"required": true
},
{
"id": "consensus-silver-v1",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/Consensus/consensus-silver.jsonl",
"license": "Apache-2.0",
"defaultUse": "by-split",
"sourceType": "model-consensus",
"allIntentLabelsKnown": false,
"sentimentKnown": false,
"weight": 1.0,
"required": false
},
{
"id": "random-holdout",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/random-holdout-corpus.jsonl",
"license": "OSGKeyboard project license",
"defaultUse": "evaluation-only",
"sourceType": "frozen-holdout",
"allIntentLabelsKnown": true,
"knownIntentLabels": ["task", "question", "invitation", "complaint", "scheduleNegotiation", "confirmationDecision", "followUpReminder", "blessing", "replyableMessage"],
"sentimentKnown": true,
"weight": 1.0,
"required": true
},
{
"id": "fresh-metric-holdout",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/fresh-metric-holdout-corpus.jsonl",
"license": "OSGKeyboard project license",
"defaultUse": "evaluation-only",
"sourceType": "frozen-holdout",
"allIntentLabelsKnown": true,
"knownIntentLabels": ["task", "question", "invitation", "complaint", "scheduleNegotiation", "confirmationDecision", "followUpReminder", "blessing", "replyableMessage"],
"sentimentKnown": true,
"weight": 1.0,
"required": true
},
{
"id": "targeted-confirmation-holdout",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/targeted-confirmation-holdout-corpus.jsonl",
"license": "OSGKeyboard project license",
"defaultUse": "evaluation-only",
"sourceType": "frozen-holdout",
"allIntentLabelsKnown": true,
"knownIntentLabels": ["task", "question", "invitation", "complaint", "scheduleNegotiation", "confirmationDecision", "followUpReminder", "blessing", "replyableMessage"],
"sentimentKnown": true,
"weight": 1.0,
"required": true
},
{
"id": "targeted-final-holdout",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/targeted-final-holdout-corpus.jsonl",
"license": "OSGKeyboard project license",
"defaultUse": "evaluation-only",
"sourceType": "frozen-holdout",
"allIntentLabelsKnown": true,
"knownIntentLabels": ["task", "question", "invitation", "complaint", "scheduleNegotiation", "confirmationDecision", "followUpReminder", "blessing", "replyableMessage"],
"sentimentKnown": true,
"weight": 1.0,
"required": true
},
{
"id": "targeted-release-holdout",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/targeted-release-holdout-corpus.jsonl",
"license": "OSGKeyboard project license",
"defaultUse": "evaluation-only",
"sourceType": "frozen-holdout",
"allIntentLabelsKnown": true,
"knownIntentLabels": ["task", "question", "invitation", "complaint", "scheduleNegotiation", "confirmationDecision", "followUpReminder", "blessing", "replyableMessage"],
"sentimentKnown": true,
"weight": 1.0,
"required": true
},
{
"id": "online-real-holdout",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/online-real-holdout-corpus.jsonl",
"license": "evaluation-only mixed provenance",
"defaultUse": "evaluation-only",
"sourceType": "frozen-holdout",
"allIntentLabelsKnown": true,
"knownIntentLabels": ["task", "question", "invitation", "complaint", "scheduleNegotiation", "confirmationDecision", "followUpReminder", "blessing", "replyableMessage"],
"sentimentKnown": true,
"weight": 1.0,
"required": true
},
{
"id": "comprehensive-online-holdout",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/comprehensive-online-holdout-corpus.jsonl",
"license": "evaluation-only mixed provenance",
"defaultUse": "evaluation-only",
"sourceType": "frozen-holdout",
"allIntentLabelsKnown": true,
"knownIntentLabels": ["task", "question", "invitation", "complaint", "scheduleNegotiation", "confirmationDecision", "followUpReminder", "blessing", "replyableMessage"],
"sentimentKnown": true,
"weight": 1.0,
"required": true
},
{
"id": "blessing-benchmark-review",
"path": "${REPO_ROOT}/ModelTraining/ClipboardSemantics/BlessingBenchmark/review-queue.jsonl",
"license": "evaluation-only mixed provenance",
"defaultUse": "evaluation-only",
"sourceType": "blind-review-benchmark",
"allIntentLabelsKnown": false,
"sentimentKnown": false,
"weight": 1.0,
"sensitive": true,
"required": true
},
{
"id": "blessing-unseen-scenarios",
"path": "${REPO_ROOT}/OSGKeyboardTests/Fixtures/BlessingUnseenScenarios.json",
"license": "OSGKeyboard project license",
"defaultUse": "evaluation-only",
"sourceType": "frozen-holdout",
"allIntentLabelsKnown": false,
"sentimentKnown": false,
"weight": 1.0,
"required": false
}
],
"excludedSources": [
{
"id": "LCCC",
"reason": "Research-only terms and incomplete content-rights/privacy chain. It must not influence production corpus generation or training."
},
{
"id": "DailyDialog-EmpatheticDialogues-Switchboard",
"reason": "Non-commercial license restrictions."
},
{
"id": "CPED",
"reason": "Repository license does not establish commercial rights to the underlying television dialogue."
},
{
"id": "Tianji-Wishes-Birthday-Quotes",
"reason": "No sufficiently clear per-record source or generation-rights chain."
},
{
"id": "CFPB",
"reason": "No official train split; privacy-sensitive narratives overlap the frozen evaluation provenance."
},
{
"id": "CLINC150",
"reason": "Isolated from product training because its assistant taxonomy is not product-policy compatible."
}
]
}
ModelTraining/ClipboardSemantics/corpus-summary.json
+16 -172
View File
@@ -2,198 +2,42 @@
"containsUserClipboardData": false,
"families": {
"acknowledgment": 388,
"acknowledgment_decision_boundary": 540,
"blessing_boundary": 560,
"blessing_golden": 20,
"blessing_message": 540,
"complaint_implicit_failure": 540,
"complaint_incident_diverse": 540,
"complaint_request": 546,
"complaint_statement": 546,
"confirmation_decision": 540,
"confirmation_decision_boundary": 20,
"confirmation_decision_golden": 20,
"confirmation_selection_short": 540,
"conversational_message": 550,
"event_statement": 544,
"follow_up_action": 540,
"follow_up_personal_reminder": 540,
"follow_up_reminder_boundary": 20,
"follow_up_reminder_golden": 20,
"follow_up_triggered": 540,
"information_question": 544,
"invitation_question": 548,
"negative_news": 486,
"neutral_fact": 550,
"personal_action_item_boundary": 540,
"positive_feedback": 546,
"quoted_question": 384,
"resolved_issue_boundary": 540,
"schedule_fixed_invitation_boundary": 540,
"schedule_negotiation": 540,
"schedule_negotiation_boundary": 20,
"schedule_negotiation_golden": 20,
"self_plan": 546,
"task_assignment_diverse": 540,
"task_completion_boundary": 540,
"task_indirect_assignment": 540,
"task_indirect_question": 540,
"task_question": 546,
"task_statement": 548,
"vague_future_boundary": 540
},
"goldenCoverage": {
"blessing": {
"en": {
"boundaryNegative": 10,
"positive": 10
},
"zh-Hans": {
"boundaryNegative": 10,
"positive": 10
}
},
"confirmationDecision": {
"en": {
"boundaryNegative": 10,
"positive": 10
},
"zh-Hans": {
"boundaryNegative": 10,
"positive": 10
}
},
"followUpReminder": {
"en": {
"boundaryNegative": 10,
"positive": 13
},
"zh-Hans": {
"boundaryNegative": 10,
"positive": 13
}
},
"scheduleNegotiation": {
"en": {
"boundaryNegative": 10,
"positive": 10
},
"zh-Hans": {
"boundaryNegative": 10,
"positive": 10
}
}
},
"labelsByLanguage": {
"en": {
"blessing": {
"negative": 8566,
"positive": 280
},
"complaint": {
"negative": 7760,
"positive": 1086
},
"confirmationDecision": {
"negative": 8296,
"positive": 550
},
"followUpReminder": {
"negative": 7753,
"positive": 1093
},
"invitation": {
"negative": 8298,
"positive": 548
},
"question": {
"negative": 6933,
"positive": 1913
},
"replyable": {
"negative": 3106,
"positive": 5740
},
"scheduleNegotiation": {
"negative": 8566,
"positive": 280
},
"task": {
"negative": 6671,
"positive": 2175
}
},
"zh-Hans": {
"blessing": {
"negative": 8566,
"positive": 280
},
"complaint": {
"negative": 7760,
"positive": 1086
},
"confirmationDecision": {
"negative": 8296,
"positive": 550
},
"followUpReminder": {
"negative": 7753,
"positive": 1093
},
"invitation": {
"negative": 8298,
"positive": 548
},
"question": {
"negative": 6933,
"positive": 1913
},
"replyable": {
"negative": 3106,
"positive": 5740
},
"scheduleNegotiation": {
"negative": 8566,
"positive": 280
},
"task": {
"negative": 6671,
"positive": 2175
}
}
"task_statement": 548
},
"languages": {
"en": 8846,
"zh-Hans": 8846
"en": 3636,
"zh-Hans": 3636
},
"positiveIntentLabels": {
"blessing": 560,
"complaint": 2172,
"confirmationDecision": 1100,
"followUpReminder": 2186,
"invitation": 1096,
"question": 3826,
"replyable": 11480,
"scheduleNegotiation": 560,
"task": 4350
"complaint": 1092,
"invitation": 548,
"question": 2182,
"replyable": 4374,
"task": 1094
},
"seed": 20260821,
"sentiments": {
"negative": 2658,
"neutral": 13928,
"positive": 1106
"negative": 1578,
"neutral": 5148,
"positive": 546
},
"splits": {
"golden": 252,
"test": 2970,
"train": 11500,
"validation": 2970
"golden": 92,
"test": 1260,
"train": 4660,
"validation": 1260
},
"total": 17692,
"validation": {
"crossSplitTextLeaks": 0,
"duplicateIDs": 0,
"duplicateNormalizedTexts": 0,
"sensitiveContentMatches": 0
}
"total": 7272
}
ModelTraining/ClipboardSemantics/deployment-golden-report.json
-1392
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/evaluation-report.json
+565 -1145
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/fresh-metric-holdout-corpus.jsonl
-480
View File
@@ -1,480 +0,0 @@
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-010", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "先说重点，附件始终打不开已经影响到交付时间被耽误，你们准备哪天真正解决？"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-003", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "顺便提一句，因为页面一直空白，现在工作完全卡住，能不能给出明确处理时限？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-016", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Set myself a follow-up reminder to ask the warehouse lead about the missing documents before the next review."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-017", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "还有一件事，我看过供应商丙了，但还没有选择，等明天再决定。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-007", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "In short, The statistical report records that the weather alert was upgraded, with no customer complaint."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-005", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "对了，版本上线仍在评审，当前没有批准结论。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-009", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "我可能自己看看排期变动，但还没决定什么时候做。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-012", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "The main point is this: Can you close out the delivery checklist before lunch and update Finance?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-006", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "单独记一下，以后说不定会再问仓库负责人，目前没有后续计划。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-018", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "刚想到，只是个人想法：以后也许整理交付清单，目前没有安排。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-006", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "对了，同样的故障第三次出现，附件始终打不开，整个事情已经家人收不到商品。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-013", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "刚想到，因为付款结果重复扣款，现在客户已经在催，能不能给出明确处理时限？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-002", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "单独记一下，行业通报称原材料价格再次上涨，这里只摘录公开信息。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-004", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, Set myself a follow-up reminder to ask the landlord about next steps before lunch."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-011", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "先说重点，只是个人想法：以后也许整理验收截图，目前没有安排。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-010", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "Just to add, Because tracking has not moved for five days, delivery is now delayed. Can you provide a firm resolution date?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-009", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "顺便提一句，现在请直接整理测试结论并发给财务，不需要后续回访。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-004", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For the record, Prepare the acceptance screenshots now and send it to the project lead; no later follow-up is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-002", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, This is only a personal idea: perhaps I will organize the signature page someday."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-016", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, The review is over; my final selection is vendor C, and the alternatives are closed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-017", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "另外，只是个人想法：以后也许整理验收截图，目前没有安排。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-012", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "补充一下，这项分工你能接吗：月底前整理验收截图？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-016", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "the release remains under review, with no approval yet."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-002", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "By the way, The industry bulletin says that raw material prices rose again; this only quotes public information."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-003", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "A quick note: I reviewed the offline resolution, but have not selected it; the decision waits until tomorrow."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-006", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: Set myself a follow-up reminder to ask the doctor about the final decision before month-end."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-004", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "补充一下，本来承诺今天解决，结果还是物流状态停了五天，现在我无法继续操作。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-011", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "顺便提一句，这项分工你能接吗：两个工作日内整理复盘摘要？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-002", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "对了，资料归档仍在评审，当前没有批准结论。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-003", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "另外，现在请直接整理预算备注并发给供应商，不需要后续回访。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-001", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For context, the vendor assigned the budget notes to you, with completion required within two business days."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-003", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "A quick note: The same failure has happened a third time: the account is locked again, so delivery is now delayed."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-014", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "By the way, The same failure has happened a third time: the attachment never opens, so I cannot continue."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-002", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "顺便提一句，我可能自己看看售后范围，但还没决定什么时候做。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-017", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "先说重点，账号又被锁住已经影响到客户已经在催，你们准备哪天真正解决？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-011", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "For the record, The industry bulletin says that the weather alert was upgraded; this only quotes public information."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-014", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For the record, Prepare the test findings now and send it to Finance; no later follow-up is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-019", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For context, Prepare the delivery checklist now and send it to Finance; no later follow-up is needed."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-011", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "刚想到，结论正式生效：权限开通采用线下处理方案。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-015", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "顺便提一句，付款结果重复扣款已经影响到工作完全卡住，你们准备哪天真正解决？"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-010", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "对了，本来承诺今天解决，结果还是账号又被锁住，现在工作完全卡住。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-018", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: the release remains under review, with no approval yet."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-020", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For context, This is only a personal idea: perhaps I will organize the signature page someday."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-010", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Also, The review is over; my final selection is the second quote, and the alternatives are closed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-008", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "刚想到，这份交付由你收尾：把复盘摘要整理好，最迟明晚之前交给运营。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-002", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "对了，以后说不定会再问医生，目前没有后续计划。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-004", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "One more thing: Finance assigned the test findings to you, with completion required by tomorrow evening."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-016", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "简单说，结论正式生效：售后范围采用先灰度发布。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-010", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "In short, Can you close out the signature page as this week closes and update the project lead?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-011", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, I reviewed quarterly billing, but have not selected it; the decision waits until tomorrow."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-012", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Just to add, Two days after the patch ships, check with the warehouse lead again about payment status and record the outcome."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-004", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "The main point is this: Because the payment was charged twice, I cannot continue. Can you provide a firm resolution date?"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-008", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "In short, This was promised for today, yet the page stays blank, and now the client is already chasing us."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-002", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "附件始终打不开已经影响到客户已经在催，你们准备哪天真正解决？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-012", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "刚想到，费用调整仍在评审，当前没有批准结论。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-002", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "先说重点，交付清单能由你在下次评审前前收尾吗？完成后告诉客服团队。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-005", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "刚想到，本来承诺今天解决，结果还是付款结果重复扣款，现在工作完全卡住。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-017", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "补充一下，给自己设一条后续提醒：午休前找房东确认处理进度。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-019", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "简单说，个人行动项：复诊结束以后再次检查处理进度。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-020", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "By the way, the payment was charged twice has reached the point where my family cannot receive the item. When will you actually resolve it?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-008", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Just to add, the vendor assigned the budget notes to you, with completion required before month-end."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-008", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Just to add, Can you take this assignment and finish the budget notes by tomorrow evening?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-012", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "单独记一下，以后说不定会再问客户经理，目前没有后续计划。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-010", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "By the way, The industry bulletin says that the industry index fell again; this only quotes public information."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-013", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "A quick note: The statistical report records that many flights were delayed overnight, with no customer complaint."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-008", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, I reviewed a limited rollout first, but have not selected it; the decision waits until tomorrow."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-003", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "另外，结论正式生效：版本上线采用供应商丙。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-002", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "单独记一下，本来承诺今天解决，结果还是付款结果重复扣款，现在客户已经在催。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-017", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, access activation remains under review, with no approval yet."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-016", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "The main point is this: This was promised for today, yet the account is locked again, and now the client is already chasing us."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-014", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "对了，我可能自己看看排期变动，但还没决定什么时候做。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-014", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "One more thing: You are closing out this deliverable: finish the acceptance screenshots and give it to Operations before month-end."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-015", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Also, Two days after the checkup ends, check with the doctor again about the missing documents and record the outcome."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-016", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Can you close out the acceptance screenshots as this week closes and update the project lead?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-001", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: I reviewed the second quote, but have not selected it; the decision waits until tomorrow."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-020", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "单独记一下，一次性完成签字页即可，交给项目负责人后任务结束。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-018", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "After the current item closes, return to the landlord and track the delivery date."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-006", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "A quick note: You are closing out this deliverable: finish the acceptance screenshots and give it to Operations as this week closes."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-018", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "顺便提一句，一次性完成签字页即可，交给项目负责人后任务结束。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-011", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "The main point is this: Because the attachment never opens, delivery is now delayed. Can you provide a firm resolution date?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-011", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Just to add, Prepare the budget notes now and send it to the vendor; no later follow-up is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-004", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "刚想到，个人行动项：补丁上线以后再次检查下一步安排。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-006", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, I may look into document archiving myself, but I have not decided when."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-010", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "还有一件事，只是个人想法：以后也许整理验收截图，目前没有安排。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-004", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For context, Two days after the sample arrives, check with Legal again about payment status and record the outcome."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-008", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "One more thing: The review is over; my final selection is vendor C, and the alternatives are closed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-017", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "供应商把交付清单分给你处理，完成时间不能晚于月底前。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-016", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "刚想到，等客户回信满两天后，再找仓库负责人核实补充材料并记录结果。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-006", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "对了，因为附件始终打不开，现在我无法继续操作，能不能给出明确处理时限？"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-012", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "In short, This was promised for today, yet the payment was charged twice, and now all work is blocked."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-020", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: I might ask the landlord again someday, but there is no follow-up plan."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-020", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "补充一下，行业通报称原材料价格再次上涨，这里只摘录公开信息。"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-002", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: The decision is now official: use the second quote for document archiving."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-013", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "刚想到，结论正式生效：权限开通采用供应商丙。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-011", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "对了，本来承诺今天解决，结果还是附件始终打不开，现在客户已经在催。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-014", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: This is only a personal idea: perhaps I will organize the delivery checklist someday."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-001", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "还有一件事，物流状态停了五天已经影响到工作完全卡住，你们准备哪天真正解决？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-006", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "顺便提一句，统计报告记录了原材料价格再次上涨，没有客户投诉。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-007", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "One more thing: Because the account is locked again, the client is already chasing us. Can you provide a firm resolution date?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-014", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "A quick note: the release remains under review, with no approval yet."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-014", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "顺便提一句，结论正式生效：资料归档采用季度结算。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-002", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "One more thing: I might ask the landlord again someday, but there is no follow-up plan."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-003", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "先说重点，给自己设一条后续提醒：月底前找房东确认处理进度。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-007", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For the record, Design assigned the signature page to you, with completion required before month-end."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-016", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "刚想到，项目负责人把预算备注分给你处理，完成时间不能晚于月底前。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-007", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For context, Two days after the contract is signed, check with the doctor again about the missing documents and record the outcome."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-008", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "单独记一下，我可能自己看看权限开通，但还没决定什么时候做。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-020", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "For context, The statistical report records that raw material prices rose again, with no customer complaint."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-009", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "One more thing: Can you close out the signature page before the next review and update Operations?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-011", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "先说重点，统计报告记录了部分门店暂停营业，没有客户投诉。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-019", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "还有一件事，客服团队把验收截图分给你处理，完成时间不能晚于下次评审前。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-012", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "一次性完成验收截图即可，交给设计同学后任务结束。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-014", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "补充一下，本来承诺今天解决，结果还是付款结果重复扣款，现在家人收不到商品。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-018", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "Also, Because the attachment never opens, the client is already chasing us. Can you provide a firm resolution date?"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-008", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "In short, the attachment never opens has reached the point where my family cannot receive the item. When will you actually resolve it?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-012", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, Maybe I will revisit resolution progress whenever it comes to mind; no reminder is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-012", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "In short, the project lead assigned the delivery checklist to you, with completion required within two business days."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-017", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, I might ask the warehouse lead again someday, but there is no follow-up plan."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-007", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "还有一件事，行业通报称原材料价格再次上涨，这里只摘录公开信息。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-001", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "In short, Prepare the budget notes now and send it to Design; no later follow-up is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-011", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "单独记一下，一次性完成测试结论即可，交给运营后任务结束。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-016", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For context, After the current item closes, return to the landlord and track the missing documents."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-008", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "另外，给自己设一条后续提醒：本周收尾时找招聘方确认补充材料。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-001", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "One more thing: The same failure has happened a third time: the account is locked again, so the client is already chasing us."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-010", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "刚想到，个人行动项：复诊结束以后再次检查下一步安排。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-018", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "顺便提一句，行业通报称天气预警已经升级，这里只摘录公开信息。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-018", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "The main point is this: The same failure has happened a third time: tracking has not moved for five days, so all work is blocked."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-015", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "另外，当前事项结束以后，回头联系客户经理追踪到账情况。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-011", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "In short, This is only a personal idea: perhaps I will organize the delivery checklist someday."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-007", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "By the way, Can you close out the test findings as this week closes and update the project lead?"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-001", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "For the record, Because the payment was charged twice, I cannot continue. Can you provide a firm resolution date?"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-009", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "简单说，因为附件始终打不开，现在家人收不到商品，能不能给出明确处理时限？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-003", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "By the way, This is only a personal idea: perhaps I will organize the delivery checklist someday."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-019", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "A quick note: the vendor assigned the test findings to you, with completion required before month-end."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-009", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For context, The review is over; my final selection is the lightweight version, and the alternatives are closed."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-014", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "因为页面一直空白，现在我无法继续操作，能不能给出明确处理时限？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-019", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "By the way, I may look into document archiving myself, but I have not decided when."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-017", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "In short, You are closing out this deliverable: finish the delivery checklist and give it to Operations before lunch."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-007", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "先说重点，一次性完成预算备注即可，交给供应商后任务结束。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-007", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "还有一件事，同样的故障第三次出现，页面一直空白，整个事情已经交付时间被耽误。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-017", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "另外，处理进度哪天想起来再看，现在不用提醒。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-004", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "另外，只是个人想法：以后也许整理复盘摘要，目前没有安排。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-016", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "单独记一下，测试结论能由你在下次评审前前收尾吗？完成后告诉运营。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-009", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For the record, Prepare the budget notes now and send it to Support; no later follow-up is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-010", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "还有一件事，补充材料哪天想起来再看，现在不用提醒。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-011", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "对了，页面一直空白已经影响到我无法继续操作，你们准备哪天真正解决？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-015", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For context, document archiving remains under review, with no approval yet."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-016", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "另外，本来承诺今天解决，结果还是付款结果重复扣款，现在交付时间被耽误。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-005", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For the record, Prepare the signature page now and send it to Design; no later follow-up is needed."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-005", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "顺便提一句，页面一直空白已经影响到我无法继续操作，你们准备哪天真正解决？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-016", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For the record, Prepare the budget notes now and send it to the project lead; no later follow-up is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-003", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "行业通报称部分门店暂停营业，这里只摘录公开信息。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-005", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "另外，我可能自己看看权限开通，但还没决定什么时候做。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-016", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "One more thing: I may look into support coverage myself, but I have not decided when."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-015", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "单独记一下，以后说不定会再问法务，目前没有后续计划。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-016", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "补充一下，因为物流状态停了五天，现在工作完全卡住，能不能给出明确处理时限？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-013", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Just to add, Can you close out the acceptance screenshots within two business days and update Operations?"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-002", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "The same failure has happened a third time: the payment was charged twice, so I cannot continue."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-015", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, The review is over; my final selection is a limited rollout first, and the alternatives are closed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-014", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "还有一件事，这份交付由你收尾：把交付清单整理好，最迟本周收尾时交给项目负责人。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-013", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "For context, The same failure has happened a third time: the account is locked again, so all work is blocked."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-006", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "顺便提一句，现在请直接整理验收截图并发给客服团队，不需要后续回访。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-019", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, I might ask the doctor again someday, but there is no follow-up plan."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-015", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "对了，给自己设一条后续提醒：两个工作日内找法务确认交付日期。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-010", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "顺便提一句，行业通报称部分门店暂停营业，这里只摘录公开信息。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-015", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "By the way, Complete the test findings once, deliver it to Design, and close the task."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-014", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "简单说，以后说不定会再问医生，目前没有后续计划。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-011", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "我看过第二套报价了，但还没有选择，等明天再决定。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-012", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "另外，行业通报称原材料价格再次上涨，这里只摘录公开信息。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-004", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "对了，最终结论哪天想起来再看，现在不用提醒。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-005", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "In short, I reviewed the second quote, but have not selected it; the decision waits until tomorrow."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-002", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "By the way, Because the attachment never opens, my family cannot receive the item. Can you provide a firm resolution date?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-005", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "Just to add, The industry bulletin says that the weather alert was upgraded; this only quotes public information."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-002", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "By the way, Can you take this assignment and finish the retro summary as this week closes?"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-002", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "先说重点，结论正式生效：排期变动采用第二套报价。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-013", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "By the way, Support assigned the acceptance screenshots to you, with completion required before month-end."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-006", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "单独记一下，只是个人想法：以后也许整理交付清单，目前没有安排。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-019", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "The main point is this: the payment was charged twice has reached the point where I cannot continue. When will you actually resolve it?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-020", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "刚想到，这份交付由你收尾：把交付清单整理好，最迟两个工作日内交给运营。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-017", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "One more thing: Set myself a follow-up reminder to ask the account manager about the missing documents before lunch."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-015", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "单独记一下，我看过季度结算了，但还没有选择，等明天再决定。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-004", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Also, support coverage remains under review, with no approval yet."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-007", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "交付日期哪天想起来再看，现在不用提醒。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-003", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "简单说，测试结论能由你在午休前前收尾吗？完成后告诉项目负责人。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-020", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For context, I reviewed vendor C, but have not selected it; the decision waits until tomorrow."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-009", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "顺便提一句，交付日期哪天想起来再看，现在不用提醒。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-009", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "The main point is this: The industry bulletin says that the industry index fell again; this only quotes public information."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-006", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "One more thing: Because the payment was charged twice, my family cannot receive the item. Can you provide a firm resolution date?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-009", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "资料归档仍在评审，当前没有批准结论。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-003", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For context, I might ask the recruiter again someday, but there is no follow-up plan."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-010", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Also, You are closing out this deliverable: finish the signature page and give it to Design before the next review."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-003", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "顺便提一句，当前事项结束以后，回头联系医生追踪到账情况。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-012", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "The industry bulletin says that raw material prices rose again; this only quotes public information."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-011", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "顺便提一句，个人行动项：合同盖章以后再次检查处理进度。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-001", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "By the way, Can you take this assignment and finish the retro summary before lunch?"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-005", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "A quick note: The review is over; my final selection is the second quote, and the alternatives are closed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-008", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "单独记一下，当前事项结束以后，回头联系医生追踪处理进度。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-007", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "In short, I reviewed quarterly billing, but have not selected it; the decision waits until tomorrow."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-012", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: Personal action item: check the missing documents again after the patch ships."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-018", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "另外，当前事项结束以后，回头联系医生追踪补充材料。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-019", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "单独记一下，等样品送达满两天后，再找招聘方核实补充材料并记录结果。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-001", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "先说重点，给自己设一条后续提醒：明晚之前找客户经理确认最终结论。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-019", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "The main point is this: Can you close out the acceptance screenshots as this week closes and update Design?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-015", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "Just to add, The statistical report records that several stores paused operations, with no customer complaint."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-013", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, The review is over; my final selection is quarterly billing, and the alternatives are closed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-018", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "One more thing: Can you close out the retro summary by tomorrow evening and update the project lead?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-013", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "补充材料哪天想起来再看，现在不用提醒。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-008", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "简单说，行业通报称天气预警已经升级，这里只摘录公开信息。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-010", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "补充一下，等样品送达满两天后，再找医生核实补充材料并记录结果。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-012", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "单独记一下，个人行动项：客户回信以后再次检查下一步安排。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-004", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "对了，我看过轻量版本了，但还没有选择，等明天再决定。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-006", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "单独记一下，预算备注能由你在午休前前收尾吗？完成后告诉运营。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-016", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "单独记一下，一次性完成复盘摘要即可，交给供应商后任务结束。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-017", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "The main point is this: This was promised for today, yet the account is locked again, and now my family cannot receive the item."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-017", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "先说重点，结论正式生效：版本上线采用先灰度发布。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-020", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "还有一件事，这项分工你能接吗：月底前整理测试结论？"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-011", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "By the way, The decision is now official: use vendor C for support coverage."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-009", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "One more thing: Operations assigned the acceptance screenshots to you, with completion required by tomorrow evening."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-016", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "I might ask the account manager again someday, but there is no follow-up plan."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-020", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "The main point is this: Can you close out the retro summary before the next review and update the project lead?"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-009", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "单独记一下，本来承诺今天解决，结果还是物流状态停了五天，现在家人收不到商品。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-010", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: This is only a personal idea: perhaps I will organize the signature page someday."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-004", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "补充一下，付款结果重复扣款已经影响到客户已经在催，你们准备哪天真正解决？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-004", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "I may look into support coverage myself, but I have not decided when."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-007", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "我看过轻量版本了，但还没有选择，等明天再决定。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-001", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "统计报告记录了天气预警已经升级，没有客户投诉。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-004", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "刚想到，统计报告记录了原材料价格再次上涨，没有客户投诉。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-004", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "还有一件事，这份交付由你收尾：把签字页整理好，最迟月底前交给客服团队。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-016", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "单独记一下，我看过先灰度发布了，但还没有选择，等明天再决定。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-015", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "A quick note: Maybe I will revisit payment status whenever it comes to mind; no reminder is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-003", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "简单说，我看过第二套报价了，但还没有选择，等明天再决定。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-003", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Just to add, Prepare the delivery checklist now and send it to the project lead; no later follow-up is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-014", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "还有一件事，一次性完成测试结论即可，交给项目负责人后任务结束。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-009", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Two days after the patch ships, check with the recruiter again about next steps and record the outcome."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-011", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "One more thing: Can you take this assignment and finish the budget notes as this week closes?"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-004", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "By the way, The decision is now official: use quarterly billing for support coverage."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-008", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "对了，权限开通仍在评审，当前没有批准结论。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-013", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, This is only a personal idea: perhaps I will organize the acceptance screenshots someday."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-003", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "A quick note: Two days after the sample arrives, check with the warehouse lead again about the missing documents and record the outcome."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-016", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "For context, Because the page stays blank, all work is blocked. Can you provide a firm resolution date?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-003", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Just to add, the vendor assigned the delivery checklist to you, with completion required before lunch."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-012", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "还有一件事，这份交付由你收尾：把签字页整理好，最迟明晚之前交给项目负责人。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-004", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "补充一下，当前事项结束以后，回头联系仓库负责人追踪下一步安排。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-008", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "In short, This is only a personal idea: perhaps I will organize the budget notes someday."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-018", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: I may look into support coverage myself, but I have not decided when."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-001", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, I might ask the account manager again someday, but there is no follow-up plan."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-002", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "顺便提一句，当前事项结束以后，回头联系仓库负责人追踪下一步安排。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-013", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: Maybe I will revisit resolution progress whenever it comes to mind; no reminder is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-020", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "The main point is this: the vendor assigned the retro summary to you, with completion required within two business days."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-018", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "顺便提一句，供应商把预算备注分给你处理，完成时间不能晚于下次评审前。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-017", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "By the way, Can you close out the signature page as this week closes and update the project lead?"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-013", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "Also, tracking has not moved for five days has reached the point where all work is blocked. When will you actually resolve it?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-002", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "One more thing: Set myself a follow-up reminder to ask the doctor about the final decision as this week closes."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-005", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "The main point is this: Because tracking has not moved for five days, all work is blocked. Can you provide a firm resolution date?"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-017", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, The decision is now official: use the second quote for support coverage."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-020", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "先说重点，等合同盖章满两天后，再找招聘方核实补充材料并记录结果。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-015", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "先说重点，我可能自己看看版本上线，但还没决定什么时候做。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-008", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "刚想到，同样的故障第三次出现，账号又被锁住，整个事情已经客户已经在催。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-014", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Also, Two days after the contract is signed, check with the warehouse lead again about next steps and record the outcome."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-001", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "简单说，我可能自己看看售后范围，但还没决定什么时候做。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-006", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "单独记一下，排期变动仍在评审，当前没有批准结论。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-013", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "还有一件事，一次性完成测试结论即可，交给客服团队后任务结束。"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-004", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "补充一下，评审结束，我的最终选择是先灰度发布，其他方案关闭。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-011", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, I might ask the doctor again someday, but there is no follow-up plan."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-009", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "The main point is this: the account is locked again has reached the point where I cannot continue. When will you actually resolve it?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-017", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "对了，统计报告记录了原材料价格再次上涨，没有客户投诉。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-005", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "对了，项目负责人把交付清单分给你处理，完成时间不能晚于下次评审前。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-009", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "简单说，个人行动项：合同盖章以后再次检查交付日期。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-001", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "One more thing: This is only a personal idea: perhaps I will organize the retro summary someday."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-005", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "另外，统计报告记录了原材料价格再次上涨，没有客户投诉。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-020", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "补充一下，以后说不定会再问招聘方，目前没有后续计划。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-019", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "先说重点，以后说不定会再问法务，目前没有后续计划。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-005", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: Personal action item: check next steps again after the checkup ends."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-016", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "对了，只是个人想法：以后也许整理交付清单，目前没有安排。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-001", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "对了，现在请直接整理预算备注并发给供应商，不需要后续回访。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-010", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "A quick note: support coverage remains under review, with no approval yet."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-005", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "顺便提一句，结论正式生效：售后范围采用线下处理方案。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-013", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "简单说，给自己设一条后续提醒：月底前找房东确认交付日期。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-007", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, I might ask the landlord again someday, but there is no follow-up plan."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-012", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "顺便提一句，只是个人想法：以后也许整理复盘摘要，目前没有安排。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-003", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Just to add, Can you take this assignment and finish the test findings within two business days?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-019", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "One more thing: I reviewed the lightweight version, but have not selected it; the decision waits until tomorrow."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-018", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "顺便提一句，以后说不定会再问仓库负责人，目前没有后续计划。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-013", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "单独记一下，这份交付由你收尾：把验收截图整理好，最迟月底前交给设计同学。"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-006", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For context, The review is over; my final selection is the second quote, and the alternatives are closed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-014", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, Personal action item: check the missing documents again after the payment lands."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-015", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "In short, Because the page stays blank, I cannot continue. Can you provide a firm resolution date?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-016", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "另外，以后说不定会再问招聘方，目前没有后续计划。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-009", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "Just to add, This was promised for today, yet the account is locked again, and now delivery is now delayed."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-018", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "简单说，同样的故障第三次出现，付款结果重复扣款，整个事情已经我无法继续操作。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-012", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "In short, I reviewed vendor C, but have not selected it; the decision waits until tomorrow."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-015", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "先说重点，结论正式生效：售后范围采用先灰度发布。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-017", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "还有一件事，一次性完成测试结论即可，交给设计同学后任务结束。"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-018", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "先说重点，结论正式生效：版本上线采用第二套报价。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-020", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "By the way, Personal action item: check next steps again after the sample arrives."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-007", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, This is only a personal idea: perhaps I will organize the signature page someday."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-018", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "The industry bulletin says that the industry index fell again; this only quotes public information."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-013", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "By the way, Prepare the retro summary now and send it to Support; no later follow-up is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-005", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "顺便提一句，个人行动项：复诊结束以后再次检查处理进度。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-013", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For context, Two days after the patch ships, check with the doctor again about resolution progress and record the outcome."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-015", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Also, Can you close out the test findings before lunch and update Design?"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-001", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "结论正式生效：排期变动采用供应商丙。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-011", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "刚想到，设计同学把复盘摘要分给你处理，完成时间不能晚于午休前。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-009", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "等补丁上线满两天后，再找房东核实补充材料并记录结果。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-004", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "现在请直接整理测试结论并发给运营，不需要后续回访。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-003", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "对了，运营把交付清单分给你处理，完成时间不能晚于月底前。"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-019", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "刚想到，评审结束，我的最终选择是季度结算，其他方案关闭。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-007", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "顺便提一句，这项分工你能接吗：本周收尾时整理复盘摘要？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-020", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "补充一下，给自己设一条后续提醒：下次评审前找房东确认最终结论。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-017", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "先说重点，同样的故障第三次出现，付款结果重复扣款，整个事情已经交付时间被耽误。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-011", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "Just to add, The same failure has happened a third time: the page stays blank, so all work is blocked."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-018", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "By the way, The review is over; my final selection is the offline resolution, and the alternatives are closed."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-007", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "简单说，评审结束，我的最终选择是轻量版本，其他方案关闭。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-014", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "先说重点，给自己设一条后续提醒：月底前找仓库负责人确认到账情况。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-017", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "For the record, Because the page stays blank, my family cannot receive the item. Can you provide a firm resolution date?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-004", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "By the way, Can you take this assignment and finish the budget notes before month-end?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-011", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "以后说不定会再问仓库负责人，目前没有后续计划。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-015", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "By the way, Design assigned the retro summary to you, with completion required before the next review."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-005", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Just to add, You are closing out this deliverable: finish the signature page and give it to Support before the next review."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-002", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "单独记一下，给自己设一条后续提醒：月底前找房东确认下一步安排。"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-012", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, The review is over; my final selection is the offline resolution, and the alternatives are closed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-015", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, This is only a personal idea: perhaps I will organize the delivery checklist someday."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-011", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "One more thing: Finance assigned the delivery checklist to you, with completion required before the next review."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-019", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "对了，现在请直接整理测试结论并发给项目负责人，不需要后续回访。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-002", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "补充一下，运营把复盘摘要分给你处理，完成时间不能晚于下次评审前。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-006", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "One more thing: The statistical report records that the industry index fell again, with no customer complaint."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-006", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "刚想到，这份交付由你收尾：把交付清单整理好，最迟月底前交给运营。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-006", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Prepare the signature page now and send it to Design; no later follow-up is needed."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-006", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "One more thing: The same failure has happened a third time: the account is locked again, so I cannot continue."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-003", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "Also, The industry bulletin says that several stores paused operations; this only quotes public information."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-008", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "单独记一下，到账情况哪天想起来再看，现在不用提醒。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-008", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "In short, The statistical report records that many flights were delayed overnight, with no customer complaint."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-001", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "对了，当前事项结束以后，回头联系房东追踪最终结论。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-015", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "刚想到，一次性完成验收截图即可，交给运营后任务结束。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-003", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "For context, the page stays blank has reached the point where my family cannot receive the item. When will you actually resolve it?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-020", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "补充一下，我可能自己看看资料归档，但还没决定什么时候做。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-014", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "顺便提一句，等补丁上线满两天后，再找客户经理核实最终结论并记录结果。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-010", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "刚想到，排期变动仍在评审，当前没有批准结论。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-019", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "另外，复盘摘要能由你在午休前前收尾吗？完成后告诉供应商。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-002", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "顺便提一句，现在请直接整理验收截图并发给供应商，不需要后续回访。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-007", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "还有一件事，我可能自己看看权限开通，但还没决定什么时候做。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-001", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "简单说，本来承诺今天解决，结果还是物流状态停了五天，现在客户已经在催。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-014", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "In short, The industry bulletin says that several stores paused operations; this only quotes public information."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-018", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "You are closing out this deliverable: finish the signature page and give it to Operations before the next review."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-010", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "顺便提一句，评审结束，我的最终选择是第二套报价，其他方案关闭。"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-020", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "补充一下，结论正式生效：资料归档采用线下处理方案。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-020", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "单独记一下，同样的故障第三次出现，账号又被锁住，整个事情已经工作完全卡住。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-009", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "I might ask the landlord again someday, but there is no follow-up plan."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-017", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "简单说，这项分工你能接吗：明晚之前整理复盘摘要？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-007", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "对了，等复诊结束满两天后，再找客户经理核实补充材料并记录结果。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-017", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "The main point is this: Prepare the signature page now and send it to Design; no later follow-up is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-010", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "By the way, Prepare the budget notes now and send it to the vendor; no later follow-up is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-009", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, I may look into document archiving myself, but I have not decided when."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-010", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "简单说，复盘摘要能由你在月底前前收尾吗？完成后告诉运营。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-018", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Also, Complete the acceptance screenshots once, deliver it to Support, and close the task."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-010", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Also, Personal action item: check next steps again after the client replies."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-003", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Also, The review is over; my final selection is a limited rollout first, and the alternatives are closed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-019", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "对了，我可能自己看看权限开通，但还没决定什么时候做。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-020", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "还有一件事，附件始终打不开已经影响到客户已经在催，你们准备哪天真正解决？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-003", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Also, Set myself a follow-up reminder to ask the warehouse lead about next steps before the next review."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-014", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Also, Can you take this assignment and finish the delivery checklist before month-end?"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-020", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Also, The decision is now official: use the second quote for document archiving."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-013", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "只是个人想法：以后也许整理签字页，目前没有安排。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-002", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For the record, Two days after the sample arrives, check with the warehouse lead again about the missing documents and record the outcome."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-013", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "先说重点，资料归档仍在评审，当前没有批准结论。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-007", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "简单说，个人行动项：合同盖章以后再次检查处理进度。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-015", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "The main point is this: The same failure has happened a third time: the account is locked again, so my family cannot receive the item."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-002", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "The main point is this: Complete the acceptance screenshots once, deliver it to the vendor, and close the task."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-020", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "One more thing: This was promised for today, yet the payment was charged twice, and now all work is blocked."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-019", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "另外，统计报告记录了行业指数连续回落，没有客户投诉。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-016", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Also, the vendor assigned the delivery checklist to you, with completion required before month-end."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-008", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "另外，评审结束，我的最终选择是供应商丙，其他方案关闭。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-014", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "单独记一下，验收截图能由你在午休前前收尾吗？完成后告诉客服团队。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-004", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "By the way, I might ask the landlord again someday, but there is no follow-up plan."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-013", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, the release remains under review, with no approval yet."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-017", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "One more thing: I may look into the release myself, but I have not decided when."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-002", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For context, the timeline change remains under review, with no approval yet."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-007", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "Just to add, This was promised for today, yet the page stays blank, and now all work is blocked."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-003", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "本来承诺今天解决，结果还是附件始终打不开，现在家人收不到商品。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-008", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, Maybe I will revisit the missing documents whenever it comes to mind; no reminder is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-015", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Set myself a follow-up reminder to ask the warehouse lead about the final decision before the next review."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-019", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "A quick note: The same failure has happened a third time: the account is locked again, so all work is blocked."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-004", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "单独记一下，交付清单能由你在午休前前收尾吗？完成后告诉客服团队。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-009", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "单独记一下，交付清单能由你在本周收尾时前收尾吗？完成后告诉供应商。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-015", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "本来承诺今天解决，结果还是账号又被锁住，现在家人收不到商品。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-006", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "补充一下，给自己设一条后续提醒：月底前找法务确认到账情况。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-017", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "Just to add, The industry bulletin says that several stores paused operations; this only quotes public information."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-003", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "最终结论哪天想起来再看，现在不用提醒。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-011", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, Personal action item: check the final decision again after the patch ships."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-007", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, The review is over; my final selection is the second quote, and the alternatives are closed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-005", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, I may look into the timeline change myself, but I have not decided when."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-006", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "另外，当前事项结束以后，回头联系房东追踪到账情况。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-012", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "对了，因为付款结果重复扣款，现在我无法继续操作，能不能给出明确处理时限？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-011", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Two days after the patch ships, check with the warehouse lead again about the delivery date and record the outcome."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-005", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "另外，等样品送达满两天后，再找房东核实到账情况并记录结果。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-005", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "One more thing: Maybe I will revisit the missing documents whenever it comes to mind; no reminder is needed."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-012", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "还有一件事，结论正式生效：售后范围采用轻量版本。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-016", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "The statistical report records that several stores paused operations, with no customer complaint."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-006", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For context, the release remains under review, with no approval yet."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-008", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Two days after the contract is signed, check with the recruiter again about resolution progress and record the outcome."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-001", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "单独记一下，这份交付由你收尾：把预算备注整理好，最迟下次评审前交给客服团队。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-001", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "Also, The industry bulletin says that many flights were delayed overnight; this only quotes public information."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-005", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "After the current item closes, return to the doctor and track resolution progress."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-012", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For context, Complete the test findings once, deliver it to Operations, and close the task."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-004", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "In short, The statistical report records that the industry index fell again, with no customer complaint."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-008", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "顺便提一句，现在请直接整理验收截图并发给设计同学，不需要后续回访。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-007", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "对了，运营把签字页分给你处理，完成时间不能晚于月底前。"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-009", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "另外，结论正式生效：费用调整采用轻量版本。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-018", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "先说重点，我看过第二套报价了，但还没有选择，等明天再决定。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-008", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "对了，这项分工你能接吗：下次评审前整理测试结论？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-014", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "In short, I might ask the doctor again someday, but there is no follow-up plan."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-010", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, Maybe I will revisit the missing documents whenever it comes to mind; no reminder is needed."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_confirmation-006", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "对了，结论正式生效：权限开通采用先灰度发布。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-019", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Two days after the client replies, check with the recruiter again about the final decision and record the outcome."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-008", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "By the way, Complete the retro summary once, deliver it to Support, and close the task."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-001", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: Personal action item: check resolution progress again after the contract is signed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-017", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "简单说，当前事项结束以后，回头联系医生追踪补充材料。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-019", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "By the way, Set myself a follow-up reminder to ask the recruiter about next steps before month-end."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-001", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Just to add, Two days after the sample arrives, check with the account manager again about the missing documents and record the outcome."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-018", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "还有一件事，因为附件始终打不开，现在交付时间被耽误，能不能给出明确处理时限？"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-010", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "Just to add, This was promised for today, yet the page stays blank, and now my family cannot receive the item."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-008", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "因为付款结果重复扣款，现在家人收不到商品，能不能给出明确处理时限？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-018", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Also, Set myself a follow-up reminder to ask the doctor about the delivery date before lunch."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-005", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "By the way, This was promised for today, yet the attachment never opens, and now I cannot continue."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-015", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "先说重点，行业通报称昨夜航班大面积延误，这里只摘录公开信息。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-020", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "还有一件事，资料归档仍在评审，当前没有批准结论。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-010", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "One more thing: Two days after the sample arrives, check with the account manager again about the final decision and record the outcome."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-005", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "对了，现在请直接整理预算备注并发给运营，不需要后续回访。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-007", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Complete the acceptance screenshots once, deliver it to Design, and close the task."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-019", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "刚想到，因为页面一直空白，现在交付时间被耽误，能不能给出明确处理时限？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-006", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "By the way, Can you take this assignment and finish the budget notes before the next review?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-010", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "单独记一下，财务把交付清单分给你处理，完成时间不能晚于本周收尾时。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-013", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: Set myself a follow-up reminder to ask Legal about resolution progress before lunch."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-005", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "另外，交付日期哪天想起来再看，现在不用提醒。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-009", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "简单说，统计报告记录了部分门店暂停营业，没有客户投诉。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-014", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "还有一件事，权限开通仍在评审，当前没有批准结论。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-012", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "等客户回信满两天后，再找房东核实下一步安排并记录结果。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-en-fresh_task_assignment-002", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "In short, Design assigned the signature page to you, with completion required before month-end."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-en-fresh_task_question-005", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Just to add, Can you close out the test findings before the next review and update Design?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-019", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "刚想到，我看过季度结算了，但还没有选择，等明天再决定。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-013", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "交付清单能由你在两个工作日内前收尾吗？完成后告诉供应商。"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-001", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: The review is over; my final selection is the lightweight version, and the alternatives are closed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_self_plan_boundary-012", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, I may look into support coverage myself, but I have not decided when."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-013", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "补充一下，统计报告记录了昨夜航班大面积延误，没有客户投诉。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint_request-007", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "先说重点，因为页面一直空白，现在我无法继续操作，能不能给出明确处理时限？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-011", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "简单说，等合同盖章满两天后，再找招聘方核实补充材料并记录结果。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-017", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "Also, Two days after the contract is signed, check with the account manager again about the delivery date and record the outcome."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-016", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "补充一下，给自己设一条后续提醒：两个工作日内找招聘方确认下一步安排。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-009", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "One more thing: Personal action item: check the missing documents again after the patch ships."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-008", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For context, Personal action item: check resolution progress again after the checkup ends."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_follow_up-013", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "对了，等合同盖章满两天后，再找医生核实最终结论并记录结果。"}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-019", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, The decision is now official: use quarterly billing for the release."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-zh-Hans-fresh_personal_reminder-018", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "还有一件事，个人行动项：样品送达以后再次检查补充材料。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint-004", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "Just to add, The same failure has happened a third time: tracking has not moved for five days, so delivery is now delayed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-020", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "For the record, After the current item closes, return to the recruiter and track the delivery date."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_plain_task_boundary-010", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "补充一下，一次性完成预算备注即可，交给财务后任务结束。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-018", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "这项分工你能接吗：月底前整理预算备注？"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-018", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "In short, Maybe I will revisit payment status whenever it comes to mind; no reminder is needed."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-009", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "对了，设计同学把交付清单分给你处理，完成时间不能晚于明晚之前。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_pending_boundary-001", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "单独记一下，费用调整仍在评审，当前没有批准结论。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_follow_up", "followUpReminder": true, "id": "random-20260827-en-fresh_follow_up-006", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "In short, After the current item closes, return to the warehouse lead and track the missing documents."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_vague_follow_boundary-006", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "For the record, I might ask the account manager again someday, but there is no follow-up plan."}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-012", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "Also, tracking has not moved for five days has reached the point where delivery is now delayed. When will you actually resolve it?"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-019", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "先说重点，同样的故障第三次出现，附件始终打不开，整个事情已经工作完全卡住。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-015", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "复盘摘要能由你在月底前前收尾吗？完成后告诉设计同学。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_pending_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_pending_boundary-009", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "the fee adjustment remains under review, with no approval yet."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-016", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "顺便提一句，行业通报称原材料价格再次上涨，这里只摘录公开信息。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint_request", "followUpReminder": false, "id": "random-20260827-en-fresh_complaint_request-014", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "A quick note: Because the attachment never opens, delivery is now delayed. Can you provide a firm resolution date?"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_vague_follow_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_vague_follow_boundary-001", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "单独记一下，交付日期哪天想起来再看，现在不用提醒。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-001", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "单独记一下，预算备注能由你在下次评审前前收尾吗？完成后告诉客服团队。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-012", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "另外，本来承诺今天解决，结果还是物流状态停了五天，现在工作完全卡住。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_plain_task_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_plain_task_boundary-020", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "By the way, Complete the acceptance screenshots once, deliver it to Finance, and close the task."}
{"complaint": false, "confirmationDecision": true, "family": "fresh_confirmation", "followUpReminder": false, "id": "random-20260827-en-fresh_confirmation-014", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "The main point is this: The decision is now official: use vendor C for the fee adjustment."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-en-fresh_negative_report_boundary-019", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "For the record, The industry bulletin says that many flights were delayed overnight; this only quotes public information."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_self_plan_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_self_plan_boundary-003", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "刚想到，只是个人想法：以后也许整理验收截图，目前没有安排。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_negative_report_boundary", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_negative_report_boundary-014", "invitation": false, "language": "zh-Hans", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "单独记一下，统计报告记录了天气预警已经升级，没有客户投诉。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_question", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_question-005", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "还有一件事，测试结论能由你在月底前前收尾吗？完成后告诉运营。"}
{"complaint": true, "confirmationDecision": false, "family": "fresh_complaint", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_complaint-013", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "split": "randomHoldout", "task": false, "text": "补充一下，本来承诺今天解决，结果还是物流状态停了五天，现在交付时间被耽误。"}
{"complaint": false, "confirmationDecision": false, "family": "fresh_personal_reminder", "followUpReminder": true, "id": "random-20260827-en-fresh_personal_reminder-007", "invitation": false, "language": "en", "question": false, "replyable": false, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": false, "text": "Just to add, Personal action item: check next steps again after the client replies."}
{"complaint": false, "confirmationDecision": false, "family": "fresh_task_assignment", "followUpReminder": false, "id": "random-20260827-zh-Hans-fresh_task_assignment-015", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "split": "randomHoldout", "task": true, "text": "先说重点，这份交付由你收尾：把预算备注整理好，最迟本周收尾时交给供应商。"}
ModelTraining/ClipboardSemantics/fresh-metric-holdout-report.json
-1231
View File
File diff suppressed because it is too large Load Diff
ModelTraining/ClipboardSemantics/online-real-holdout-corpus.jsonl
-200
View File
@@ -1,200 +0,0 @@
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-2550620", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2550620", "split": "onlineRealHoldout", "task": false, "text": "In 2013 I considered taking a course at XXXX XXXX College online and was told the loan would be throu gh First Associates. I never took the course therefore I am not responsible for the loan ... .I spoke with First Associates and they stated that they had paid the school and I was responsible for the loan. A representative from First Associates called and wanted me to ver ify personal information as a victim of identity theft I did not feel comfortable doing so. The representative hung up and next thing I know the account was placed in collections."}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-8866", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-8866", "split": "onlineRealHoldout", "task": false, "text": "冲着金鼎轩的牌子和看了点评才来的，太失望了，服务员一直在收拾桌子，点菜和上菜慢的要命，半个小时菜还没上全，儿童餐椅和餐具数量不够，菜式太少，之前点评里出现的很多菜都没有，难道之前都在刷信誉么？点了肥牛饭和天福号酱肉饭，上来基本都是凉的，既然不是煲仔饭拿一个冰的煲仔装着干嘛？饭只有底下一点是温的，上面都是凉的，卤蛋是冰的，明显就是没热透。脚下的地也都是之前吃的残羹剩饭，不知道怎么回事，以后不会再来了。"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-12856", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2219", "split": "onlineRealHoldout", "task": false, "text": "directions please"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-11773", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2060", "split": "onlineRealHoldout", "task": false, "text": "找下刘若英电影"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-24310", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-24310", "split": "onlineRealHoldout", "task": false, "text": "排队了半个多小时，等待期间没有服务员招待，只能干坐着。开始后服务员一直不理我，叫了好多次才来，菜品个别不新鲜，而且价格真是偏贵，菜品份量不多盘子大而已，酸奶简直要吐了。底锅味道真不如何园的鸿潤轩，而且那边还便宜菜品新鲜。送的什么凉粉简直就是一碗色素调成的，看着都不想吃。最最重要里面有一种叫嫩牛肉，是假的，第一，一点牛肉味都没有，第二一下到锅里立马碎成豆腐渣似的，吃过牛肉的都知道，再怎么腌制牛肉多少还有一点点筋，不会有鸡肉那种嫩嫩的感觉，而这个不知道叫什么东西的居然是嫩牛肉，刷新了我对牛肉的认知。。不会再去第二次。"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-4392346", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4392346", "split": "onlineRealHoldout", "task": true, "text": "I have received a copy of my credit report and it shows company XXXX XXXX account number XXXX. Per FDCPA I am aware that a charge off or collection account is a direct violation due to reporting a balance. The balance must be reported as {$0.00}. Currently I am being violated due to FDCPA because there is an open balance listed on my credit report in the amount of {$610.00}. I have tried many times to get this verified with no such luck. Please review for deletion."}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-7595", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-7595", "split": "onlineRealHoldout", "task": false, "text": "位置比较方便 饭后都会去买一杯 比旁边的coco 快乐柠檬健康的多了 有团购就更划算了 选择的饮品也还算不错 之前都是用大众的会员卡 打个小折 如果人不多的情况 速度超快 就可惜没有积分服务 活动也仅限于团购了吧 \\\\n\\\\n本来好评的店 最后就因为这个女收银 好几次多收客人钱了 第一次是我老公支付宝支付 她多收 后来发现和她说才退钱 这次是我遇到 说不找了 四舍五入 我朋友还碰过一次 类似情况 .. 敢问此女 你是讨饭的吗 讨饭还要看人家肯不肯把这钱给你 太无耻了 大家当心 记住这张脸了"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-2301085", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2301085", "split": "onlineRealHoldout", "task": false, "text": "I noticed that there are XXXX federal lawsuits against the Navient Corp for the way they handle consumers who requested repayment plans. Exactly what happened to others about their student loan happened to me. I called the company and requested to work a payment arrangement based off income. They said they would get back with me. When I did n't hear from them I went into my loan information online and found they had deferred my loan. This was the second time they had done this in 2 years. I am willing to make the payments, but my income was not going to accommodate the amount they were requiring. This loan comes off deferment next month and I will again call them to arrange payment plans."}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-1965672950", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "Laurent2916", "sourceAuthorURL": "https://github.com/Laurent2916", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6360", "split": "onlineRealHoldout", "task": true, "text": "Add support for `Sequence(Audio/Image)` feature in `push_to_hub`"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-3328948690", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "ryan-minato", "sourceAuthorURL": "https://github.com/ryan-minato", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/7738", "split": "onlineRealHoldout", "task": true, "text": "Allow saving multi-dimensional ndarray with dynamic shapes"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2072111000", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "albertvillanova", "sourceAuthorURL": "https://github.com/albertvillanova", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6571", "split": "onlineRealHoldout", "task": true, "text": "Make DatasetDict.column_names return a list instead of dict"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-6305597", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6305597", "split": "onlineRealHoldout", "task": true, "text": "I started the dispute process with this company, as some inaccurate information is been report in my Credit profile. The Dispute process started on XX/XX/2022 with follow ups disputes and this company have not send me any mail or dispute results to my home address, I submitted my ID and proof of address so they can located me, there is not excuses of why I am been ignored on my requests, by law they have the obligation to look into this inaccuracies information. Please see attached and help to resolve this matter soon as possible.."}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-1594", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=269", "split": "onlineRealHoldout", "task": false, "text": "can you tell me the latest news"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-10757", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1877", "split": "onlineRealHoldout", "task": false, "text": "我的购物清单上有什么"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-5262925", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5262925", "split": "onlineRealHoldout", "task": true, "text": "This is in response to case XXXX. I have requested multiple times in writing that Credit Systems Inc provide me with detailed and signed statements. Credit Systems Inc has still failed to provide a detailed statement as to what services were performed for the {$570.00} that they falsely claim that I owe. The CFPB website provides an easy way for Credit Systems Inc to upload the requested documentation. I also find it very suspicious that they claim that I owe them {$570.00} and I paid {$790.00}. I've attempted to contact this collection agency multiple times and they refuse to communicate."}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-3058", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-3058", "split": "onlineRealHoldout", "task": false, "text": "中午一点多过去，进门没有领位。堂食的客人已经不多了，到处都是空着却没有收拾的桌子。所谓随便坐，就只好挑张干净的坐。入座后服务员把点菜iPad给我们以后就再也叫不回来了。又没法自己下单，只好呆呆的望着一群不知道在忙啥反正就是不给你点菜的服务员。呵呵…关键是，iPad里有很多新菜，其实还没开售，也不标示。求爷爷似的叫来服务员说下单，结果却被告知这个不能做那个已沽清，在有这么多问题为什么不提前告知？几乎重新点了一遍菜才下单。好在点的不多上菜比较快，旁边一桌水煮鱼已经点了一小时都没上。相比之下，我们真是万分感恩了！"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-7196", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1273", "split": "onlineRealHoldout", "task": true, "text": "提醒我三月十五日和大文的会面"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-32385", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-32385", "split": "onlineRealHoldout", "task": false, "text": "离第一次吃耶里夏丽也有好多年了，现在店开的越来越多，唯一不变的是生意一直是如此的火爆，其实之前过来的时候因为人多，所以才没有光顾，倒是门口的羊肉串和酸奶冰淇淋已经吃过几次了，挺不错的，这次和朋友聚会，好久没聚了，都是肉食动物，就选了这里，不过感觉现在吃下来，大盘鸡，豪情羊肉都没有以前好吃了，只能说一般般，倒是羊肉串还是依然不错，五个人700元，价格还是小贵，不过生意是真心好，吃到七点半走的时候，竟然还有人在排队，厉害的"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-8516", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1480", "split": "onlineRealHoldout", "task": true, "text": "删除日历项目"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-1939649238", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "ddrous", "sourceAuthorURL": "https://github.com/ddrous", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6299", "split": "onlineRealHoldout", "task": true, "text": "Support for newer versions of JAX"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-47118", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-47118", "split": "onlineRealHoldout", "task": false, "text": "这家小吃店在大行宫地铁站附近，也就是图一所示位置。店面看着不大，进去还是有点大的，进门无人招呼，自己走到选菜的冰柜处找了半天发现装菜的篮子放在不显眼的位置，每个菜一元一串不分蔬菜或者荤菜。有的荤菜很小，一块钱有点不值，蘸料分为油碟和干的花生＋辣椒，4元一份，以为是免费的，结账的时候才说要钱，应该在调料区放置一个提示牌，告诉吃货调料是要钱的。选好菜入座，10分钟无人问我，最后还是自己叫服务员给我加热一下。菜里有一根头发。不知道下菜的时候服务员是否发现？"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-10481", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-10481", "split": "onlineRealHoldout", "task": false, "text": "去年去过，感觉非常好，今年再次去，感觉完全不一样了。地址位置确实不错，江边，餐馆的整个环境也很不错，氛围很好。服务员比较少，因为吃饭的人不多，服务热情正常，没有特别出众的地方。最失望的是菜的口味，跟之前来完全不一样，像换了厨师。咖喱虾完全变味了，非常难吃。菜的量挺足的，但是完全没有摆盘，视觉感觉糟糕，点的豆腐真的就是实实在在的一锅豆腐我也是醉了。总体失望，希望厨师要加把劲，对得起原来这么高的评价..."}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-16470", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2836", "split": "onlineRealHoldout", "task": true, "text": "请添加这个电子邮件的我的联系人"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-4203840", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4203840", "split": "onlineRealHoldout", "task": false, "text": "Two companies are reporting inaccurate information regarding the same account that is already closed going on 7 years and keeps reflecting misidentified information with no factual date background or balance history."}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-8289", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1440", "split": "onlineRealHoldout", "task": true, "text": "把今天的教员会议安排在四点钟"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-4341612", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4341612", "split": "onlineRealHoldout", "task": false, "text": "I have a judgement that is being held against my from XXXX and XXXX XXXX XXXX XXXX Attorney at Law, this judgement resulted as a garnishment. The garnishment was paid in full and I have documentation to prove it. They keep sending me letters saying judgement is valid and that they did an investigation and that it must be paid. I have yet to receive a call back after numerous calls trying to get this resolved."}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-401", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-401", "split": "onlineRealHoldout", "task": false, "text": "90后开的一家比较别具特色的店，但是性价比却并不高，第一这家店的并不实惠，菜价偏贵，菜量少，这家店也就宫保鸡丁拿得出手，还有牛眼肉，但是一份牛眼肉要将近100元，分量还特别少，一碗拳头大的粥要3元钱，分量太少了，装修虽然不错，但是饭店的声音太大，太吵，根本就没好心情就餐，肉本虽然不错，但是也偏贵，一张饼20多元，而且卖相也不好看，切开后肉馅已经和饼分离了。上菜速度太慢，一个肉饼让我等了将近20多分钟，这家总体来说不推荐，差评。"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-3389535011", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "namesarnav", "sourceAuthorURL": "https://github.com/namesarnav", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/7757", "split": "onlineRealHoldout", "task": true, "text": "Add support for `.conll` file format in datasets"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2578675565", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "muthissar", "sourceAuthorURL": "https://github.com/muthissar", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/7213", "split": "onlineRealHoldout", "task": true, "text": "Add with_rank to Dataset.from_generator"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-3388951", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3388951", "split": "onlineRealHoldout", "task": false, "text": "I am writing this due to non-compliance with ( XXXX, XXXX, Transunion ). They have failed to remove information that was affiliated with personal details that were challenged in the past. I strongly believe that they are in violation of the FCRA and are outright refusing to uphold the law."}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-2673", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=448", "split": "onlineRealHoldout", "task": false, "text": "我记得为下一次的医生预约设置提醒闹钟吗"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-1977400799", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "SauravMaheshkar", "sourceAuthorURL": "https://github.com/SauravMaheshkar", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6382", "split": "onlineRealHoldout", "task": true, "text": "Add CheXpert dataset for vision"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-3627028", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3627028", "split": "onlineRealHoldout", "task": false, "text": "I am a victim of identity theft/fraud. I have notified the collection agencies/original creditors several times that the accounts do not belong to me. I have not in any way received goods or services from these companies and I have provided my police reports, my FTC id theft affidavit signed and notarized along with my sworn statement regarding the fraudulent accounts. Documents have been submitted to all credit bureaus."}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-3672", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-3672", "split": "onlineRealHoldout", "task": true, "text": "久负盛名的蜀九香，实在太令人失望了！跟其他家的火锅比，锅底不够香，清汤不够鲜，这些都可以忍，毕竟锅底每家有各自的调味和风格，口味因人而异，不能一概而论，但是食材不新鲜这种火锅店最基本要求都没能做到，实在不能容忍，牛肉不Q弹，又木又柴，羊肉更不用提了，端上来就趴下了，筷子一夹就散，烫完后味如嚼蜡，完全没有羊肉香味，其他就不一一吐槽了，必须差评！！！果断决定不吃了，不能浪费胃里的空间，马上找另一家火锅店重新来过！"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2562392887", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "getao", "sourceAuthorURL": "https://github.com/getao", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/7193", "split": "onlineRealHoldout", "task": true, "text": "Support of num_workers (multiprocessing) in map for IterableDataset"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-4295463", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4295463", "split": "onlineRealHoldout", "task": false, "text": "There are several inaccuracies on my report that I didnt authorize these accounts violating my rights according to the FDCPA. The Credit Reporting agency continues to violate my rights according to 15 USC 1692. \" Any bad debt furnished on your reports is ruining your reputation and it's defamation of character '' I am requestion that the credit agencies stop reporting these accounts and violating my right according to the 15 USC 1692."}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-8182", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1425", "split": "onlineRealHoldout", "task": true, "text": "你能删除牙医预约吗"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-13177", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2266", "split": "onlineRealHoldout", "task": true, "text": "提醒我多运动防止肥胖"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-16605", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2855", "split": "onlineRealHoldout", "task": true, "text": "李雷给我的老板发一封电子邮件"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-1863318027", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "rojagtap", "sourceAuthorURL": "https://github.com/rojagtap", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6172", "split": "onlineRealHoldout", "task": true, "text": "Make Dataset streaming queries retryable"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-27384", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-27384", "split": "onlineRealHoldout", "task": false, "text": "服務態度很不好，並不是惡意差評，他家菜好吃，就是服務跟不上，我團了一個100的，一個50的，告訴我一張台不能一起用，我就說那就用一張100的，退掉一個菜，當時那收銀員就不樂意了，很不耐煩的給我用了，一開始我們選好菜叫服務員根本沒人理。等了好久才過來點菜，也許是因為那個時間都是休息了所以會怠慢些，就是那收銀員的態度實在不能接受，絕對不去了。過了好久才來評論，是因為輕易不評論，我朋友想去吃。我直接告訴她，別去了，去那吃飯還受氣！要嘛就打包回來！他家菜還挺好吃的！朋友說不去挑戰了。。。。"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-4631876", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4631876", "split": "onlineRealHoldout", "task": false, "text": "I checked my credit and noticed a account and multiple hard inquiries I do not recognize"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2065637625", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "yuvalkirstain", "sourceAuthorURL": "https://github.com/yuvalkirstain", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6560", "split": "onlineRealHoldout", "task": true, "text": "Support Video"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-11744", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2055", "split": "onlineRealHoldout", "task": false, "text": "奥莉，这周末有什么新的剧情电影"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2242968745", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "albertvillanova", "sourceAuthorURL": "https://github.com/albertvillanova", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6810", "split": "onlineRealHoldout", "task": true, "text": "Allow deleting a subset/config from a no-script dataset"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2150800065", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "albertvillanova", "sourceAuthorURL": "https://github.com/albertvillanova", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6690", "split": "onlineRealHoldout", "task": true, "text": "Add function to convert a script-dataset to Parquet"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-18367", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-18367", "split": "onlineRealHoldout", "task": false, "text": "宜宾的朋友带来的，说是这里菜做的不错。今天算是感受了下全竹宴，竹荪蛋，竹毛肚，竹胎盘，竹笋等等等等跟竹子有关的食材，确实是生态的东西，不添加额外的添加剂，天然的味道，很巴适。\\\\n价格有点贵哦，我们八个人吃下来一千多，随便一个菜都是七八十，但是最后还是打了点折。米饭不是很好吃，有点过耙了，服务挺好的，大多是一些十几岁的学生，估计是大假帮着家里的懂事的小主人。\\\\n过节出来就是感觉有点烧人，不过没办法，自己选择出来的，只能认了"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-8269", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1436", "split": "onlineRealHoldout", "task": true, "text": "在星期二的会议前三十分钟提醒"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-11947", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2091", "split": "onlineRealHoldout", "task": false, "text": "我附近有什么餐馆"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-13340", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2291", "split": "onlineRealHoldout", "task": false, "text": "我希望它能像 wolfram alpha 那样从搜索结果中计算出答案"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-25316", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-25316", "split": "onlineRealHoldout", "task": false, "text": "昏过去，多年专业评审的我极少给差评。十几桌事先定好过来的，上来的菜质量太差。剁椒鱼头，鱼是臭的，鱼肉全部烂掉⋯⋯服务员还不承认一口新鲜活杀！侮辱我智商吗？这么多人吃出毛病负责吗?直接叫经理退货，过了半小时再上来的鱼还有点样子！清蒸白水鱼，是盐过的鱼，居然是半条⋯⋯西湖莼菜汤，莼菜像梅干菜，稀稀两两几片，根本不是新鲜莼菜烧的，一碗刷锅水啊⋯⋯五谷杂粮，要不要那么省，芋艿不是整齐几块，而是根部几个头。太过分了吧！开门做生意，良心生意是立足之本，这种质量和服务，全甪直镇奇葩第一家！"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-8280", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1438", "split": "onlineRealHoldout", "task": true, "text": "需要在三月十五日设置提醒"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-13181", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2268", "split": "onlineRealHoldout", "task": false, "text": "check for all the movie theater prices and availability for a newly released movie in my location"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-22258", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-22258", "split": "onlineRealHoldout", "task": false, "text": "总体感觉一般，新开的店面，今天五折最后一天，服务员整体乱糟糟，叫号乱，收拾桌子乱，叫人叫不到，催单催不到，就一个乱字。食物味道就是一般的东南亚风味，没有惊喜，椰皇小到只有我的拳头大，喝的时候并没有椰子的清甜味，有点不知道怎么形容的味道，喝两口弃。点了扎肉汤粉，上来的时候，汤粉是粘在一块，用筷子搅拌好几次才分开，汤味淡，配料给得太随便。最后上的烤猪排，催了两次单，等足四十分钟才上，味道尚算可以。入店后发现店面其实也不是很大，即便今天多人排队，但是店里面能坐下就那么多人数，人员配置却跟不上。"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-7151", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1264", "split": "onlineRealHoldout", "task": true, "text": "在每个奇数周日设置一个提醒"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-41096", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-41096", "split": "onlineRealHoldout", "task": false, "text": "难吃难吃难吃！！点了六七道菜就只有饺子入得下口！那个什么金粉的，恶心死了就好像烂菜炒的，点菜的时候图片看起来都很不错，可是实物惨不忍睹，汤图片上是白色的拿过来是棕色的也没什么味道完全水加盐！那个金糕图片看起来也是很美味的，实物味道实在是吃不下！结果这顿饭菜几乎没怎么吃，我们是不喜欢浪费的，可居然有如此难吃之食物让人难以下咽，就算不愿意浪费也做不到了，实在是服了！！桌上也没有放醋的碗…总之这是我第一次在万达吃饭这么不满意！！难得用一次大众点评竟然是给差评，但也没办法着实是不满意！"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-2742619", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2742619", "split": "onlineRealHoldout", "task": true, "text": "I do not have the dates of my student loan. It was XX/XX/XXXX or XX/XX/XXXX. XXXX sold me \" college '' debt and the education was n't worth transferring credits bit they helped me get my student loans and grants put thru. I have heard there was a lawsuit. I really need this resolved so I can go back to school. This time just for a certfication. XXXX is like half student loans. Can You Help?"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-7285245", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7285245", "split": "onlineRealHoldout", "task": false, "text": "On XXXX XXXX I sent a letter regarding an accurate and unknown things on my credit report to this day over 45 days later I have not received a response yet. I feel like Im being taken advantage of and being ignored. Section 611 ( a ), It states that a failure to investigate these items within 30 days gives a reason to immediately remove those items from my credit report its been over 45 days so they should be deleted promptly. I demand that these accounts be deleted immediately or I will file for litigation due to the stress you have caused me. My information was also impacted by the XXXX data breach and may have gotten into hands of the wrong person. ''"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-2769739", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2769739", "split": "onlineRealHoldout", "task": false, "text": "Wells Fargo is getting rich on the backs of poor, and unwilling victims. I have requested that transactions not be honored if inadequate funds in account. I wish not to accrue overdraft fees. I opted out of this service and am being charged these fees despite my objection to the service. I am being told that there is not option but I was asked if I wanted to decline tis service and have several times. I do not want transactions to clear where there are no funds available to cover the transaction. I do not wish to pay those overdraft fees."}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2328637831", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "yuvalkirstain", "sourceAuthorURL": "https://github.com/yuvalkirstain", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6940", "split": "onlineRealHoldout", "task": true, "text": "Enable Sharding to Equal Sized Shards"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-8270", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-8270", "split": "onlineRealHoldout", "task": false, "text": "先说地理位置。古漪园。旁边。进门感受。一般性。当我们点了小笼时。竟然忽悠我们再点一份。这么难吃！皮厚。没较劲。跟在吃面粉一样。肉一般般！那个蛋饼。我竟然吃出了虾的味道。你是加量了吗！！又干又不好吃。还偏咸！！另外最后一道里面的方肉！我只想说几块钱买的。就这么欺骗消费者。满满的面粉。真是好吃的狠啊！价格贵。味道不咋地。如何对得起百年。我想问。老板真的是百年吗？差差差！！！！！！！！！！！！！！！！！"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-10816", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1891", "split": "onlineRealHoldout", "task": true, "text": "创建一个播放列表"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2303855833", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "umarbutler", "sourceAuthorURL": "https://github.com/umarbutler", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6907", "split": "onlineRealHoldout", "task": true, "text": "Support the deserialization of json lines files comprised of lists"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-8602", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-8602", "split": "onlineRealHoldout", "task": false, "text": "其实味道还可以金针菇很油但是味道还不错感觉就是超市那种袋装的油闷金针菇打开来放在盆子里，鳕鱼饼也是很油，上来时是烫的应该现炸的，味道有点淡如果配上些酱就好了。日式猪排拉面上来的时候只有面，里面有玉米笋海带什么的，以为上错了就跟服务员说了，可是态度真的很凶说猪排等会来。因为是两个女生就只点了一碗面和一些小吃，面来了问服务员再要一个碗，怎么都不肯给说碗来不及洗了没碗…那我就不明白那些放小菜的碗是哪来的了…不会再去了…"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-3771", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=644", "split": "onlineRealHoldout", "task": false, "text": "tell me about alarms"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-14030", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-14030", "split": "onlineRealHoldout", "task": false, "text": "因为之前吃过这家店觉得味道不错 所以特意过来再吃 不知道是发生了什么事 店家的味道一落千丈 点的莴笋馋嘴牛蛙 菜一上来就是分颜色的 一半红色一半咖啡色 和之前不同 莴笋看上去有些怪怪的 吃在嘴里竟是苦的 手撕包菜大小参差不齐 有焦的也有夹生的 叫服务员买单 等了10分钟没反应 等终于反应过来了 让等一下 然后把我们桌上所有的餐具盘子收干净了 感觉切配的不用心 做菜的不走心 服务的最关心的不是服务好客人 是翻桌 体验非常差 以后不会再来"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-5974", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1030", "split": "onlineRealHoldout", "task": false, "text": "我设置中午吃药的闹钟了吗"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-8520", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1481", "split": "onlineRealHoldout", "task": true, "text": "添加事件在日历应用上"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-4706895", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4706895", "split": "onlineRealHoldout", "task": false, "text": "I have filed a dispute regarding the incorrect items on my credit report. It has been over 30 days and I have not received any investigation results."}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-10523", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1838", "split": "onlineRealHoldout", "task": true, "text": "从我的中国风歌单中删除列表"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-18424", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-18424", "split": "onlineRealHoldout", "task": false, "text": "实话实说，算老顾客了，从你们之前开的烤古，后来原址开的BIRD LAND，之前去还不错，店员都感觉不错，菜品也多，现在这家各种不行，从门口刚进门开始说，木质踏板坏的，进门后吧台中间吧台烧烤位置防护做的不到位会四溅，就连碟子都换白色了，茶水都没有了，菜单由原来的黄色牛皮纸改白纸加塑料保护膜，因为感觉自己开红了，客人感受都不顾的店，感觉第二家丁丁麻辣烫，还有烤物都是冷冻甚至速冻的，后悔昨晚吃了这顿，回到家到今天上吐下泻，看来要吃还是要吃宁波老牌店，新崛起的不行"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-2790289", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2790289", "split": "onlineRealHoldout", "task": false, "text": "I have no knowledge of any accounts with XXXX XXXX Ive never ordered anything or received any services from this company. Ive repeatedly disputed this account with each credit bureau and asked for validity of this account. No one has ever sent me any signed contracts or anything verifying that I own an account with XXXX XXXX or that I owe them any money. This account is negatively affecting my credit and hindering me from obtain any good credit."}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-2383661", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2383661", "split": "onlineRealHoldout", "task": false, "text": "Called my parents phone and discussed my debt with them. I had n't lived at my parent 's house in 20 years"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-1929551712", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "rajveer43", "sourceAuthorURL": "https://github.com/rajveer43", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6284", "split": "onlineRealHoldout", "task": true, "text": "Add Belebele multiple-choice machine reading comprehension (MRC) dataset"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-12961", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2231", "split": "onlineRealHoldout", "task": false, "text": "please define forensic"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-15305", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2625", "split": "onlineRealHoldout", "task": false, "text": "do i have any notifications from social media"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-3171883522", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "albertvillanova", "sourceAuthorURL": "https://github.com/albertvillanova", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/7637", "split": "onlineRealHoldout", "task": true, "text": "Introduce subset_name as an alias of config_name"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-12797", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2205", "split": "onlineRealHoldout", "task": false, "text": "train times from near me to location"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-15565", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2672", "split": "onlineRealHoldout", "task": true, "text": "你能告诉春秋航空我再也不用他们了"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-3936", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=673", "split": "onlineRealHoldout", "task": false, "text": "气温多少度啊"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-4934", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=852", "split": "onlineRealHoldout", "task": false, "text": "what time is my domino's order expected to arrive"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-10433", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1821", "split": "onlineRealHoldout", "task": true, "text": "删除我的任务清单"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-10513", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1837", "split": "onlineRealHoldout", "task": true, "text": "我想做这周的购物清单"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-33771", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-33771", "split": "onlineRealHoldout", "task": false, "text": "等位的人挺多的，等了大概半个多小时，然后点菜。要芒果汁没有，橙汁没有，玉米汁没有，虾也没有，100样通通都没有。#梅子里脊#跟西瓜搭配也挺普通的，稍微有点酸了。#茶树菇芹菜#算是不错的一个菜了，大概个人比较喜欢吃茶树菇。#干锅花菜#偏咸了。最好吃的应该是豆腐皮了，挺特别的，微辣，口感不错。点的鱼头汤，豆腐也没了，帮我们加了乌冬面，乌冬面特别不入味，好淡，鱼头汤味道也一般，鱼有点腥。这家除了布置装修的还不错，为什么有这么多人给5星？！开张发票还不能刮奖。。。"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-1884324631", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "mariosasko", "sourceAuthorURL": "https://github.com/mariosasko", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6221", "split": "onlineRealHoldout", "task": true, "text": "Support saving datasets with custom formatting"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-14417", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2480", "split": "onlineRealHoldout", "task": false, "text": "which ocean touches at our continent"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-1893337083", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "hgt312", "sourceAuthorURL": "https://github.com/hgt312", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6235", "split": "onlineRealHoldout", "task": true, "text": "Support multiprocessing for download/extract nestedly"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-1301", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=221", "split": "onlineRealHoldout", "task": false, "text": "告诉我特朗普外交政策的新闻"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-2496796", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2496796", "split": "onlineRealHoldout", "task": true, "text": "I am writing to dispute XXXX XXXX # XXXX on cr edit report number XXXX The balance listed on the account is incorrect. Please delete the account."}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2997422044", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "mashdragon", "sourceAuthorURL": "https://github.com/mashdragon", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/7520", "split": "onlineRealHoldout", "task": true, "text": "Update items in the dataset without `map`"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-3751654", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3751654", "split": "onlineRealHoldout", "task": false, "text": "They got my name wrong on my credit card and I was never able to see that account on my mobile phone 's app or online. I didn't get the billing amount for that account. They have. closed my credit card and left two late payment mark on my credit account."}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2424488648", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "lappemic", "sourceAuthorURL": "https://github.com/lappemic", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/7063", "split": "onlineRealHoldout", "task": true, "text": "Add `batch` method to `Dataset`"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2008195298", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "severo", "sourceAuthorURL": "https://github.com/severo", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6447", "split": "onlineRealHoldout", "task": true, "text": "Support one dataset loader per config when using YAML"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-10473", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-10473", "split": "onlineRealHoldout", "task": false, "text": "去年光顾过一次感觉还行，虽然速度一如慢，菜品还行也拍了照片，今天又去了，明显不行，去的是午餐时间，一个人也没有，当然了，外卖为主，可以理解，只是速度慢得不要不要的，点了牛腩饭，冬阴功汤，炸鸡翅，虾饼，芒果糯米饭，第一份上来是冬阴功汤，吓我一跳，很小的碗半碗装，根本没法喝，因为这半碗装也就是被香料填补的，喝最好过滤，对比去年的照片，明显偷工减料了。其它都过很久才上，真心照片也没兴趣拍了，本来可以放去年拍的照片的，只是不想误导，生意越来越好，品质越来越差"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-8570", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1490", "split": "onlineRealHoldout", "task": true, "text": "请注意明天下午两点我正忙着参加一个活动"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-11598", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2030", "split": "onlineRealHoldout", "task": false, "text": "please let me know the dog shows events going on in my home town"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-6410276", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/6410276", "split": "onlineRealHoldout", "task": false, "text": "On XXXX Experian & XXXX responded to my dispute to this public record being reported on my credit report stating it was verified accurate by primary creditor is bankruptcy court. So on XXXX XXXX I wrote us bankruptcy court asking them to verify this information. In which on XXXX is bankruptcy court responded they do not report to the credit bureaus. This is a Violated Of My FCRA 611 ( 15 U.S.C 1681 ) This Information must be Removed! Attached is my letter along with us Bankruptcy court response"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-2553001", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2553001", "split": "onlineRealHoldout", "task": false, "text": "I 've been trying to resolve multiple negative student loan accounts on my credit report. The Credit Bureau ( XXXX XXXX, Transunion ) are neglecting to verify/validate the accounts properly to determine which ones are duplicates or original. Due to poor and lack of investigation and communication I 'm requesting that all of the closed student accounts be removed. I have one student loan account and the negative accounts that are showing as paid off are hurting my scores. Also, there is a collection agency called XXXX XXXX account that 's showing on all three bureaus that has n't been removed after failure to validate the debt."}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-22764", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-22764", "split": "onlineRealHoldout", "task": false, "text": "感觉现在时时乐越来越差了，首先是沙拉少了好几种，而且内容也偷工减料了。原来有一个黄桃培根的沙拉现在没有了，杏仁蔓越莓鸡肉那个发现几乎看不见杏仁片和鸡肉了，沙拉现在真是越来越素了。。。完了周三的特价其实一算也没便宜，比如鸡肉和猪肉的套餐，原来分别单点69.89吧，包含两份沙拉，，现在周三套餐99，但是只有一份沙拉了，两个人去还要再点一份沙拉，完了原来里面的烤土豆或者薯条也没有了…所以一点也没有便宜。服务员清理盘子也不是很勤快，看见好几次有服务员从桌前走过，还特意看了我们桌上一眼空盘子，然后就那么走过去了。。。"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-16518", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2841", "split": "onlineRealHoldout", "task": true, "text": "为郑小美添加一个新电子邮件"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-12908", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2226", "split": "onlineRealHoldout", "task": false, "text": "what time does the train arrive in sacremento"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-32729", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-32729", "split": "onlineRealHoldout", "task": false, "text": "第一次去，各种菜都不错。感觉特好。第二次去，估计换了大厨。粥是掺水不熟，米饭不熟，汤暴咸。阿姨还行，说，不行就退了。过来一个老先生，态度特别不好的说，你说不熟就不熟，这店我管理的，我想怎样就怎样。当时一听就很不舒服，这是一个服务人员该有的态度吗？我又不是存心找茬，有问题你们虚心接受不就好了，作为消费者有权对享有合格的食物及优质的服务，我说：这是上海滩，不是你家。然后他居然自己摔砸自家店东西。有点想打架的趋势，好怕，撤退。"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-35541", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-35541", "split": "onlineRealHoldout", "task": false, "text": "菜的味道和以前比差的不是一点点的。更奇葩的是看菜单点的菜里面会少更多东西。干锅花菜菜单显示有肉150克。上来竟没有一点肉。飘香牛肉菜单显示有金针菇的上来也没有。找服务员后服务员给的回答更是奇葩，说飘香牛肉以实物为准。说干锅花菜可能是几分一起烧的说一这份肉没有。我想难道肉都去别的座上了吗。飘香牛肉以实物为准那是不是连牛肉也可以不用放了呀。就是一个字差。劝大家以后可以对辛香汇绕道了。吃饭是件开心的事。去了辛香汇吃饭反而让自己添堵。"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-14117", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2428", "split": "onlineRealHoldout", "task": false, "text": "where are pyramids located"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-28245", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-28245", "split": "onlineRealHoldout", "task": false, "text": "来过两次了.点了酱香湄公鱼～说是微辣却一点都不辣，而且咸的要命。第二次点蒜香跟服务员说少辣，好了，看到菜单打了个少辣，你妹还是那么辣。辣椒不用钱也不是这样～酸梅汤太甜的好假，糖精放多了么，两次来点的酸梅汤一杯少一杯多～饮料都放的那么随意。加冰也没加。叫服务员去打冰块半天才好。催了几次说厨房忙打冰块要稍等。而且鱼头鱼尾焦的。基本苦的。没动过，可能烤的都会这样吧！点个冷菜盘子都是烂的！感觉像个乞丐在吃鱼"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-8302", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1444", "split": "onlineRealHoldout", "task": true, "text": "删除下周一的会议"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-14323", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2462", "split": "onlineRealHoldout", "task": false, "text": "what color is a dragon fruit"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-16467", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2835", "split": "onlineRealHoldout", "task": false, "text": "do i have any new emails from my contact q."}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-39305", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-39305", "split": "onlineRealHoldout", "task": false, "text": "这应该是吃的云南馆中最糟的了，服务员态度冷淡，其他菜还凑活，过桥米线油加得特别多，导致吃的时候沾得手上和筷子上全是油，可恶心了（平时我吃汤面时基本不沾半点油的），还特别烫，远烫于其他餐馆的汤面，油的隔热还特别好，吹了几十分钟都还跟最开始的温度完全一样，店内还不提供冰水，所以我只能管他们要了桶冰，然后冰上得感觉跟饮料差不多慢，我还以为他忘了呢，冰加了十几块面感觉还是热的，但最起码可以吃了，走后不久还感觉肚子特别疼，感觉这的米线完全就是在坑钱，我知道这是特殊失误造成的，但我还是想说"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-32804", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-32804", "split": "onlineRealHoldout", "task": false, "text": "第一次去这家，从电梯出来进店门，没有人带位，让我们自己找坐位，点了拌木耳，咸猪手，干锅八爪鱼，小牛排，冷菜上来后在木耳里吃出黑色塑料水管圈，叫他们领导来就说是调料瓶塞，睁眼说瞎话，说送给我们水果，我看旁边每桌都送水果的，糊弄我们，最后木耳取消再免了一个最便宜的菜38元的，买单时查账单，干锅八爪鱼明明是56，打成58，价钱可以乱开的吗，以后不会再去了。希望这家的领导可以整顿一下了。再补充一下，处理这件是的人态度不好，没有道歉还说这个东西吃不坏的，有这么说话的吗？"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-15289", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2621", "split": "onlineRealHoldout", "task": true, "text": "现在发布消息"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-6937", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1226", "split": "onlineRealHoldout", "task": true, "text": "设置一个提醒中午跟老板吃午餐"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2360909930", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "NeilGirdhar", "sourceAuthorURL": "https://github.com/NeilGirdhar", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6980", "split": "onlineRealHoldout", "task": true, "text": "Support NumPy 2.0"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-61", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=12", "split": "onlineRealHoldout", "task": false, "text": "我都设什么闹铃了啊"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-8449", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1470", "split": "onlineRealHoldout", "task": true, "text": "为我女儿的生日设置一个提醒"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-16318", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2806", "split": "onlineRealHoldout", "task": true, "text": "回复电子邮件"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-5335459", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5335459", "split": "onlineRealHoldout", "task": true, "text": ".Hi, I can't believe you guys are taking advantage of me. I AM VERY UPSET the credit bureaus have not responded back to me about my investigation. I sent a letter, it's more than 60days. I need these accounts deleted or updated. These are the items I demanding to be deleted immediately Chapter XXXX bankruptcy XXXX Please remove this bankruptcy from my Public record Chapter XXXX bankruptcy XXXX Please remove this bankruptcy from my Public record"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-41645", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-41645", "split": "onlineRealHoldout", "task": false, "text": "非常难过的一次吃饭经历，我想以后永远都不会来这家店了。烤鸭难吃就算了，酒通通都难喝的不行！有一种白酒卖100元，简直难喝喝吐了！于是换了一种红酒，也是差到不行！酒水真的劝大家不要点，恶心的不行！后来，买单消费了1000多，于是用大众点评的优惠买单，结果服务员没有说清楚是哪家店，直接让我买错到别家店，经理过来解决问题，傻逼的说让我再买一次单，说买错单的责任怪我没看清楚。谁TM来你这里消费还要花双倍的价钱，直接差评。这里服务员都说外地人，智商不要太低，没培训好就出来服务，店长和经理解决问题的能力太差，祝你立马倒闭。"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-14991", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-14991", "split": "onlineRealHoldout", "task": false, "text": "在凯德广场五楼转一圈，还是倾向于妈妈菜。我是奔着名字去的，高峰期要排队，服务还是热情。谁知刚坐下来，手就一模油滋滋的。沙发上还有米粒和汤勺。应该是生意太好来不及收拾。点了妈妈红烧肉、茄子煲、山药木耳，两个人足够吃。怀着期待先尝尝红烧肉，颜色好看，味道应该不错，谁知有点苦。是不是甜面酱加多了，茄子煲也有点咸，配着饭吃还是咸。把希望寄托在山药木耳，山药木耳还是爽口，至少是脆的。既然菜的味道不能满足胃，来点鲜榨，胡萝卜苹果汁和木瓜牛奶。鲜榨弥补了菜品的不足。总之妈妈红烧肉的土豆还是好吃。"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-6023", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1038", "split": "onlineRealHoldout", "task": false, "text": "夜晚会潮了吧唧的吧"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-6936", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1225", "split": "onlineRealHoldout", "task": true, "text": "提醒我上午九点吃药"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-6162", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1071", "split": "onlineRealHoldout", "task": true, "text": "删除闹钟"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-8442", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1469", "split": "onlineRealHoldout", "task": true, "text": "请用这个活动修改我的日程表"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-7121305", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7121305", "split": "onlineRealHoldout", "task": false, "text": "In accordance with the Fair Credit Report Act XXXX Account : AMSHER COLLECTION SE, has violated my rights. 15 U.S.C 1681 Section 602 A, States I have the right to privacy. 15 U.S.C 1681 Section 604 A, Section 2 : It also states a consumer reporting agency can not furnish an account without my written instructions."}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-10640", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1856", "split": "onlineRealHoldout", "task": true, "text": "把洗涤剂加到我要买的东西的清单"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-1964653995", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "bryant1410", "sourceAuthorURL": "https://github.com/bryant1410", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6357", "split": "onlineRealHoldout", "task": true, "text": "Allow passing a multiprocessing context to functions that support `num_proc`"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2730676278", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "yabramuvdi", "sourceAuthorURL": "https://github.com/yabramuvdi", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/7318", "split": "onlineRealHoldout", "task": true, "text": "Introduce support for PDFs"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-7669934", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7669934", "split": "onlineRealHoldout", "task": false, "text": "Im not swayed that Bureaus efficiently pleased the principles of the Fair Credit Reporting Act in completing their investigation. The XXXX, XXXX and XXXX Credit Bureau is reporting inaccurate information on ALLY FINANCIAL. This status is damaging to my report, which would not be happening if the bureaus investigated properly before posting incorrect information. Per FCRA, Reporting must be 100 % accurate. Here is the list of the erroneous account reporting on my Credit report. ALLY FINANCIAL XXXX"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-15370", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-15370", "split": "onlineRealHoldout", "task": false, "text": "在对面的佳家吃汤包，正好看到对面的coco，想买杯咖啡解解腻。买的是大杯拿铁，15米一杯，价格不贵，量也不多，开始我以为给我的是中杯，反复确认才知道这就是大杯……\\\\n\\\\n一定要形容的话，这咖啡给我的感觉就是【寡淡】。咖啡味道清淡、奶味也清淡，感觉水太多了。以前买过coco的布丁奶茶还不错，但咖啡实在是差强人意，不会再点第二次的饮料。\\\\n\\\\n还是就是服务态度，讲真，真算不上好，服务员男生很不耐烦，呵呵。手动再见！"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-2969457", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2969457", "split": "onlineRealHoldout", "task": false, "text": "I was the victim of identity theft and my payments accounts were compromised causing payments to be returned. XXXX XXXX refuses to accept this even though I have sent them a copy of my driver 's identity theft report"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-7356207", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7356207", "split": "onlineRealHoldout", "task": false, "text": "I was scammed by someone by XXXX, I contacted the discover Bank. They couldn't help. They suppose to help and I want my {$600.00} back!"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-13303", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2286", "split": "onlineRealHoldout", "task": false, "text": "can you make dinner for me"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-6865", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1213", "split": "onlineRealHoldout", "task": true, "text": "设置一个通知明天十点的会议"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2393411631", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "yuvalkirstain", "sourceAuthorURL": "https://github.com/yuvalkirstain", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/7030", "split": "onlineRealHoldout", "task": true, "text": "Add option to disable progress bar when reading a dataset (\"Loading dataset from disk\")"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-2821", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-2821", "split": "onlineRealHoldout", "task": false, "text": "东西很贵，还不好吃，服务不到位，说话不算数，明明给了单号让我们排队等，说好了到了的时候给我打电话，结果等到七点都没有电话，过去一问，说我的号早过了，说他们来不及打电话，这个承诺等于什么啊？！点菜时多点了几次服务员还不高兴，要我们想好了再一次点。所有的菜份量很少，石锅土鸡要48元一份，那个锅只有巴掌大，问题味道还不好，菜都咸，3个人吃了将近200元竟然没有吃饱，整个不够吃，这还是第一天，鲈鱼6.8元的时候去吃的呢。所以有看到我的评价的，奉劝一句，千万别和我一样傻去送钱了，真心的不值！"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-3090255023", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "trotsky1997", "sourceAuthorURL": "https://github.com/trotsky1997", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/7584", "split": "onlineRealHoldout", "task": true, "text": "Add LMDB format support"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-23809", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-23809", "split": "onlineRealHoldout", "task": false, "text": "我觉得很有必要说一下，以免其他朋友后悔，和亲戚朋友去吃了一顿，环境一般、水沟没水，有点脏乱的赶脚，脸难看菜难吃，菜品量少，点的茄盒又小又薄就几片，十个人不够一人一片的，极少，吃过那么多餐馆没见过这么少的，叫服务员来问问，说是就是这样的。点了十个热菜没有一个够水准的，家人都说不好吃，说以后再也不来了，碍于情面又不好声张，还花了不少银子，关键是真的不好吃。第二天有朋友问起，还没来得及吐槽朋友就惊呼：“怎么去那里了？那里饭菜死难吃”。于是泪奔啊！以后龙升阁的所有东西坚决杜绝！"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-1655", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=280", "split": "onlineRealHoldout", "task": false, "text": "will it snow tomorrow at noon"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-16297", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2803", "split": "onlineRealHoldout", "task": true, "text": "发送一封电子邮件给李雷告诉他谢谢你"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-4906634", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4906634", "split": "onlineRealHoldout", "task": false, "text": "The creditor company was under LVNV funding And now resurgent capitol. This debt was included in my bankruptcy and it was charged off. This business came back as resurgent capitol and has put this negative on my credit. I paid them {$330.00} and they said they would remove it from my credit. It still on my credit which should have been discharged and I should have never paid something."}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-15304", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2624", "split": "onlineRealHoldout", "task": false, "text": "今天微博有谁关注我了"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-7191973", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7191973", "split": "onlineRealHoldout", "task": false, "text": "15 USC 1681 Section 604 \" States rights to consumers privacy '' Reporting agencies can not furnish an account WITHOUT my WRITTEN consent!"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-3822", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=654", "split": "onlineRealHoldout", "task": false, "text": "告訴我有关汽车的消息"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-16384", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2817", "split": "onlineRealHoldout", "task": false, "text": "嗨我有任何新电子邮件吗"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-16501", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2839", "split": "onlineRealHoldout", "task": true, "text": "请给我的朋友小美发邮件说你好吗"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-1957707870", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "MajdTannous1", "sourceAuthorURL": "https://github.com/MajdTannous1", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6345", "split": "onlineRealHoldout", "task": true, "text": "support squad structure datasets using a YAML parameter"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-7216", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1276", "split": "onlineRealHoldout", "task": false, "text": "a good first impression"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-1994579267", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "NathanGodey", "sourceAuthorURL": "https://github.com/NathanGodey", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6422", "split": "onlineRealHoldout", "task": true, "text": "Allow to choose the `writer_batch_size` when using `save_to_disk`"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-16280", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2800", "split": "onlineRealHoldout", "task": true, "text": "请给在我的家人和朋友列表的韩梅梅发送一封电子邮件"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-5311322", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5311322", "split": "onlineRealHoldout", "task": false, "text": "This agency has been harassing to pay a debt that has already been paid. The debt was paid in XX/XX/XXXX. They are still harassing me. I had to block their number and I am still getting letters. I told a man in XXXX, I would take care of it. I did not even remember the debt and I took care of it like I said I would. I found out today XX/XX/XXXX that they added the debt to my credit report, falsely. They are not managing their accounts correctly or trying to make me pay the debt twice so that they can make money off of me. I am literally in the process of looking for a home and they are messing with my credit score and ability for my family to buy a home."}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-5930768", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5930768", "split": "onlineRealHoldout", "task": true, "text": "I call them and spoke with someone about get this resolved and removed this off of my credit report this is very I call them XX/XX/2018 and they told me they was to have it removed but they never did it so Im writing yall to have it removed now please help me thank you an advance. XXXX XXXX"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-2432", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=412", "split": "onlineRealHoldout", "task": false, "text": "我的订单怎么样了"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-2667679", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2667679", "split": "onlineRealHoldout", "task": false, "text": "I complained back in XXXX about my Chexsystems information being incorrect. They have my middle initial a C when it should be R. Chexsystems told me the report was given by a bank sometime ago, most likely a credit card I tried to apply for years ago. The middle initial in their data base with the letter C is incorrect. They refuse to correct that information. I believe that is why banks, etc. have turned me down several times. There was a time when identity theft was being committed towards me back in XXXX."}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-31955", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-31955", "split": "onlineRealHoldout", "task": false, "text": "真心觉得每次去都那么多人是托，首先服务很差，特别势力眼，穿得好的，点得多的服务员面带微笑，点得少的就爱理不理的。其次，菜品少，这个没所谓，如果每道菜都有自己特别之处也可以接受，但是很抱歉，没有。每个人的评价都是这么少，这么咸，真不值。抄手一碗就4个，各位！我本身食量很小的，和男朋友点的干锅和肥牛，一个抄手一碗饭，快两百，结果我竟然没吃饱，呵呵。最后就是我旁边桌那对情侣点完菜吃了一口就说：哎…真难吃。"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-16377", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2816", "split": "onlineRealHoldout", "task": true, "text": "现在给妈妈发送一封邮件"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-4916048", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/4916048", "split": "onlineRealHoldout", "task": true, "text": "My credit report contains information that is incorrect. It is your responsibility to accurately inform them about the information they require. Please undertake investigations and updates on these accounts and queries, or I will pursue legal action."}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-3120799626", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "avishaiElmakies", "sourceAuthorURL": "https://github.com/avishaiElmakies", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/7594", "split": "onlineRealHoldout", "task": true, "text": "Add option to ignore keys/columns when loading a dataset from jsonl(or any other data format)"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-10792", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1885", "split": "onlineRealHoldout", "task": true, "text": "我需要列一个清单"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-14429", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2483", "split": "onlineRealHoldout", "task": false, "text": "什么是长衫"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-7017720", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7017720", "split": "onlineRealHoldout", "task": true, "text": "This inquiry in not mine, I don't have any relation with these Creditors, and Please remove it from my credit report ASAP."}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2724830603", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "TParcollet", "sourceAuthorURL": "https://github.com/TParcollet", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/7310", "split": "onlineRealHoldout", "task": true, "text": "Enable the Audio Feature to decode / read with an offset + duration"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-15305", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2625", "split": "onlineRealHoldout", "task": false, "text": "我收到任何社交媒体的通知了吗"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-3380445", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3380445", "split": "onlineRealHoldout", "task": false, "text": "This account in the amount of {$3700.00} was placed back on my credit reports after being taken off following an investigation. XXXX XXXX XXXX purchased the account. Previously a police report was presented with this account listed as fraud. All 3 of the credit reporting agencies removed this information from my report. It has now showed up under another name. I did not authorize this account. It was obtained fraudulently and needs to be removed."}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2139640381", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "rwightman", "sourceAuthorURL": "https://github.com/rwightman", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6675", "split": "onlineRealHoldout", "task": true, "text": "Allow image model (color conversion) to be specified as part of datasets Image() decode"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-3303637075", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "intexcor", "sourceAuthorURL": "https://github.com/intexcor", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/7731", "split": "onlineRealHoldout", "task": true, "text": "Add the possibility of a backend for audio decoding"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-8079", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1410", "split": "onlineRealHoldout", "task": true, "text": "给我的烘烤面包设个一小时提醒"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-15467", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2653", "split": "onlineRealHoldout", "task": true, "text": "告诉浙江卫视我讨厌他们"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-2570", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-2570", "split": "onlineRealHoldout", "task": false, "text": "不知是不是和上海的汉舍一家。环境不错，在运河边，不是太吵。但是菜品一般，卤水居然不新鲜…有江团是很不错的，但是口感吃上去怎么有点像鲶鱼…这和江团的肉质感有挺大区别，不知道是不是食品添加剂有点多。笋烧肉，是走油肉配罐头笋，极度失望…没有鲜笋可以换笋干，用肥肉的油蒸会有很好的口感。最后要说的是他们家的服务，有三九严寒天的体验，如果是正夏天我可能觉得还好，天已微凉的初秋就不怎么愉快。全程的服务人员没有一个有微笑过，态度硬冷。就这服务只能说没有管理及培训好。总体评分低，应该不会再来了。这家店在点评上有9.2的分真是奇迹。"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-3829", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=655", "split": "onlineRealHoldout", "task": true, "text": "请删除设置为工作日九点的闹钟"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-8347", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1451", "split": "onlineRealHoldout", "task": false, "text": "what is going on on december fourth"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-2679", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=450", "split": "onlineRealHoldout", "task": false, "text": "温度是会保持不变呢还是会更低"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-28345", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-28345", "split": "onlineRealHoldout", "task": false, "text": "来这里是因为交通便利，离地铁很近，而且看了点评，分数不低，东西选择面也较大。然而，结果却很失望。晚上近六点到的，点单时服务生完全不提到六点马上就会有优惠套餐，只是一再催问除饮料外还要什么零食或甜点等。我点了花茶之后又加了薯条，早了几分钟什么优惠都没有，原价。花茶味道很淡，薯条量很少，也没觉得好吃，感觉味道（包括番茄酱的）还不如快餐店。期间上了趟厕所，在二楼，厕所味道很大，地上都是污水，而且没有卫生纸。二楼是吸烟区，一楼虽然没人吸烟，但厨房在正中间，取而代之的就是一股油烟味。"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-30350", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-30350", "split": "onlineRealHoldout", "task": false, "text": "特意点了一条青斑，做出来居然是臭的，让老板过来尝，还说不会阿是正常的，最后实在骗不过自己的良心说可能就中间有一点臭了，说最后给我们便宜点，四个人一共吃了874，结账800，尼玛一条青斑可是220阿，我们外地的想让我们中间还挪位置让给另外的一桌的评评理，无奈应该是本地人，用方言沟通了一下，人家也不愿意帮我们，吃了哑巴亏，以后也不会再来了！总之要小心，应该是老板女儿，很会说话，大老远来一趟不吵架，为了开心，安慰自己"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-5369853", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/5369853", "split": "onlineRealHoldout", "task": false, "text": "I recently noticed I have been a victim of identity theft. There are some accounts that were opened in my name that I did not open."}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-10600", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1852", "split": "onlineRealHoldout", "task": true, "text": "请把一加仑百分之二的牛奶更新到我的食品杂物清单中"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-3029091", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3029091", "split": "onlineRealHoldout", "task": false, "text": "The first issue is that I closed my account and there is a XXXX balance that they will not return. The second issue is that I filed two disputes for products not received, they want to credit my closed account but yet they will not return the current balance. The current disputes are : 1, {$2400.00} - for door purchases, never received the product, order canceled but bill wad paid in full 2 {$120.00} - for door handle purchased, never received the product, order canceled, billed paid in full. So, in total this company has been paid {$3800.00} of my money and they will not refund it. When I call them, i get the run around and still my money has not been returned."}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-2310599", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/2310599", "split": "onlineRealHoldout", "task": false, "text": "Payments are n't applied correctly and have been paying on them for nearly 20 years. I have had no help in understanding why the amount is barely reduced and sometimes increased monthly after a payment is made. Lately I have to call 9-10 times just to get an answer or things corrected. This is from my XXXX from XXXX University and my XXXX XXXX from the University XXXX."}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-1808154414", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "lhoestq", "sourceAuthorURL": "https://github.com/lhoestq", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6046", "split": "onlineRealHoldout", "task": true, "text": "Support proxy and user-agent in fsspec calls"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2288699041", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "not-lain", "sourceAuthorURL": "https://github.com/not-lain", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6890", "split": "onlineRealHoldout", "task": true, "text": "add `with_transform` and/or `set_transform` to IterableDataset"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-10512", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1836", "split": "onlineRealHoldout", "task": false, "text": "list everything left on my query"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-21204", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-21204", "split": "onlineRealHoldout", "task": false, "text": "很差很差的一家店，价格死贵，一个酱油肘子卖88，一块扎肉卖58，这且不说，菜品全然没有特色，都是家常菜，味道吃不出咸淡，点菜的服务员一问三不知，48元一道荷叶粉蒸肉上来一看，简直就是拍扁了的粽子，全是糯米，可以说是糯米饭饼一块了!筷子翻遍才找到一小块小肉，买单时质问店家，回答说粉蒸肉吃的就是粉啊，晕。出门时店家小姑娘居然还追出来问有没有买单!晕，这道盯得挺牢，可我在帐台买单你怎么没看见呢？心情大坏。反正挨一次斩，也不会再去了，劝大家也不要去，骗人的店!就知道坑钱!"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-13341", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2292", "split": "onlineRealHoldout", "task": false, "text": "我希望它能记住我的喜好当我询问时能根据我的喜好来推荐"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-3607", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-3607", "split": "onlineRealHoldout", "task": false, "text": "为什么要给一星，是因为，上次吃过以后感觉不错，就又带了老公去吃，我吃自助餐不浪费，吃多少点多少，吃到后来就不给我上菜了，我想吃牛舌，就是不给我上，那你既然做不起自助做什么自助，又不是我吃剩了一桌子，那你不给上是应该的，最后回家没吃饱，好了，和你家说再见，虽然你也不在乎我这一个小小的客人，说不定还庆幸像我这样胃口不错的可以不用来吃，但是我还是想说，我以后不会来了，再见，本来很美好的一个晚上就被你们毁了"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-3336952", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/3336952", "split": "onlineRealHoldout", "task": false, "text": "I received a letter from Midland credit management company XX/XX/2019 with a threat to forward my debt to a lawyer. If I did not pay XXXX I repeatedly get phone calls from this company. I have never opened an account with this company. I have never signed a contract or opened credit with them. I am currently working on a credit valatiion letter and a cease to contact. They continually call. I want them off my credit reports as well. Companies should not have so much power to try and scare you into paying them. Everyone has problems in their life. Making threats to sue or jail seizing property is ridiculousle Than you for your help"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2258433178", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "severo", "sourceAuthorURL": "https://github.com/severo", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6830", "split": "onlineRealHoldout", "task": true, "text": "Add a doc page for the convert_to_parquet CLI"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-36123", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-36123", "split": "onlineRealHoldout", "task": false, "text": "要说这家和乐山王浩儿店比，差距不是点把点，最主要是菜品如独蒜等特色全部精简掉了，仅仅牛肉特色还保留着，但牛肉分量不足，用料也比较差。绿缘麻辣烫，本身锅底是统一后台制作配送的，各店锅底没啥区别，唯有菜品和分量比拼。成都李家沱这家店刚开不久，好的地方没感受到，菜品种类和分量都不足，牛华的最大弊病脏乱差服务差全有，居然还排队，成都人真是贱骨头！所以这家店在我看来，没吃过可以去，去过就不想来。下面的图是乐山绿缘王浩儿店，大家看看可看看比较下"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-en-US-7120", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE en-US test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1260", "split": "onlineRealHoldout", "task": false, "text": "what's my schedule like today"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-8290", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1441", "split": "onlineRealHoldout", "task": true, "text": "打开下周周二经理会议的提醒"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-7430321", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7430321", "split": "onlineRealHoldout", "task": false, "text": "{$960.00} Ive tried to dispute it off my credit report. XXXX XXXX"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2802723285", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "JulesGM", "sourceAuthorURL": "https://github.com/JulesGM", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/7377", "split": "onlineRealHoldout", "task": true, "text": "Support for sparse arrays with the Arrow Sparse Tensor format?"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-24918", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-24918", "split": "onlineRealHoldout", "task": false, "text": "无力吐槽的一家店，第一眼感觉还可以，进去之后就感觉被骗了，还是带着公公婆婆去吃的～随意换我们的菜不说，关键是换的菜的价格和原菜价格居然差十多块！服务员态度还很差！还说这也没有那也没有，没商量就把换了的菜端上来，那就告诉我们只能吃，没得选！还说换的菜只会换贵的，结果一看菜单。。。无语，服务员还抵赖！这种店也就是因为酒店在附近才来吃，以后反正再也不会来了～希望大家慎重选择，这种店就不要进了，影响旅游心情！附图中猪肝能做成这样也是醉了，那个生菜就是被换的，还有那个凉拌茄子。。。"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-1986484124", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "leoleoasd", "sourceAuthorURL": "https://github.com/leoleoasd", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6395", "split": "onlineRealHoldout", "task": true, "text": "Add ability to set lock type"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-2122955282", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "albertvillanova", "sourceAuthorURL": "https://github.com/albertvillanova", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6644", "split": "onlineRealHoldout", "task": true, "text": "Support fsspec 2023.12"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-10508", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=1835", "split": "onlineRealHoldout", "task": true, "text": "删除清单项目"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_query_boundary", "followUpReminder": false, "id": "online-massive-zh-CN-14347", "invitation": false, "language": "zh-Hans", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2466", "split": "onlineRealHoldout", "task": false, "text": "什么是假设"}
{"complaint": true, "confirmationDecision": false, "family": "online_cfpb_complaint", "followUpReminder": false, "id": "online-cfpb-7214922", "invitation": false, "language": "en", "question": true, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "CFPB via hpe-ai/customer-complaints", "sourceLicense": "CC0-1.0 source / Apache-2.0 mirror", "sourceURL": "https://www.consumerfinance.gov/data-research/consumer-complaints/search/detail/7214922", "split": "onlineRealHoldout", "task": false, "text": "1main Financial of XXXX XXXX Illinois submitted multiple, unauthorized drafts to my checking account with XXXX XXXX XXXX located in XXXX XXXX, Il causing the bank to CLOSE my checking account and Savings account. They drafted my account EVEN after I submitted a payment. Now I owe the credit union over {$300.00} in overdraft fees and worse, 1main has levied non-sufficient fund fines on top of my loan with them. Isn't this illegal??!? What can be done?"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-1755197946", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "richardwth", "sourceAuthorURL": "https://github.com/richardwth", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/5950", "split": "onlineRealHoldout", "task": true, "text": "Support for data with instance-wise dictionary as features"}
{"complaint": false, "confirmationDecision": false, "family": "online_github_task", "followUpReminder": false, "id": "online-github-1855691512", "invitation": false, "language": "en", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceAuthor": "mariosasko", "sourceAuthorURL": "https://github.com/mariosasko", "sourceDataset": "Sulak2020 GitHub issues multi-repo dataset", "sourceLicense": "CC-BY-4.0 dataset / attributed source issue", "sourceURL": "https://github.com/huggingface/datasets/issues/6159", "split": "onlineRealHoldout", "task": true, "text": "Add `BoundingBox` feature"}
{"complaint": true, "confirmationDecision": false, "family": "online_asap_complaint", "followUpReminder": false, "id": "online-asap-15742", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "negative", "sourceDataset": "Meituan-Dianping/ASAP test", "sourceLicense": "Apache-2.0", "sourceURL": "https://github.com/Meituan-Dianping/asap/blob/975122a60065240124df62cb4d5dbfd19ed9ef2c/data/test.csv#row-15742", "split": "onlineRealHoldout", "task": false, "text": "在火车站附近的一家kfc。那边因为客流量大，店面小的原因，一直有很多人。当然更多人选择外带上火车或者候车时候吃。所以店里还是有三两个空位的，但是点单的队伍很长。我去的时候只要1个人负责点单，但是队伍已经排了有十人了，另2个服务员就在柜台里装忙。过了很久才新开一个窗口点单。而且点单收银的服务员还要负责配餐，几乎3-5分钟才排一个人。还有，店里没有标注不能用肯德基app优惠券点单。居然不让点，说：我们只提供菜单上这几个！最终换了一家店去吃。我以前从来没给过差评，第一次给差评，实在是忍无可忍，太浪费顾客时间了！"}
{"complaint": false, "confirmationDecision": false, "family": "online_massive_task", "followUpReminder": false, "id": "online-massive-zh-CN-16729", "invitation": false, "language": "zh-Hans", "question": false, "replyable": true, "scheduleNegotiation": false, "sentiment": "neutral", "sourceDataset": "AmazonScience/MASSIVE zh-CN test", "sourceLicense": "CC-BY-4.0", "sourceURL": "https://huggingface.co/datasets/AmazonScience/massive?row=2882", "split": "onlineRealHoldout", "task": true, "text": "回复家明发给我的电子邮件告诉他们明天我会跟他们见面"}
ModelTraining/ClipboardSemantics/online-real-holdout-prelabel-correction-report.json
-967
View File
@@ -1,967 +0,0 @@
{
"binaryMacro" : {
"accuracy" : 0.7863,
"f1" : 0.1613,
"precision" : 0.3899,
"recall" : 0.1203
},
"binaryMacroByLanguage" : {
"en" : {
"accuracy" : 0.805,
"f1" : 0.1635,
"precision" : 0.4342,
"recall" : 0.1331
},
"zh-Hans" : {
"accuracy" : 0.7675,
"f1" : 0.1603,
"precision" : 0.3719,
"recall" : 0.1126
}
},
"classifiers" : [
{
"falseNegativeExamples" : [
{
"confidence" : 0.8831,
"family" : "online_massive_task",
"id" : "online-massive-en-US-16438",
"language" : "en",
"text" : "i need this email sent now"
},
{
"confidence" : 0.8183,
"family" : "online_massive_task",
"id" : "online-massive-en-US-9321",
"language" : "en",
"text" : "make the radio turn on now"
},
{
"confidence" : 0.792,
"family" : "online_massive_task",
"id" : "online-massive-en-US-9327",
"language" : "en",
"text" : "please scan the am dial on the radio right now"
},
{
"confidence" : 0.791,
"family" : "online_massive_task",
"id" : "online-massive-en-US-9542",
"language" : "en",
"text" : "let me listen the latest news program on radio"
},
{
"confidence" : 0.7748,
"family" : "online_massive_task",
"id" : "online-massive-en-US-9569",
"language" : "en",
"text" : "ok google play one hundred and six point seven"
}
],
"falsePositiveExamples" : [
{
"confidence" : 0.7822,
"family" : "online_massive_query_boundary",
"id" : "online-massive-zh-CN-11677",
"language" : "zh-Hans",
"text" : "定位下鼎泰丰餐馆"
}
],
"id" : "task",
"metrics" : {
"accuracy" : 0.575,
"f1" : 0.1237,
"falseNegative" : 84,
"falsePositive" : 1,
"precision" : 0.8571,
"recall" : 0.0667,
"total" : 200,
"trueNegative" : 109,
"truePositive" : 6
},
"metricsByLanguage" : {
"en" : {
"accuracy" : 0.53,
"f1" : 0.0784,
"falseNegative" : 47,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.0408,
"total" : 100,
"trueNegative" : 51,
"truePositive" : 2
},
"zh-Hans" : {
"accuracy" : 0.62,
"f1" : 0.1739,
"falseNegative" : 37,
"falsePositive" : 1,
"precision" : 0.8,
"recall" : 0.0976,
"total" : 100,
"trueNegative" : 58,
"truePositive" : 4
}
},
"thresholdAt90Precision" : {
"metrics" : {
"accuracy" : 0.56,
"f1" : 0.0435,
"falseNegative" : 88,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.0222,
"total" : 200,
"trueNegative" : 110,
"truePositive" : 2
},
"threshold" : 0.86
},
"thresholdAt95Precision" : {
"metrics" : {
"accuracy" : 0.56,
"f1" : 0.0435,
"falseNegative" : 88,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.0222,
"total" : 200,
"trueNegative" : 110,
"truePositive" : 2
},
"threshold" : 0.86
},
"thresholdsAt90PrecisionByLanguage" : {
"en" : {
"metrics" : {
"accuracy" : 0.53,
"f1" : 0.0784,
"falseNegative" : 47,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.0408,
"total" : 100,
"trueNegative" : 51,
"truePositive" : 2
},
"threshold" : 0.86
}
},
"thresholdsAt95PrecisionByLanguage" : {
"en" : {
"metrics" : {
"accuracy" : 0.53,
"f1" : 0.0784,
"falseNegative" : 47,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.0408,
"total" : 100,
"trueNegative" : 51,
"truePositive" : 2
},
"threshold" : 0.86
}
}
},
{
"falseNegativeExamples" : [
{
"confidence" : 0.5872,
"family" : "online_massive_query_boundary",
"id" : "online-massive-zh-CN-2921",
"language" : "zh-Hans",
"text" : "中国新闻网上有什么新闻"
},
{
"confidence" : 0.5268,
"family" : "online_massive_query_boundary",
"id" : "online-massive-en-US-16354",
"language" : "en",
"text" : "check for emails from my employer"
},
{
"confidence" : 0.5163,
"family" : "online_massive_query_boundary",
"id" : "online-massive-zh-CN-14117",
"language" : "zh-Hans",
"text" : "金字塔在哪里"
},
{
"confidence" : 0.5,
"family" : "online_massive_query_boundary",
"id" : "online-massive-en-US-11720",
"language" : "en",
"text" : "swimming"
},
{
"confidence" : 0.4906,
"family" : "online_massive_query_boundary",
"id" : "online-massive-en-US-14330",
"language" : "en",
"text" : "where was steve jobs born"
}
],
"falsePositiveExamples" : [
{
"confidence" : 0.9794,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-329",
"language" : "zh-Hans",
"text" : "突然好想你"
},
{
"confidence" : 0.971,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-16519",
"language" : "zh-Hans",
"text" : "我想要添加新邮件到我的联系人"
},
{
"confidence" : 0.9471,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-8",
"language" : "zh-Hans",
"text" : "我们想要粉红色"
},
{
"confidence" : 0.9086,
"family" : "online_massive_task",
"id" : "online-massive-en-US-261",
"language" : "en",
"text" : "i can barely hear you"
},
{
"confidence" : 0.8587,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-6789",
"language" : "zh-Hans",
"text" : "安排星期六下午四点和乔安娜开会"
}
],
"id" : "question",
"metrics" : {
"accuracy" : 0.71,
"f1" : 0.3409,
"falseNegative" : 38,
"falsePositive" : 20,
"precision" : 0.4286,
"recall" : 0.283,
"total" : 200,
"trueNegative" : 127,
"truePositive" : 15
},
"metricsByLanguage" : {
"en" : {
"accuracy" : 0.77,
"f1" : 0.439,
"falseNegative" : 13,
"falsePositive" : 10,
"precision" : 0.4737,
"recall" : 0.4091,
"total" : 100,
"trueNegative" : 68,
"truePositive" : 9
},
"zh-Hans" : {
"accuracy" : 0.65,
"f1" : 0.2553,
"falseNegative" : 25,
"falsePositive" : 10,
"precision" : 0.375,
"recall" : 0.1935,
"total" : 100,
"trueNegative" : 59,
"truePositive" : 6
}
},
"thresholdsAt90PrecisionByLanguage" : {
"en" : {
"metrics" : {
"accuracy" : 0.8,
"f1" : 0.1667,
"falseNegative" : 20,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.0909,
"total" : 100,
"trueNegative" : 78,
"truePositive" : 2
},
"threshold" : 0.91
}
},
"thresholdsAt95PrecisionByLanguage" : {
"en" : {
"metrics" : {
"accuracy" : 0.8,
"f1" : 0.1667,
"falseNegative" : 20,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.0909,
"total" : 100,
"trueNegative" : 78,
"truePositive" : 2
},
"threshold" : 0.91
}
}
},
{
"falseNegativeExamples" : [
],
"falsePositiveExamples" : [
{
"confidence" : 0.9718,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-8",
"language" : "zh-Hans",
"text" : "我们想要粉红色"
},
{
"confidence" : 0.8556,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-329",
"language" : "zh-Hans",
"text" : "突然好想你"
}
],
"id" : "invitation",
"metrics" : {
"accuracy" : 0.99,
"f1" : 0,
"falseNegative" : 0,
"falsePositive" : 2,
"precision" : 0,
"recall" : 0,
"total" : 200,
"trueNegative" : 198,
"truePositive" : 0
},
"metricsByLanguage" : {
"en" : {
"accuracy" : 1,
"f1" : 0,
"falseNegative" : 0,
"falsePositive" : 0,
"precision" : 0,
"recall" : 0,
"total" : 100,
"trueNegative" : 100,
"truePositive" : 0
},
"zh-Hans" : {
"accuracy" : 0.98,
"f1" : 0,
"falseNegative" : 0,
"falsePositive" : 2,
"precision" : 0,
"recall" : 0,
"total" : 100,
"trueNegative" : 98,
"truePositive" : 0
}
},
"thresholdsAt90PrecisionByLanguage" : {
},
"thresholdsAt95PrecisionByLanguage" : {
}
},
{
"falseNegativeExamples" : [
{
"confidence" : 0.777,
"family" : "online_cfpb_complaint",
"id" : "online-cfpb-7191973",
"language" : "en",
"text" : "15 USC 1681 Section 604 \" States rights to consumers privacy '' Reporting agencies can not furnish an account WITHOUT my WRITTEN consent!"
},
{
"confidence" : 0.7219,
"family" : "online_asap_complaint",
"id" : "online-asap-3672",
"language" : "zh-Hans",
"text" : "久负盛名的蜀九香，实在太令人失望了！跟其他家的火锅比，锅底不够香，清汤不够鲜，这些都可以忍，毕竟锅底每家有各自的调味和风格，口味因人而异，不能一概而论，但是食材不新鲜这种火锅店最基本要求都没能做到，实在不能容忍，牛肉不Q弹，又木又柴，羊肉更不用提了，端上来就趴下了，筷子一夹就散，烫完后味如嚼蜡，完全没有羊肉香味，其他就不一一吐槽了，必须差评！！！果断决定不吃了，不能浪费胃里的空间，马上找另一家火锅店重新来过！"
},
{
"confidence" : 0.683,
"family" : "online_cfpb_complaint",
"id" : "online-cfpb-3380445",
"language" : "en",
"text" : "This account in the amount of {$3700.00} was placed back on my credit reports after being taken off following an investigation. XXXX XXXX XXXX purchased the account. Previously a police report was presented with this account listed as fraud. All 3 of the credit reporting agencies removed this information from my report. It has now showed up under another name. I did not authorize this account. It was obtained fraudulently and needs to be removed."
},
{
"confidence" : 0.67,
"family" : "online_cfpb_complaint",
"id" : "online-cfpb-2383661",
"language" : "en",
"text" : "Called my parents phone and discussed my debt with them. I had n't lived at my parent 's house in 20 years"
},
{
"confidence" : 0.6572,
"family" : "online_cfpb_complaint",
"id" : "online-cfpb-4631876",
"language" : "en",
"text" : "I checked my credit and noticed a account and multiple hard inquiries I do not recognize"
}
],
"falsePositiveExamples" : [
{
"confidence" : 0.8704,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-2542",
"language" : "zh-Hans",
"text" : "变成卧室灯光红色和大厅灯正常颜色"
}
],
"id" : "complaint",
"metrics" : {
"accuracy" : 0.62,
"f1" : 0.1163,
"falseNegative" : 75,
"falsePositive" : 1,
"precision" : 0.8333,
"recall" : 0.0625,
"total" : 200,
"trueNegative" : 119,
"truePositive" : 5
},
"metricsByLanguage" : {
"en" : {
"accuracy" : 0.61,
"f1" : 0.0488,
"falseNegative" : 39,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.025,
"total" : 100,
"trueNegative" : 60,
"truePositive" : 1
},
"zh-Hans" : {
"accuracy" : 0.63,
"f1" : 0.1778,
"falseNegative" : 36,
"falsePositive" : 1,
"precision" : 0.8,
"recall" : 0.1,
"total" : 100,
"trueNegative" : 59,
"truePositive" : 4
}
},
"thresholdAt90Precision" : {
"metrics" : {
"accuracy" : 0.615,
"f1" : 0.0723,
"falseNegative" : 77,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.0375,
"total" : 200,
"trueNegative" : 120,
"truePositive" : 3
},
"threshold" : 0.88
},
"thresholdAt95Precision" : {
"metrics" : {
"accuracy" : 0.615,
"f1" : 0.0723,
"falseNegative" : 77,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.0375,
"total" : 200,
"trueNegative" : 120,
"truePositive" : 3
},
"threshold" : 0.88
},
"thresholdsAt90PrecisionByLanguage" : {
"en" : {
"metrics" : {
"accuracy" : 0.62,
"f1" : 0.0952,
"falseNegative" : 38,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.05,
"total" : 100,
"trueNegative" : 60,
"truePositive" : 2
},
"threshold" : 0.77
},
"zh-Hans" : {
"metrics" : {
"accuracy" : 0.62,
"f1" : 0.0952,
"falseNegative" : 38,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.05,
"total" : 100,
"trueNegative" : 60,
"truePositive" : 2
},
"threshold" : 0.88
}
},
"thresholdsAt95PrecisionByLanguage" : {
"en" : {
"metrics" : {
"accuracy" : 0.62,
"f1" : 0.0952,
"falseNegative" : 38,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.05,
"total" : 100,
"trueNegative" : 60,
"truePositive" : 2
},
"threshold" : 0.77
},
"zh-Hans" : {
"metrics" : {
"accuracy" : 0.62,
"f1" : 0.0952,
"falseNegative" : 38,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.05,
"total" : 100,
"trueNegative" : 60,
"truePositive" : 2
},
"threshold" : 0.88
}
}
},
{
"falseNegativeExamples" : [
],
"falsePositiveExamples" : [
{
"confidence" : 0.9258,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-6789",
"language" : "zh-Hans",
"text" : "安排星期六下午四点和乔安娜开会"
},
{
"confidence" : 0.8636,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-7291",
"language" : "zh-Hans",
"text" : "明天早上十点起预定一个小时"
},
{
"confidence" : 0.823,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-7194",
"language" : "zh-Hans",
"text" : "我明天有个会议请设置它"
},
{
"confidence" : 0.8142,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-6878",
"language" : "zh-Hans",
"text" : "安排周五下午两点三十和财务部的会议"
},
{
"confidence" : 0.7838,
"family" : "online_massive_query_boundary",
"id" : "online-massive-zh-CN-14449",
"language" : "zh-Hans",
"text" : "刘亦菲有一个新生儿吗"
}
],
"id" : "scheduleNegotiation",
"metrics" : {
"accuracy" : 0.92,
"f1" : 0,
"falseNegative" : 0,
"falsePositive" : 16,
"precision" : 0,
"recall" : 0,
"total" : 200,
"trueNegative" : 184,
"truePositive" : 0
},
"metricsByLanguage" : {
"en" : {
"accuracy" : 0.99,
"f1" : 0,
"falseNegative" : 0,
"falsePositive" : 1,
"precision" : 0,
"recall" : 0,
"total" : 100,
"trueNegative" : 99,
"truePositive" : 0
},
"zh-Hans" : {
"accuracy" : 0.85,
"f1" : 0,
"falseNegative" : 0,
"falsePositive" : 15,
"precision" : 0,
"recall" : 0,
"total" : 100,
"trueNegative" : 85,
"truePositive" : 0
}
},
"thresholdsAt90PrecisionByLanguage" : {
},
"thresholdsAt95PrecisionByLanguage" : {
}
},
{
"falseNegativeExamples" : [
],
"falsePositiveExamples" : [
{
"confidence" : 0.7756,
"family" : "online_massive_query_boundary",
"id" : "online-massive-zh-CN-5006",
"language" : "zh-Hans",
"text" : "我的闹钟定了多少次啊"
},
{
"confidence" : 0.7361,
"family" : "online_massive_query_boundary",
"id" : "online-massive-en-US-2890",
"language" : "en",
"text" : "current weather"
}
],
"id" : "confirmationDecision",
"metrics" : {
"accuracy" : 0.99,
"f1" : 0,
"falseNegative" : 0,
"falsePositive" : 2,
"precision" : 0,
"recall" : 0,
"total" : 200,
"trueNegative" : 198,
"truePositive" : 0
},
"metricsByLanguage" : {
"en" : {
"accuracy" : 0.99,
"f1" : 0,
"falseNegative" : 0,
"falsePositive" : 1,
"precision" : 0,
"recall" : 0,
"total" : 100,
"trueNegative" : 99,
"truePositive" : 0
},
"zh-Hans" : {
"accuracy" : 0.99,
"f1" : 0,
"falseNegative" : 0,
"falsePositive" : 1,
"precision" : 0,
"recall" : 0,
"total" : 100,
"trueNegative" : 99,
"truePositive" : 0
}
},
"thresholdsAt90PrecisionByLanguage" : {
},
"thresholdsAt95PrecisionByLanguage" : {
}
},
{
"falseNegativeExamples" : [
],
"falsePositiveExamples" : [
{
"confidence" : 0.9686,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-6865",
"language" : "zh-Hans",
"text" : "设置一个通知明天十点的会议"
},
{
"confidence" : 0.9264,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-7287",
"language" : "zh-Hans",
"text" : "提前一天提醒我我的周年纪念日"
},
{
"confidence" : 0.9111,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-6937",
"language" : "zh-Hans",
"text" : "设置一个提醒中午跟老板吃午餐"
},
{
"confidence" : 0.8792,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-6836",
"language" : "zh-Hans",
"text" : "提醒我明天六点的会议"
},
{
"confidence" : 0.8713,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-6901",
"language" : "zh-Hans",
"text" : "明天上午十点提醒我这个会"
}
],
"id" : "followUpReminder",
"metrics" : {
"accuracy" : 0.935,
"f1" : 0,
"falseNegative" : 0,
"falsePositive" : 13,
"precision" : 0,
"recall" : 0,
"total" : 200,
"trueNegative" : 187,
"truePositive" : 0
},
"metricsByLanguage" : {
"en" : {
"accuracy" : 0.96,
"f1" : 0,
"falseNegative" : 0,
"falsePositive" : 4,
"precision" : 0,
"recall" : 0,
"total" : 100,
"trueNegative" : 96,
"truePositive" : 0
},
"zh-Hans" : {
"accuracy" : 0.91,
"f1" : 0,
"falseNegative" : 0,
"falsePositive" : 9,
"precision" : 0,
"recall" : 0,
"total" : 100,
"trueNegative" : 91,
"truePositive" : 0
}
},
"thresholdsAt90PrecisionByLanguage" : {
},
"thresholdsAt95PrecisionByLanguage" : {
}
},
{
"falseNegativeExamples" : [
{
"confidence" : 0.7819,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-9363",
"language" : "zh-Hans",
"text" : "让我们在电台播放热门歌曲"
},
{
"confidence" : 0.7649,
"family" : "online_asap_complaint",
"id" : "online-asap-10473",
"language" : "zh-Hans",
"text" : "去年光顾过一次感觉还行，虽然速度一如慢，菜品还行也拍了照片，今天又去了，明显不行，去的是午餐时间，一个人也没有，当然了，外卖为主，可以理解，只是速度慢得不要不要的，点了牛腩饭，冬阴功汤，炸鸡翅，虾饼，芒果糯米饭，第一份上来是冬阴功汤，吓我一跳，很小的碗半碗装，根本没法喝，因为这半碗装也就是被香料填补的，喝最好过滤，对比去年的照片，明显偷工减料了。其它都过很久才上，真心照片也没兴趣拍了，本来可以放去年拍的照片的，只是不想误导，生意越来越好，品质越来越差"
},
{
"confidence" : 0.7594,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-9591",
"language" : "zh-Hans",
"text" : "听中国之声的养生大讲堂"
},
{
"confidence" : 0.7587,
"family" : "online_massive_task",
"id" : "online-massive-zh-CN-7291",
"language" : "zh-Hans",
"text" : "明天早上十点起预定一个小时"
},
{
"confidence" : 0.749,
"family" : "online_massive_query_boundary",
"id" : "online-massive-zh-CN-2914",
"language" : "zh-Hans",
"text" : "告诉我今天几号"
}
],
"falsePositiveExamples" : [
],
"id" : "replyableMessage",
"metrics" : {
"accuracy" : 0.55,
"f1" : 0.7097,
"falseNegative" : 90,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.55,
"total" : 200,
"trueNegative" : 0,
"truePositive" : 110
},
"metricsByLanguage" : {
"en" : {
"accuracy" : 0.59,
"f1" : 0.7421,
"falseNegative" : 41,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.59,
"total" : 100,
"trueNegative" : 0,
"truePositive" : 59
},
"zh-Hans" : {
"accuracy" : 0.51,
"f1" : 0.6755,
"falseNegative" : 49,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.51,
"total" : 100,
"trueNegative" : 0,
"truePositive" : 51
}
},
"thresholdAt90Precision" : {
"metrics" : {
"accuracy" : 0.975,
"f1" : 0.9873,
"falseNegative" : 5,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.975,
"total" : 200,
"trueNegative" : 0,
"truePositive" : 195
},
"threshold" : 0.05
},
"thresholdAt95Precision" : {
"metrics" : {
"accuracy" : 0.975,
"f1" : 0.9873,
"falseNegative" : 5,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.975,
"total" : 200,
"trueNegative" : 0,
"truePositive" : 195
},
"threshold" : 0.05
},
"thresholdsAt90PrecisionByLanguage" : {
"en" : {
"metrics" : {
"accuracy" : 0.97,
"f1" : 0.9848,
"falseNegative" : 3,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.97,
"total" : 100,
"trueNegative" : 0,
"truePositive" : 97
},
"threshold" : 0.05
},
"zh-Hans" : {
"metrics" : {
"accuracy" : 0.98,
"f1" : 0.9899,
"falseNegative" : 2,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.98,
"total" : 100,
"trueNegative" : 0,
"truePositive" : 98
},
"threshold" : 0.05
}
},
"thresholdsAt95PrecisionByLanguage" : {
"en" : {
"metrics" : {
"accuracy" : 0.97,
"f1" : 0.9848,
"falseNegative" : 3,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.97,
"total" : 100,
"trueNegative" : 0,
"truePositive" : 97
},
"threshold" : 0.05
},
"zh-Hans" : {
"metrics" : {
"accuracy" : 0.98,
"f1" : 0.9899,
"falseNegative" : 2,
"falsePositive" : 0,
"precision" : 1,
"recall" : 0.98,
"total" : 100,
"trueNegative" : 0,
"truePositive" : 98
},
"threshold" : 0.05
}
}
}
],
"corpusRecordCount" : 200,
"exactTrainingOverlapCount" : 0,
"familyCount" : 4,
"generatedAt" : "2026-08-27T01:30:19Z",
"languageCounts" : {
"en" : 100,
"zh-Hans" : 100
},
"manifestSchemaVersion" : 2,
"seed" : 20260831,
"sentiment" : {
"accuracy" : 0.205,
"correct" : 41,
"macroF1" : 0.1745,
"perLabelF1" : {
"negative" : 0.2391,
"neutral" : 0.2844,
"positive" : 0
},
"total" : 200,
"unknown" : 97,
"unknownRate" : 0.485
}
}

Some files were not shown because too many files have changed in this diff Show More