记录三模型话轮检测实验、44点评估及延迟对比

2026-10-14 10:30:22 +08:00
parent 0204f1288a
commit 05f67739ce
75 changed files with 63467 additions and 4 deletions
@@ -0,0 +1,19 @@
+call_id,decision_ms,user_text_at_decision,can_reply_now,confidence,reason,annotator,probability,prediction,correct,error_type,audio_start_ms,audio_end_ms,real_audio_ms,model_input_ms,leading_zero_ms,user_block_origin_ms,input_source,alignment_issue,audio_channel,label_status
+2c83253a-7977-4e3c-a387-0aa1ea06fbe1,48125,型号是24年380大众帕萨特星空龙腾版。,0,low,mid_turn_pause,xlsx_draft,0.9848582744598389,1,0,false_reply,40640.0,48125,7485.0,8000,515.0,40640,asr_user_block,,0,draft
+2c83253a-7977-4e3c-a387-0aa1ea06fbe1,76672,恒泰轮胎前门两条轮胎开裂,0,low,unfinished_expression,xlsx_draft,0.9729918241500854,1,0,false_reply,69860.0,76672,6812.0,8000,1188.0,69860,asr_user_block,,0,draft
+40ae686c-8196-4d7b-b7ad-3e12a427ebb6,65298,轮胎裂纹。,0,low,mid_turn_pause,xlsx_draft,0.9777120351791382,1,0,false_reply,62000.0,65298,3298.0,8000,4702.0,62000,asr_user_block,,0,draft
+40ae686c-8196-4d7b-b7ad-3e12a427ebb6,67943,轮胎裂纹同意更换新轮胎。但是,0,low,mid_turn_pause,xlsx_draft,0.6701734066009521,1,0,false_reply,62000.0,67943,5943.0,8000,2057.0,62000,asr_user_block,,0,draft
+40ae686c-8196-4d7b-b7ad-3e12a427ebb6,70430,轮胎裂纹同意更换新轮胎。但是20,0,low,unfinished_expression,xlsx_draft,0.8732463121414185,1,0,false_reply,62430.0,70430,8000.0,8000,0.0,62000,asr_user_block,,0,draft
+a266b9ef-5e47-4434-a04c-ce4eacd52c19,51080,迈腾2023款330豪华版2.0T。出现的问题是轮购车时间是2024年5月份，里程是6851公里。,0,low,unfinished_expression,xlsx_draft,0.9333261251449585,1,0,false_reply,43080.0,51080,8000.0,8000,0.0,33980,asr_user_block,,0,draft
+a266b9ef-5e47-4434-a04c-ce4eacd52c19,68313,轮胎质量问题规律，排水槽横向竖向龟裂。,0,low,mid_turn_pause,xlsx_draft,0.9889053702354431,1,0,false_reply,60320.0,68313,7993.0,8000,7.0,60320,asr_user_block,,0,draft
+cb3238dc-3946-42a5-aad8-9b9a54226363,70745,轮胎开裂,0,low,mid_turn_pause,xlsx_draft,0.9604700207710266,1,0,false_reply,68160.0,70745,2585.0,8000,5415.0,68160,asr_user_block,,0,draft
+e304f740-85d4-427e-9fd6-c5474e9cd737,40701,帕萨特,0,low,mid_turn_pause,xlsx_draft,0.9875311851501465,1,0,false_reply,37980.0,40701,2721.0,8000,5279.0,37980,asr_user_block,,0,draft
+872a1e67-873a-4c49-a598-b38a670afcad,47187,帕萨特L2025款 ,0,,mid_turn_pause,,0.978554368019104,1,0,false_reply,41620.0,47187,5567.0,8000,2433.0,41620,asr_user_block,,0,unconfirmed_manual
+872a1e67-873a-4c49-a598-b38a670afcad,52326,我的轮胎开裂了。,0,,mid_turn_pause,,0.9859892129898071,1,0,false_reply,44326.0,52326,8000.0,8000,0.0,41620,asr_user_block,,0,unconfirmed_manual
+40ae686c-8196-4d7b-b7ad-3e12a427ebb6,48348,爱车型号是大众帕萨特，购车时间2023年10月份,0,,mid_turn_pause,,0.9889053702354431,1,0,false_reply,41260.0,48348,7088.0,8000,912.0,41260,asr_user_block,,0,unconfirmed_manual
+872a1e67-873a-4c49-a598-b38a670afcad,44810,帕萨特,0,,mid_turn_pause,,0.9777120351791382,1,0,false_reply,41620.0,44810,3190.0,8000,4810.0,41620,asr_user_block,,0,unconfirmed_manual
+872a1e67-873a-4c49-a598-b38a670afcad,45581,帕萨特,0,,mid_turn_pause,,0.7923524379730225,1,0,false_reply,41620.0,45581,3961.0,8000,4039.0,41620,asr_user_block,,0,unconfirmed_manual
+a266b9ef-5e47-4434-a04c-ce4eacd52c19,41219,迈腾2023款330豪华版2.0T,0,,mid_turn_pause,,0.9870367050170898,1,0,false_reply,33980.0,41219,7239.0,8000,761.0,33980,asr_user_block,,0,unconfirmed_manual
+cb3238dc-3946-42a5-aad8-9b9a54226363,41207,我是2023年,0,,mid_turn_pause,,0.9403132200241089,1,0,false_reply,34480.0,41207,6727.0,8000,1273.0,34480,asr_user_block,,0,unconfirmed_manual
+cb3238dc-3946-42a5-aad8-9b9a54226363,49204,我是2023年、2024年1月份购置的迈腾3302023款轿车,0,,mid_turn_pause,,0.9808988571166992,1,0,false_reply,41204.0,49204,8000.0,8000,0.0,34480,asr_user_block,,0,unconfirmed_manual
+cb3238dc-3946-42a5-aad8-9b9a54226363,73640,轮胎开裂，行驶28000公里，轮胎开裂,0,,mid_turn_pause,,0.9870367050170898,1,0,false_reply,68160.0,73640,5480.0,8000,2520.0,68160,asr_user_block,,0,unconfirmed_manual
@@ -0,0 +1,45 @@
+call_id,decision_ms,user_text_at_decision,can_reply_now,confidence,reason,annotator,probability,prediction,correct,error_type,audio_start_ms,audio_end_ms,real_audio_ms,model_input_ms,leading_zero_ms,user_block_origin_ms,input_source,alignment_issue,audio_channel,label_status
+2c83253a-7977-4e3c-a387-0aa1ea06fbe1,21780,贵州省遵义市仁怀市。,1,low,completed_answer,xlsx_draft,0.9875311851501465,1,1,correct,15980.0,21780,5800.0,8000,2200.0,15980,asr_user_block,,0,draft
+2c83253a-7977-4e3c-a387-0aa1ea06fbe1,29860,投诉建议。,1,low,completed_answer,xlsx_draft,0.9403132200241089,1,1,correct,26000.0,29860,3860.0,8000,4140.0,26000,asr_user_block,,0,draft
+2c83253a-7977-4e3c-a387-0aa1ea06fbe1,48125,型号是24年380大众帕萨特星空龙腾版。,0,low,mid_turn_pause,xlsx_draft,0.9848582744598389,1,0,false_reply,40640.0,48125,7485.0,8000,515.0,40640,asr_user_block,,0,draft
+2c83253a-7977-4e3c-a387-0aa1ea06fbe1,64000,行驶3万公里。,1,low,completed_answer,xlsx_draft,0.9875311851501465,1,1,correct,60200.0,64000,3800.0,8000,4200.0,60200,asr_user_block,,0,draft
+2c83253a-7977-4e3c-a387-0aa1ea06fbe1,76672,恒泰轮胎前门两条轮胎开裂,0,low,unfinished_expression,xlsx_draft,0.9729918241500854,1,0,false_reply,69860.0,76672,6812.0,8000,1188.0,69860,asr_user_block,,0,draft
+2c83253a-7977-4e3c-a387-0aa1ea06fbe1,88482,尽快，已经影响行车安全了。,1,low,completed_answer,xlsx_draft,0.9729918241500854,1,1,correct,84780.0,88482,3702.0,8000,4298.0,84780,asr_user_block,,0,draft
+40ae686c-8196-4d7b-b7ad-3e12a427ebb6,22007,宣传。,1,low,completed_answer,xlsx_draft,0.9865230321884155,1,1,correct,18720.0,22007,3287.0,8000,4713.0,18720,asr_user_block,,0,draft
+40ae686c-8196-4d7b-b7ad-3e12a427ebb6,31842,投诉建议。,1,low,completed_answer,xlsx_draft,0.9889053702354431,1,1,correct,28540.0,31842,3302.0,8000,4698.0,28540,asr_user_block,,0,draft
+40ae686c-8196-4d7b-b7ad-3e12a427ebb6,52348,爱车型号是大众帕萨特，购车时间2023年10月份，行驶里程24000多公里。,1,low,completed_answer,xlsx_draft,0.9889053702354431,1,1,correct,44348.0,52348,8000.0,8000,0.0,41260,asr_user_block,,0,draft
+40ae686c-8196-4d7b-b7ad-3e12a427ebb6,65298,轮胎裂纹。,0,low,mid_turn_pause,xlsx_draft,0.9777120351791382,1,0,false_reply,62000.0,65298,3298.0,8000,4702.0,62000,asr_user_block,,0,draft
+40ae686c-8196-4d7b-b7ad-3e12a427ebb6,67943,轮胎裂纹同意更换新轮胎。但是,0,low,mid_turn_pause,xlsx_draft,0.6701734066009521,1,0,false_reply,62000.0,67943,5943.0,8000,2057.0,62000,asr_user_block,,0,draft
+40ae686c-8196-4d7b-b7ad-3e12a427ebb6,70430,轮胎裂纹同意更换新轮胎。但是20,0,low,unfinished_expression,xlsx_draft,0.8732463121414185,1,0,false_reply,62430.0,70430,8000.0,8000,0.0,62000,asr_user_block,,0,draft
+40ae686c-8196-4d7b-b7ad-3e12a427ebb6,82941,可以。,1,low,completed_answer,xlsx_draft,0.9801466464996338,1,1,correct,80060.0,82941,2881.0,8000,5119.0,80060,asr_user_block,,0,draft
+872a1e67-873a-4c49-a598-b38a670afcad,17153,我姓宋。,1,low,completed_answer,xlsx_draft,0.9880069494247437,1,1,correct,14100.0,17153,3053.0,8000,4947.0,14100,asr_user_block,,0,draft
+872a1e67-873a-4c49-a598-b38a670afcad,24846,郑州市，河南郑州市。,1,low,completed_answer,xlsx_draft,0.9884648323059082,1,1,correct,19720.0,24846,5126.0,8000,2874.0,19720,asr_user_block,,0,draft
+872a1e67-873a-4c49-a598-b38a670afcad,33471,我的轮胎开裂了。,1,low,completed_answer,xlsx_draft,0.9854345321655273,1,1,correct,29780.0,33471,3691.0,8000,4309.0,29780,asr_user_block,,0,draft
+a266b9ef-5e47-4434-a04c-ce4eacd52c19,18027,天津市。,1,low,completed_answer,xlsx_draft,0.9884648323059082,1,1,correct,14760.0,18027,3267.0,8000,4733.0,14760,asr_user_block,,0,draft
+a266b9ef-5e47-4434-a04c-ce4eacd52c19,24768,投诉。,1,low,completed_answer,xlsx_draft,0.9880069494247437,1,1,correct,22060.0,24768,2708.0,8000,5292.0,22060,asr_user_block,,0,draft
+a266b9ef-5e47-4434-a04c-ce4eacd52c19,51080,迈腾2023款330豪华版2.0T。出现的问题是轮购车时间是2024年5月份，里程是6851公里。,0,low,unfinished_expression,xlsx_draft,0.9333261251449585,1,0,false_reply,43080.0,51080,8000.0,8000,0.0,33980,asr_user_block,,0,draft
+a266b9ef-5e47-4434-a04c-ce4eacd52c19,68313,轮胎质量问题规律，排水槽横向竖向龟裂。,0,low,mid_turn_pause,xlsx_draft,0.9889053702354431,1,0,false_reply,60320.0,68313,7993.0,8000,7.0,60320,asr_user_block,,0,draft
+cb3238dc-3946-42a5-aad8-9b9a54226363,13540,辽宁葫芦岛。,1,low,completed_answer,xlsx_draft,0.9793655872344971,1,1,correct,10244.0,13540,3296.0,8000,4704.0,10244.0,past_vad_missing_asr,missing_earlier_user_asr_segment,0,draft
+cb3238dc-3946-42a5-aad8-9b9a54226363,27520,投诉建议。,1,low,completed_answer,xlsx_draft,0.9870367050170898,1,1,correct,23920.0,27520,3600.0,8000,4400.0,23920,asr_user_block,,0,draft
+cb3238dc-3946-42a5-aad8-9b9a54226363,60790,我的轮胎行驶28000公里。,0,low,unfinished_expression,xlsx_draft,0.04772377014160156,0,1,correct,55780.0,60790,5010.0,8000,2990.0,55780,asr_user_block,,0,draft
+cb3238dc-3946-42a5-aad8-9b9a54226363,70745,轮胎开裂,0,low,mid_turn_pause,xlsx_draft,0.9604700207710266,1,0,false_reply,68160.0,70745,2585.0,8000,5415.0,68160,asr_user_block,,0,draft
+e304f740-85d4-427e-9fd6-c5474e9cd737,18842,苏州昆山。,1,low,completed_answer,xlsx_draft,0.8732463121414185,1,1,correct,14560.0,18842,4282.0,8000,3718.0,14560,asr_user_block,,0,draft
+e304f740-85d4-427e-9fd6-c5474e9cd737,29619,投诉。,1,low,completed_answer,xlsx_draft,0.9604700207710266,1,1,correct,26560.0,29619,3059.0,8000,4941.0,26560,asr_user_block,,0,draft
+e304f740-85d4-427e-9fd6-c5474e9cd737,40701,帕萨特,0,low,mid_turn_pause,xlsx_draft,0.9875311851501465,1,0,false_reply,37980.0,40701,2721.0,8000,5279.0,37980,asr_user_block,,0,draft
+e304f740-85d4-427e-9fd6-c5474e9cd737,54600,24年11月份购买的帕萨特，15000公里左右。,1,low,completed_answer,xlsx_draft,0.9170267581939697,1,1,correct,46600.0,54600,8000.0,8000,0.0,37980,asr_user_block,,0,draft
+e304f740-85d4-427e-9fd6-c5474e9cd737,65819,四条轮胎，最近我在。,0,low,unfinished_expression,xlsx_draft,0.01514175534248352,0,1,correct,60380.0,65819,5439.0,8000,2561.0,60380,asr_user_block,,0,draft
+872a1e67-873a-4c49-a598-b38a670afcad,47187,帕萨特L2025款 ,0,,mid_turn_pause,,0.978554368019104,1,0,false_reply,41620.0,47187,5567.0,8000,2433.0,41620,asr_user_block,,0,unconfirmed_manual
+872a1e67-873a-4c49-a598-b38a670afcad,52326,我的轮胎开裂了。,0,,mid_turn_pause,,0.9859892129898071,1,0,false_reply,44326.0,52326,8000.0,8000,0.0,41620,asr_user_block,,0,unconfirmed_manual
+40ae686c-8196-4d7b-b7ad-3e12a427ebb6,48348,爱车型号是大众帕萨特，购车时间2023年10月份,0,,mid_turn_pause,,0.9889053702354431,1,0,false_reply,41260.0,48348,7088.0,8000,912.0,41260,asr_user_block,,0,unconfirmed_manual
+872a1e67-873a-4c49-a598-b38a670afcad,44810,帕萨特,0,,mid_turn_pause,,0.9777120351791382,1,0,false_reply,41620.0,44810,3190.0,8000,4810.0,41620,asr_user_block,,0,unconfirmed_manual
+872a1e67-873a-4c49-a598-b38a670afcad,49500,帕萨特L2025款2025年3月购车,1,,completed_turn,,0.9842595458030701,1,1,correct,41620.0,49500,7880.0,8000,120.0,41620,asr_user_block,,0,unconfirmed_manual
+872a1e67-873a-4c49-a598-b38a670afcad,54318,行驶里程29000公里。,1,,completed_turn,,0.9859892129898071,1,1,correct,46318.0,54318,8000.0,8000,0.0,41620,asr_user_block,,0,unconfirmed_manual
+872a1e67-873a-4c49-a598-b38a670afcad,45581,帕萨特,0,,mid_turn_pause,,0.7923524379730225,1,0,false_reply,41620.0,45581,3961.0,8000,4039.0,41620,asr_user_block,,0,unconfirmed_manual
+a266b9ef-5e47-4434-a04c-ce4eacd52c19,41219,迈腾2023款330豪华版2.0T,0,,mid_turn_pause,,0.9870367050170898,1,0,false_reply,33980.0,41219,7239.0,8000,761.0,33980,asr_user_block,,0,unconfirmed_manual
+cb3238dc-3946-42a5-aad8-9b9a54226363,19620,,1,,completed_turn,,0.9870367050170898,1,1,correct,16100.0,19620,3520.0,8000,4480.0,16100,asr_user_block,,0,unconfirmed_manual
+cb3238dc-3946-42a5-aad8-9b9a54226363,41207,我是2023年,0,,mid_turn_pause,,0.9403132200241089,1,0,false_reply,34480.0,41207,6727.0,8000,1273.0,34480,asr_user_block,,0,unconfirmed_manual
+cb3238dc-3946-42a5-aad8-9b9a54226363,49204,我是2023年、2024年1月份购置的迈腾3302023款轿车,0,,mid_turn_pause,,0.9808988571166992,1,0,false_reply,41204.0,49204,8000.0,8000,0.0,34480,asr_user_block,,0,unconfirmed_manual
+cb3238dc-3946-42a5-aad8-9b9a54226363,58424,我的轮胎,0,,mid_turn_pause,,0.044268637895584106,0,1,correct,55780.0,58424,2644.0,8000,5356.0,55780,asr_user_block,,0,unconfirmed_manual
+cb3238dc-3946-42a5-aad8-9b9a54226363,73640,轮胎开裂，行驶28000公里，轮胎开裂,0,,mid_turn_pause,,0.9870367050170898,1,0,false_reply,68160.0,73640,5480.0,8000,2520.0,68160,asr_user_block,,0,unconfirmed_manual
+e304f740-85d4-427e-9fd6-c5474e9cd737,11531,姓赵,1,,completed_turn,,0.9880069494247437,1,1,correct,8740.0,11531,2791.0,8000,5209.0,8740.0,past_vad_missing_asr,missing_earlier_user_asr_segment,0,unconfirmed_manual
+e304f740-85d4-427e-9fd6-c5474e9cd737,62828,四条轮胎,0,,mid_turn_pause,,0.07174640893936157,0,1,correct,60380.0,62828,2448.0,8000,5552.0,60380,asr_user_block,,0,unconfirmed_manual
@@ -0,0 +1,329 @@
+{
+  "total_points": 44,
+  "metrics": {
+    "n": 44,
+    "tn": 4,
+    "fp": 18,
+    "fn": 0,
+    "tp": 22,
+    "accuracy": 0.5909090909090909,
+    "false_reply_rate": 0.8181818181818182,
+    "false_hold_rate": 0.0,
+    "recall": 1.0,
+    "precision": 0.55,
+    "f1": 0.7096774193548387
+  },
+  "grouped": {
+    "label_status": {
+      "draft": {
+        "n": 29,
+        "tn": 2,
+        "fp": 9,
+        "fn": 0,
+        "tp": 18,
+        "accuracy": 0.6896551724137931,
+        "false_reply_rate": 0.8181818181818182,
+        "false_hold_rate": 0.0,
+        "recall": 1.0,
+        "precision": 0.6666666666666666,
+        "f1": 0.8
+      },
+      "unconfirmed_manual": {
+        "n": 15,
+        "tn": 2,
+        "fp": 9,
+        "fn": 0,
+        "tp": 4,
+        "accuracy": 0.4,
+        "false_reply_rate": 0.8181818181818182,
+        "false_hold_rate": 0.0,
+        "recall": 1.0,
+        "precision": 0.3076923076923077,
+        "f1": 0.47058823529411764
+      }
+    },
+    "call_id": {
+      "2c83253a-7977-4e3c-a387-0aa1ea06fbe1": {
+        "n": 6,
+        "tn": 0,
+        "fp": 2,
+        "fn": 0,
+        "tp": 4,
+        "accuracy": 0.6666666666666666,
+        "false_reply_rate": 1.0,
+        "false_hold_rate": 0.0,
+        "recall": 1.0,
+        "precision": 0.6666666666666666,
+        "f1": 0.8
+      },
+      "40ae686c-8196-4d7b-b7ad-3e12a427ebb6": {
+        "n": 8,
+        "tn": 0,
+        "fp": 4,
+        "fn": 0,
+        "tp": 4,
+        "accuracy": 0.5,
+        "false_reply_rate": 1.0,
+        "false_hold_rate": 0.0,
+        "recall": 1.0,
+        "precision": 0.5,
+        "f1": 0.6666666666666666
+      },
+      "872a1e67-873a-4c49-a598-b38a670afcad": {
+        "n": 9,
+        "tn": 0,
+        "fp": 4,
+        "fn": 0,
+        "tp": 5,
+        "accuracy": 0.5555555555555556,
+        "false_reply_rate": 1.0,
+        "false_hold_rate": 0.0,
+        "recall": 1.0,
+        "precision": 0.5555555555555556,
+        "f1": 0.7142857142857143
+      },
+      "a266b9ef-5e47-4434-a04c-ce4eacd52c19": {
+        "n": 5,
+        "tn": 0,
+        "fp": 3,
+        "fn": 0,
+        "tp": 2,
+        "accuracy": 0.4,
+        "false_reply_rate": 1.0,
+        "false_hold_rate": 0.0,
+        "recall": 1.0,
+        "precision": 0.4,
+        "f1": 0.5714285714285714
+      },
+      "cb3238dc-3946-42a5-aad8-9b9a54226363": {
+        "n": 9,
+        "tn": 2,
+        "fp": 4,
+        "fn": 0,
+        "tp": 3,
+        "accuracy": 0.5555555555555556,
+        "false_reply_rate": 0.6666666666666666,
+        "false_hold_rate": 0.0,
+        "recall": 1.0,
+        "precision": 0.42857142857142855,
+        "f1": 0.6
+      },
+      "e304f740-85d4-427e-9fd6-c5474e9cd737": {
+        "n": 7,
+        "tn": 2,
+        "fp": 1,
+        "fn": 0,
+        "tp": 4,
+        "accuracy": 0.8571428571428571,
+        "false_reply_rate": 0.3333333333333333,
+        "false_hold_rate": 0.0,
+        "recall": 1.0,
+        "precision": 0.8,
+        "f1": 0.8888888888888888
+      }
+    },
+    "reason": {
+      "completed_answer": {
+        "n": 18,
+        "tn": 0,
+        "fp": 0,
+        "fn": 0,
+        "tp": 18,
+        "accuracy": 1.0,
+        "false_reply_rate": null,
+        "false_hold_rate": 0.0,
+        "recall": 1.0,
+        "precision": 1.0,
+        "f1": 1.0
+      },
+      "completed_turn": {
+        "n": 4,
+        "tn": 0,
+        "fp": 0,
+        "fn": 0,
+        "tp": 4,
+        "accuracy": 1.0,
+        "false_reply_rate": null,
+        "false_hold_rate": 0.0,
+        "recall": 1.0,
+        "precision": 1.0,
+        "f1": 1.0
+      },
+      "mid_turn_pause": {
+        "n": 17,
+        "tn": 2,
+        "fp": 15,
+        "fn": 0,
+        "tp": 0,
+        "accuracy": 0.11764705882352941,
+        "false_reply_rate": 0.8823529411764706,
+        "false_hold_rate": null,
+        "recall": null,
+        "precision": 0.0,
+        "f1": 0.0
+      },
+      "unfinished_expression": {
+        "n": 5,
+        "tn": 2,
+        "fp": 3,
+        "fn": 0,
+        "tp": 0,
+        "accuracy": 0.4,
+        "false_reply_rate": 0.6,
+        "false_hold_rate": null,
+        "recall": null,
+        "precision": 0.0,
+        "f1": 0.0
+      }
+    },
+    "input_source": {
+      "asr_user_block": {
+        "n": 42,
+        "tn": 4,
+        "fp": 18,
+        "fn": 0,
+        "tp": 20,
+        "accuracy": 0.5714285714285714,
+        "false_reply_rate": 0.8181818181818182,
+        "false_hold_rate": 0.0,
+        "recall": 1.0,
+        "precision": 0.5263157894736842,
+        "f1": 0.6896551724137931
+      },
+      "past_vad_missing_asr": {
+        "n": 2,
+        "tn": 0,
+        "fp": 0,
+        "fn": 0,
+        "tp": 2,
+        "accuracy": 1.0,
+        "false_reply_rate": null,
+        "false_hold_rate": 0.0,
+        "recall": 1.0,
+        "precision": 1.0,
+        "f1": 1.0
+      }
+    }
+  },
+  "config": {
+    "pipecat_version": "1.12.0",
+    "model": "smart-turn-v3.2-cpu.onnx",
+    "threshold": 0.5,
+    "pre_speech_ms": 500,
+    "max_duration_secs": 8,
+    "continuation_gap_ms": 3000,
+    "selected_audio_channel": 0,
+    "model_sha256": "2bb026316b14a660486a75b1733cd3fbab8c2fd0314dc9af7be49f8cca967e4f",
+    "label_sha256": "a809b05bf778532b1b9eb6f64596d7f0a28209869f4fd258e45ede5ce0834db9",
+    "history_sha256": "4c21e20b7323030d590276854f07b454ccbad627e1a7842101a22a99377ffbaa"
+  },
+  "method": "Each exact decision_ms is classified directly by the model. Earlier model scores, EOT signals, VAD stop gates, silence timeout forced replies and ASR return gates never determine prediction or clear this input.",
+  "threshold_diagnostics": [
+    {
+      "threshold": 0.5,
+      "n": 44,
+      "tn": 4,
+      "fp": 18,
+      "fn": 0,
+      "tp": 22,
+      "accuracy": 0.5909090909090909,
+      "false_reply_rate": 0.8181818181818182,
+      "false_hold_rate": 0.0,
+      "recall": 1.0,
+      "precision": 0.55,
+      "f1": 0.7096774193548387
+    },
+    {
+      "threshold": 0.7,
+      "n": 44,
+      "tn": 5,
+      "fp": 17,
+      "fn": 0,
+      "tp": 22,
+      "accuracy": 0.6136363636363636,
+      "false_reply_rate": 0.7727272727272727,
+      "false_hold_rate": 0.0,
+      "recall": 1.0,
+      "precision": 0.5641025641025641,
+      "f1": 0.7213114754098361
+    },
+    {
+      "threshold": 0.8,
+      "n": 44,
+      "tn": 6,
+      "fp": 16,
+      "fn": 0,
+      "tp": 22,
+      "accuracy": 0.6363636363636364,
+      "false_reply_rate": 0.7272727272727273,
+      "false_hold_rate": 0.0,
+      "recall": 1.0,
+      "precision": 0.5789473684210527,
+      "f1": 0.7333333333333333
+    },
+    {
+      "threshold": 0.9,
+      "n": 44,
+      "tn": 7,
+      "fp": 15,
+      "fn": 1,
+      "tp": 21,
+      "accuracy": 0.6363636363636364,
+      "false_reply_rate": 0.6818181818181818,
+      "false_hold_rate": 0.045454545454545456,
+      "recall": 0.9545454545454546,
+      "precision": 0.5833333333333334,
+      "f1": 0.7241379310344828
+    },
+    {
+      "threshold": 0.95,
+      "n": 44,
+      "tn": 9,
+      "fp": 13,
+      "fn": 3,
+      "tp": 19,
+      "accuracy": 0.6363636363636364,
+      "false_reply_rate": 0.5909090909090909,
+      "false_hold_rate": 0.13636363636363635,
+      "recall": 0.8636363636363636,
+      "precision": 0.59375,
+      "f1": 0.7037037037037037
+    },
+    {
+      "threshold": 0.98,
+      "n": 44,
+      "tn": 14,
+      "fp": 8,
+      "fn": 6,
+      "tp": 16,
+      "accuracy": 0.6818181818181818,
+      "false_reply_rate": 0.36363636363636365,
+      "false_hold_rate": 0.2727272727272727,
+      "recall": 0.7272727272727273,
+      "precision": 0.6666666666666666,
+      "f1": 0.6956521739130435
+    },
+    {
+      "threshold": 0.99,
+      "n": 44,
+      "tn": 22,
+      "fp": 0,
+      "fn": 22,
+      "tp": 0,
+      "accuracy": 0.5,
+      "false_reply_rate": 0.0,
+      "false_hold_rate": 1.0,
+      "recall": 0.0,
+      "precision": null,
+      "f1": 0.0
+    }
+  ],
+  "audio_origin": "Past ASR user segments locate current speech block. Consecutive user segments within 3 s share the first start unless a complete non-overlapping robot question separates them. Keep 500 ms before that start and then last 8 s. Intra-segment pauses are not resolved by coarse ASR timing. Two missing-ASR points use only past Silero VAD starts; full-audio model events are not used.",
+  "limitations": [
+    "Exploratory scoring: 29 xlsx_draft and 15 rows missing annotator/confidence; no explicit verified status.",
+    "Coarse ASR speech block origin approximates the discussed cache rule; this is point classification, not a complete online Pipecat strategy replay.",
+    "cb3238dc 13540 text is 辽宁葫芦岛 but its corresponding user ASR starts at 16600; review alignment. e304f740 11531 surname utterance is absent from ASR history.",
+    "User channel 0 can contain robot echo/overlap; no future ASR-based masking.",
+    "Selected-point false-reply rate is not interval-level interruption rate."
+  ]
+}
@@ -0,0 +1,8 @@
+threshold,n,tn,fp,fn,tp,accuracy,false_reply_rate,false_hold_rate,recall,precision,f1
+0.5,44,4,18,0,22,0.5909090909090909,0.8181818181818182,0.0,1.0,0.55,0.7096774193548387
+0.7,44,5,17,0,22,0.6136363636363636,0.7727272727272727,0.0,1.0,0.5641025641025641,0.7213114754098361
+0.8,44,6,16,0,22,0.6363636363636364,0.7272727272727273,0.0,1.0,0.5789473684210527,0.7333333333333333
+0.9,44,7,15,1,21,0.6363636363636364,0.6818181818181818,0.045454545454545456,0.9545454545454546,0.5833333333333334,0.7241379310344828
+0.95,44,9,13,3,19,0.6363636363636364,0.5909090909090909,0.13636363636363635,0.8636363636363636,0.59375,0.7037037037037037
+0.98,44,14,8,6,16,0.6818181818181818,0.36363636363636365,0.2727272727272727,0.7272727272727273,0.6666666666666666,0.6956521739130435
+0.99,44,22,0,22,0,0.5,0.0,1.0,0.0,,0.0
@@ -0,0 +1,56 @@
+Smart Turn v3.2：工作数据 can_reply_now 判断点分类
+2026-10-12
+
+本版仅评估 can_reply_now。每个 decision_ms 独立输入模型，使用 probability > 0.5 映射为可回复；不把已有结束信号、VAD 尚未停止、3 秒超时或 ASR 等待作为预测结果。
+
+输入规则
+用户第 1 声道（索引 0），原始 8 kHz 音频按当前点裁剪，然后由 Pipecat 1.12.0 的实际 LocalSmartTurnAnalyzerV3 重采样至 16 kHz。
+依据该点之前开始的用户 ASR 片段定位发言块；3 秒内相邻用户片段归并，完整且不重叠的机器人提问会分开两个发言块。起点前保留 500 毫秒，最多保留末尾 8 秒，短音频在前面补零至 8 秒。
+不使用人工标签或先前模型判定来决定音频起点，也不因早先模型判 Complete 清空当前输入。转写仅定位时间，文本不进入模型。
+这是利用片段级 ASR 近似当前用户话轮起点的判断点分类；单个 ASR 片段内部的停顿未据此重新切分，不代表完整 Pipecat 在线策略回放。
+2 个缺少早期用户 ASR 的点使用该判断点以前的实际 Silero VAD 起始事件补充起点，并单独标记。
+
+结果：44 个点，人工可回复/等待各 22 个
+可回复：22 个全部正确，误阻止 0 个。
+等待：4 个正确，误放行 18 个。
+准确率：26/44 = 59.09%。
+可回复检出率：22/22 = 100.00%。
+误放行率：18/22 = 81.82%。
+放行精确率：22/40 = 55.00%。
+
+按原因分析
+mid_turn_pause：17 个点，误放行 15 个（88.24%）。
+unfinished_expression：5 个点，误放行 3 个（60.00%）。
+completed_answer / completed_turn：合计 22 个点，全被判为可回复。
+当前模型较容易放行，主要不能可靠拒绝话轮中间停顿。
+
+代表性误放行（标注判断点，概率）
+872a1e67，44.810 秒，“帕萨特”，0.97771。
+2c83253a，48.125 秒，“型号是24年380大众帕萨特星空龙腾版。”，0.98486。
+a266b9ef，41.219 秒，“迈腾2023款330豪华版2.0T”，0.98704。
+40ae686c，67.943 秒，“轮胎裂纹同意更换新轮胎。但是”，0.67017。
+40ae686c，70.430 秒，“轮胎裂纹同意更换新轮胎。但是20”，0.87325。
+前三个例子提示局部表达结束分数与当前任务的可接话条件可能不一致，例如车型说完但其他信息尚未回答。该解释需要结合回听确认；此处不据转写断言语气变化。
+
+同一批判断点上的阈值诊断（固定音频，不推演结束信号）
+阈值 0.50：误放行 18/22，误阻止 0/22，准确率 59.09%。
+阈值 0.80：误放行 16/22，误阻止 0/22，准确率 63.64%。
+阈值 0.95：误放行 13/22，误阻止 3/22，准确率 63.64%。
+阈值 0.98：误放行 8/22，误阻止 6/22，准确率 68.18%。
+阈值 0.99：误放行 0/22，误阻止 22/22，准确率 50.00%。
+提高阈值可以减少误放行，但正负例分数重叠明显，无法在本批数据上同时保持高检出率和低误放行率。阈值对照为同集探索，不是独立测试集选参结果。
+
+标签与对齐问题
+29 个点仍为 xlsx_draft，其余 15 个未填标注员/置信度，没有明确回听确认状态。以上结果作为探索性比较，不作正式准确率验收。
+cb3238dc 的 13.540 秒标签文本为“辽宁葫芦岛”，对应用户转写在 16.600 秒开始，应回听确认判断点或文本。
+e304f740 的 11.531 秒“姓赵”在 asr_history 中缺少对应早期用户片段。
+原始人工标签未修改，两个点均保留预测并标记 alignment_issue。
+第 1 声道仍可能有机器人回声或重叠语音；这批选定点的误放行率不能直接当成静音区间误抢话率。
+
+输出
+predictions.csv：全部 44 个点的标签、模型概率、can_reply 预测、正确性及音频起止/长度。
+errors.csv：18 个误放行点。
+thresholds.csv：7 个阈值的同集诊断结果。
+summary.json：统计、分组、输入规则、版本及 SHA256。
+
+建议优先回听车型/购车时间/里程组合回答的负例，确认话轮起点和判断点，再用已确认、按通话划分的测试集检验阈值或结合对话任务上下文的方法。