wx44wx/xiaobailing-turn-detection
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

新增 Mimi 与仅用户 VAP 对比并统一流式评测

Browse Source
This commit is contained in:
Xin Wang
2026-10-28 22:44:36 +08:00
parent 19d4e3c767
commit 6785e3a07b
55 changed files with 6160 additions and 31 deletions
Download Patch File Download Diff File Expand all files Collapse all files
experiments/maai-ch-kyoto/results/mimi-standard/errors.csv
+15
View File
@@ -0,0 +1,15 @@
call_id,decision_ms,user_text_at_decision,can_reply_now,confidence,reason,annotator,can_reply_score,prediction_05,correct_05,p_now_user,p_now_robot,p_future_user,p_future_robot,vad_user,vad_robot,cpc_mc_stereo_score,cpc_mc_user_only_score,audio_start_ms,audio_end_ms,context_ms,model_load_ms,replay_inference_ms,mean_update_ms,p95_update_ms,first_output_ms,frame_count
2c83253a-7977-4e3c-a387-0aa1ea06fbe1,76672,恒泰轮胎前门两条轮胎开裂,0,low,unfinished_expression,xlsx_draft,0.5827796757221222,1,0,0.4172203242778778,0.5827587246894836,0.41673988103866577,0.5832511782646179,0.0002513767685741186,0.0001224606967298314,0.7066852748394012,0.8640106171369553,56672,76672,20000,43.11825055629015,3734.2152446508408,14.936860978603363,17.071229452267286,160.0,250
2c83253a-7977-4e3c-a387-0aa1ea06fbe1,88482,尽快，已经影响行车安全了。,1,low,completed_answer,xlsx_draft,0.2125949263572693,0,0,0.7874050736427307,0.21255195140838623,0.5050087571144104,0.494981050491333,0.01712055504322052,0.0001118458530982025,0.11465108394622803,0.16062873601913452,68482,88482,20000,42.53454227000475,3763.994230888784,15.055976923555136,17.23313126713037,160.0,250
40ae686c-8196-4d7b-b7ad-3e12a427ebb6,31842,投诉建议。,1,low,completed_answer,xlsx_draft,0.48968255519866943,0,0,0.5103174448013306,0.4896518886089325,0.5082431435585022,0.49174630641937256,0.00011276060104137287,5.577295814873651e-05,0.7899426519870758,0.9342073872685432,11842,31842,20000,44.34670880436897,3777.243494056165,15.10897397622466,17.543585738167163,160.0,250
40ae686c-8196-4d7b-b7ad-3e12a427ebb6,70430,轮胎裂纹同意更换新轮胎。但是20,0,low,unfinished_expression,xlsx_draft,0.9156609252095222,1,0,0.08433907479047775,0.9156560301780701,0.2074228972196579,0.7925690412521362,0.005387305747717619,0.9999953508377075,0.9451650716364384,0.03903418779373169,50430,70430,20000,46.39508295804262,3987.742042168975,15.9509681686759,20.263655856251717,160.0,250
40ae686c-8196-4d7b-b7ad-3e12a427ebb6,82941,可以。,1,low,completed_answer,xlsx_draft,0.13118845224380493,0,0,0.8688115477561951,0.13116922974586487,0.8727200031280518,0.12727269530296326,9.329482418252155e-05,0.00039028728497214615,0.27139031887054443,0.9212324172258377,62941,82941,20000,44.22441590577364,3770.675449632108,15.082701798528433,16.84834328480065,160.0,250
872a1e67-873a-4c49-a598-b38a670afcad,17153,我姓宋。,1,low,completed_answer,xlsx_draft,0.3544103503227234,0,0,0.6455896496772766,0.3543955981731415,0.6671656966209412,0.3328273892402649,0.00037749105831608176,0.0003432980156503618,0.4008920192718506,0.8734219521284103,33,17153,17120,42.86170843988657,3181.1862913891673,14.865356501818539,16.877298150211573,160.0,214
872a1e67-873a-4c49-a598-b38a670afcad,24846,郑州市，河南郑州市。,1,low,completed_answer,xlsx_draft,0.43358469009399414,0,0,0.5664153099060059,0.43356308341026306,0.5940371751785278,0.4059540331363678,0.00042811373714357615,0.00014359904162120074,0.6936855018138885,0.9015571922063828,4846,24846,20000,43.59066765755415,3757.988958619535,15.03195583447814,17.336932709440582,160.0,250
872a1e67-873a-4c49-a598-b38a670afcad,33471,我的轮胎开裂了。,1,low,completed_answer,xlsx_draft,0.4404107332229614,0,0,0.5595892667770386,0.4403921663761139,0.5567219257354736,0.4432700574398041,0.00027235213201493025,4.663604704546742e-05,0.802086129784584,0.929821141064167,13471,33471,20000,44.05749961733818,3898.5149217769504,15.594059687107801,16.760270670056343,160.0,250
a266b9ef-5e47-4434-a04c-ce4eacd52c19,24768,投诉。,1,low,completed_answer,xlsx_draft,0.429895281791687,0,0,0.570104718208313,0.429873526096344,0.6319901347160339,0.36800137162208557,3.379296322236769e-05,0.00017112762725446373,0.5596272945404053,0.8936084657907486,4768,24768,20000,47.33575042337179,3768.2867143303156,15.073146857321262,17.01975828036666,160.0,250
a266b9ef-5e47-4434-a04c-ce4eacd52c19,68313,轮胎质量问题规律，排水槽横向竖向龟裂。,0,low,mid_turn_pause,xlsx_draft,0.7153808772563934,1,0,0.28461912274360657,0.7153563499450684,0.3098556697368622,0.6901354789733887,0.00015701723168604076,0.00015683767560403794,0.8074509650468826,0.8763869255781174,48313,68313,20000,42.48408321291208,3793.225208297372,15.172900833189487,17.884926451370116,160.0,250
872a1e67-873a-4c49-a598-b38a670afcad,52326,我的轮胎开裂了。,0,,mid_turn_pause,,0.5608597099781036,1,0,0.43914029002189636,0.5608418583869934,0.32150939106941223,0.6784825921058655,0.00028993270825594664,6.893909448990598e-05,0.4240996241569519,0.6631686389446259,32326,52326,20000,43.711209669709206,3781.8655846640468,15.127462338656187,17.952587874606248,160.0,250
a266b9ef-5e47-4434-a04c-ce4eacd52c19,41219,迈腾2023款330豪华版2.0T,0,,mid_turn_pause,,0.5353022813796997,1,0,0.4646977186203003,0.53528892993927,0.43114253878593445,0.5688507556915283,0.0004525056283455342,0.0009800773113965988,0.9102829173207283,0.9391313791275024,21219,41219,20000,43.12216676771641,3731.8863114342093,14.927545245736837,17.138534784317017,160.0,250
cb3238dc-3946-42a5-aad8-9b9a54226363,49204,我是2023年、2024年1月份购置的迈腾3302023款轿车,0,,mid_turn_pause,,0.7771151214838028,1,0,0.2228848785161972,0.7770937085151672,0.1958613097667694,0.8041304349899292,0.0001806421932997182,0.00013914017472416162,0.8600987195968628,0.9226682409644127,29204,49204,20000,42.962207458913326,3849.3550131097436,15.397420052438974,19.366614380851384,160.0,250
cb3238dc-3946-42a5-aad8-9b9a54226363,73640,轮胎开裂，行驶28000公里，轮胎开裂,0,,mid_turn_pause,,0.5420903265476227,1,0,0.4579096734523773,0.542066752910614,0.33230483531951904,0.667686402797699,0.00046382888103835285,6.0991980717517436e-05,0.45827627182006836,0.6812975704669952,53640,73640,20000,43.076083064079285,3793.9981278032064,15.175992511212826,17.95125198550522,160.0,250
1 call_id decision_ms user_text_at_decision can_reply_now confidence reason annotator can_reply_score prediction_05 correct_05 p_now_user p_now_robot p_future_user p_future_robot vad_user vad_robot cpc_mc_stereo_score cpc_mc_user_only_score audio_start_ms audio_end_ms context_ms model_load_ms replay_inference_ms mean_update_ms p95_update_ms first_output_ms frame_count
2 2c83253a-7977-4e3c-a387-0aa1ea06fbe1 76672 恒泰轮胎前门两条轮胎开裂 0 low unfinished_expression xlsx_draft 0.5827796757221222 1 0 0.4172203242778778 0.5827587246894836 0.41673988103866577 0.5832511782646179 0.0002513767685741186 0.0001224606967298314 0.7066852748394012 0.8640106171369553 56672 76672 20000 43.11825055629015 3734.2152446508408 14.936860978603363 17.071229452267286 160.0 250
3 2c83253a-7977-4e3c-a387-0aa1ea06fbe1 88482 尽快，已经影响行车安全了。 1 low completed_answer xlsx_draft 0.2125949263572693 0 0 0.7874050736427307 0.21255195140838623 0.5050087571144104 0.494981050491333 0.01712055504322052 0.0001118458530982025 0.11465108394622803 0.16062873601913452 68482 88482 20000 42.53454227000475 3763.994230888784 15.055976923555136 17.23313126713037 160.0 250
4 40ae686c-8196-4d7b-b7ad-3e12a427ebb6 31842 投诉建议。 1 low completed_answer xlsx_draft 0.48968255519866943 0 0 0.5103174448013306 0.4896518886089325 0.5082431435585022 0.49174630641937256 0.00011276060104137287 5.577295814873651e-05 0.7899426519870758 0.9342073872685432 11842 31842 20000 44.34670880436897 3777.243494056165 15.10897397622466 17.543585738167163 160.0 250
5 40ae686c-8196-4d7b-b7ad-3e12a427ebb6 70430 轮胎裂纹同意更换新轮胎。但是20 0 low unfinished_expression xlsx_draft 0.9156609252095222 1 0 0.08433907479047775 0.9156560301780701 0.2074228972196579 0.7925690412521362 0.005387305747717619 0.9999953508377075 0.9451650716364384 0.03903418779373169 50430 70430 20000 46.39508295804262 3987.742042168975 15.9509681686759 20.263655856251717 160.0 250
6 40ae686c-8196-4d7b-b7ad-3e12a427ebb6 82941 可以。 1 low completed_answer xlsx_draft 0.13118845224380493 0 0 0.8688115477561951 0.13116922974586487 0.8727200031280518 0.12727269530296326 9.329482418252155e-05 0.00039028728497214615 0.27139031887054443 0.9212324172258377 62941 82941 20000 44.22441590577364 3770.675449632108 15.082701798528433 16.84834328480065 160.0 250
7 872a1e67-873a-4c49-a598-b38a670afcad 17153 我姓宋。 1 low completed_answer xlsx_draft 0.3544103503227234 0 0 0.6455896496772766 0.3543955981731415 0.6671656966209412 0.3328273892402649 0.00037749105831608176 0.0003432980156503618 0.4008920192718506 0.8734219521284103 33 17153 17120 42.86170843988657 3181.1862913891673 14.865356501818539 16.877298150211573 160.0 214
8 872a1e67-873a-4c49-a598-b38a670afcad 24846 郑州市，河南郑州市。 1 low completed_answer xlsx_draft 0.43358469009399414 0 0 0.5664153099060059 0.43356308341026306 0.5940371751785278 0.4059540331363678 0.00042811373714357615 0.00014359904162120074 0.6936855018138885 0.9015571922063828 4846 24846 20000 43.59066765755415 3757.988958619535 15.03195583447814 17.336932709440582 160.0 250
9 872a1e67-873a-4c49-a598-b38a670afcad 33471 我的轮胎开裂了。 1 low completed_answer xlsx_draft 0.4404107332229614 0 0 0.5595892667770386 0.4403921663761139 0.5567219257354736 0.4432700574398041 0.00027235213201493025 4.663604704546742e-05 0.802086129784584 0.929821141064167 13471 33471 20000 44.05749961733818 3898.5149217769504 15.594059687107801 16.760270670056343 160.0 250
10 a266b9ef-5e47-4434-a04c-ce4eacd52c19 24768 投诉。 1 low completed_answer xlsx_draft 0.429895281791687 0 0 0.570104718208313 0.429873526096344 0.6319901347160339 0.36800137162208557 3.379296322236769e-05 0.00017112762725446373 0.5596272945404053 0.8936084657907486 4768 24768 20000 47.33575042337179 3768.2867143303156 15.073146857321262 17.01975828036666 160.0 250
11 a266b9ef-5e47-4434-a04c-ce4eacd52c19 68313 轮胎质量问题规律，排水槽横向竖向龟裂。 0 low mid_turn_pause xlsx_draft 0.7153808772563934 1 0 0.28461912274360657 0.7153563499450684 0.3098556697368622 0.6901354789733887 0.00015701723168604076 0.00015683767560403794 0.8074509650468826 0.8763869255781174 48313 68313 20000 42.48408321291208 3793.225208297372 15.172900833189487 17.884926451370116 160.0 250
12 872a1e67-873a-4c49-a598-b38a670afcad 52326 我的轮胎开裂了。 0 mid_turn_pause 0.5608597099781036 1 0 0.43914029002189636 0.5608418583869934 0.32150939106941223 0.6784825921058655 0.00028993270825594664 6.893909448990598e-05 0.4240996241569519 0.6631686389446259 32326 52326 20000 43.711209669709206 3781.8655846640468 15.127462338656187 17.952587874606248 160.0 250
13 a266b9ef-5e47-4434-a04c-ce4eacd52c19 41219 迈腾2023款330豪华版2.0T 0 mid_turn_pause 0.5353022813796997 1 0 0.4646977186203003 0.53528892993927 0.43114253878593445 0.5688507556915283 0.0004525056283455342 0.0009800773113965988 0.9102829173207283 0.9391313791275024 21219 41219 20000 43.12216676771641 3731.8863114342093 14.927545245736837 17.138534784317017 160.0 250
14 cb3238dc-3946-42a5-aad8-9b9a54226363 49204 我是2023年、2024年1月份购置的迈腾3302023款轿车 0 mid_turn_pause 0.7771151214838028 1 0 0.2228848785161972 0.7770937085151672 0.1958613097667694 0.8041304349899292 0.0001806421932997182 0.00013914017472416162 0.8600987195968628 0.9226682409644127 29204 49204 20000 42.962207458913326 3849.3550131097436 15.397420052438974 19.366614380851384 160.0 250
15 cb3238dc-3946-42a5-aad8-9b9a54226363 73640 轮胎开裂，行驶28000公里，轮胎开裂 0 mid_turn_pause 0.5420903265476227 1 0 0.4579096734523773 0.542066752910614 0.33230483531951904 0.667686402797699 0.00046382888103835285 6.0991980717517436e-05 0.45827627182006836 0.6812975704669952 53640 73640 20000 43.076083064079285 3793.9981278032064 15.175992511212826 17.95125198550522 160.0 250