wx44wx/xiaobailing-turn-detection
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

新增 Mimi 与仅用户 VAP 对比并统一流式评测

Browse Source
This commit is contained in:
Xin Wang
2026-10-28 22:44:36 +08:00
parent 19d4e3c767
commit 6785e3a07b
55 changed files with 6160 additions and 31 deletions
Download Patch File Download Diff File Expand all files Collapse all files
experiments/maai-ch-kyoto/results/mimi-mc/errors.csv
+11
View File
@@ -0,0 +1,11 @@
call_id,decision_ms,user_text_at_decision,can_reply_now,confidence,reason,annotator,can_reply_score,prediction_05,correct_05,p_now_user,p_now_robot,p_future_user,p_future_robot,vad_user,vad_robot,cpc_mc_stereo_score,cpc_mc_user_only_score,audio_start_ms,audio_end_ms,context_ms,model_load_ms,replay_inference_ms,mean_update_ms,p95_update_ms,first_output_ms,frame_count
2c83253a-7977-4e3c-a387-0aa1ea06fbe1,76672,恒泰轮胎前门两条轮胎开裂,0,low,unfinished_expression,xlsx_draft,0.6864748597145081,1,0,0.31352514028549194,0.6864557266235352,0.2911543846130371,0.7088373303413391,0.00031061848858371377,8.592925587436184e-05,0.7066852748394012,0.8640106171369553,56672,76672,20000,44.286083430051804,4691.276874393225,18.7651074975729,27.573074866086234,160.0,250
2c83253a-7977-4e3c-a387-0aa1ea06fbe1,88482,尽快，已经影响行车安全了。,1,low,completed_answer,xlsx_draft,0.2585999369621277,0,0,0.7414000630378723,0.25855928659439087,0.41278982162475586,0.5872008800506592,0.01025086548179388,7.217686652438715e-05,0.11465108394622803,0.16062873601913452,68482,88482,20000,45.3314995393157,3868.7835028395057,15.475134011358023,18.117318768054247,160.0,250
40ae686c-8196-4d7b-b7ad-3e12a427ebb6,70430,轮胎裂纹同意更换新轮胎。但是20,0,low,unfinished_expression,xlsx_draft,0.9186511859297752,1,0,0.08134881407022476,0.9186463356018066,0.17812038958072662,0.8218727111816406,0.00206320290453732,0.9999758005142212,0.9451650716364384,0.03903418779373169,50430,70430,20000,46.39716725796461,3787.041913717985,15.14816765487194,17.745427601039406,160.0,250
40ae686c-8196-4d7b-b7ad-3e12a427ebb6,82941,可以。,1,low,completed_answer,xlsx_draft,0.295051634311676,0,0,0.704948365688324,0.295030802488327,0.6583224534988403,0.3416694402694702,4.905559399048798e-05,0.00015623004583176225,0.27139031887054443,0.9212324172258377,62941,82941,20000,44.78304274380207,3947.4950321018696,15.789980128407478,21.876844344660626,160.0,250
872a1e67-873a-4c49-a598-b38a670afcad,24846,郑州市，河南郑州市。,1,low,completed_answer,xlsx_draft,0.4162102937698364,0,0,0.5837897062301636,0.41619208455085754,0.5471727848052979,0.45281901955604553,0.0001610368926776573,0.0001012653301586397,0.6936855018138885,0.9015571922063828,4846,24846,20000,42.502458207309246,3819.1620893776417,15.276648357510567,17.85223125480114,160.0,250
a266b9ef-5e47-4434-a04c-ce4eacd52c19,68313,轮胎质量问题规律，排水槽横向竖向龟裂。,0,low,mid_turn_pause,xlsx_draft,0.8308001905679703,1,0,0.16919980943202972,0.8307783603668213,0.17210285365581512,0.8278889060020447,3.720181484823115e-05,0.00010085354006150737,0.8074509650468826,0.8763869255781174,48313,68313,20000,43.94112527370453,3842.845559120178,15.371382236480713,18.88684444129467,160.0,250
872a1e67-873a-4c49-a598-b38a670afcad,52326,我的轮胎开裂了。,0,,mid_turn_pause,,0.5535028576850891,1,0,0.4464971423149109,0.5534874200820923,0.32890474796295166,0.6710880398750305,0.0009139698813669384,0.00022386264754459262,0.4240996241569519,0.6631686389446259,32326,52326,20000,57.44829215109348,6204.5572977513075,24.81822919100523,31.657652324065555,160.0,250
a266b9ef-5e47-4434-a04c-ce4eacd52c19,41219,迈腾2023款330豪华版2.0T,0,,mid_turn_pause,,0.5108224153518677,1,0,0.4891775846481323,0.5108088254928589,0.4531340003013611,0.5468593239784241,0.0001839700562413782,0.00039992082747630775,0.9102829173207283,0.9391313791275024,21219,41219,20000,44.131457805633545,3837.323042564094,15.349292170256376,17.59768151678145,160.0,250
cb3238dc-3946-42a5-aad8-9b9a54226363,49204,我是2023年、2024年1月份购置的迈腾3302023款轿车,0,,mid_turn_pause,,0.632370263338089,1,0,0.367629736661911,0.6323491334915161,0.298109769821167,0.7018820643424988,0.00010875277075683698,3.1170831789495423e-05,0.8600987195968628,0.9226682409644127,29204,49204,20000,42.79612470418215,4056.103840470314,16.224415361881256,22.201924864202724,160.0,250
cb3238dc-3946-42a5-aad8-9b9a54226363,73640,轮胎开裂，行驶28000公里，轮胎开裂,0,,mid_turn_pause,,0.6731171607971191,1,0,0.32688283920288086,0.6730939745903015,0.2690482437610626,0.7309429049491882,0.00043130325502716005,4.166780490777455e-05,0.45827627182006836,0.6812975704669952,53640,73640,20000,71.1151659488678,3739.254044368863,14.957016177475452,16.975108766928315,160.0,250
1 call_id decision_ms user_text_at_decision can_reply_now confidence reason annotator can_reply_score prediction_05 correct_05 p_now_user p_now_robot p_future_user p_future_robot vad_user vad_robot cpc_mc_stereo_score cpc_mc_user_only_score audio_start_ms audio_end_ms context_ms model_load_ms replay_inference_ms mean_update_ms p95_update_ms first_output_ms frame_count
2 2c83253a-7977-4e3c-a387-0aa1ea06fbe1 76672 恒泰轮胎前门两条轮胎开裂 0 low unfinished_expression xlsx_draft 0.6864748597145081 1 0 0.31352514028549194 0.6864557266235352 0.2911543846130371 0.7088373303413391 0.00031061848858371377 8.592925587436184e-05 0.7066852748394012 0.8640106171369553 56672 76672 20000 44.286083430051804 4691.276874393225 18.7651074975729 27.573074866086234 160.0 250
3 2c83253a-7977-4e3c-a387-0aa1ea06fbe1 88482 尽快，已经影响行车安全了。 1 low completed_answer xlsx_draft 0.2585999369621277 0 0 0.7414000630378723 0.25855928659439087 0.41278982162475586 0.5872008800506592 0.01025086548179388 7.217686652438715e-05 0.11465108394622803 0.16062873601913452 68482 88482 20000 45.3314995393157 3868.7835028395057 15.475134011358023 18.117318768054247 160.0 250
4 40ae686c-8196-4d7b-b7ad-3e12a427ebb6 70430 轮胎裂纹同意更换新轮胎。但是20 0 low unfinished_expression xlsx_draft 0.9186511859297752 1 0 0.08134881407022476 0.9186463356018066 0.17812038958072662 0.8218727111816406 0.00206320290453732 0.9999758005142212 0.9451650716364384 0.03903418779373169 50430 70430 20000 46.39716725796461 3787.041913717985 15.14816765487194 17.745427601039406 160.0 250
5 40ae686c-8196-4d7b-b7ad-3e12a427ebb6 82941 可以。 1 low completed_answer xlsx_draft 0.295051634311676 0 0 0.704948365688324 0.295030802488327 0.6583224534988403 0.3416694402694702 4.905559399048798e-05 0.00015623004583176225 0.27139031887054443 0.9212324172258377 62941 82941 20000 44.78304274380207 3947.4950321018696 15.789980128407478 21.876844344660626 160.0 250
6 872a1e67-873a-4c49-a598-b38a670afcad 24846 郑州市，河南郑州市。 1 low completed_answer xlsx_draft 0.4162102937698364 0 0 0.5837897062301636 0.41619208455085754 0.5471727848052979 0.45281901955604553 0.0001610368926776573 0.0001012653301586397 0.6936855018138885 0.9015571922063828 4846 24846 20000 42.502458207309246 3819.1620893776417 15.276648357510567 17.85223125480114 160.0 250
7 a266b9ef-5e47-4434-a04c-ce4eacd52c19 68313 轮胎质量问题规律，排水槽横向竖向龟裂。 0 low mid_turn_pause xlsx_draft 0.8308001905679703 1 0 0.16919980943202972 0.8307783603668213 0.17210285365581512 0.8278889060020447 3.720181484823115e-05 0.00010085354006150737 0.8074509650468826 0.8763869255781174 48313 68313 20000 43.94112527370453 3842.845559120178 15.371382236480713 18.88684444129467 160.0 250
8 872a1e67-873a-4c49-a598-b38a670afcad 52326 我的轮胎开裂了。 0 mid_turn_pause 0.5535028576850891 1 0 0.4464971423149109 0.5534874200820923 0.32890474796295166 0.6710880398750305 0.0009139698813669384 0.00022386264754459262 0.4240996241569519 0.6631686389446259 32326 52326 20000 57.44829215109348 6204.5572977513075 24.81822919100523 31.657652324065555 160.0 250
9 a266b9ef-5e47-4434-a04c-ce4eacd52c19 41219 迈腾2023款330豪华版2.0T 0 mid_turn_pause 0.5108224153518677 1 0 0.4891775846481323 0.5108088254928589 0.4531340003013611 0.5468593239784241 0.0001839700562413782 0.00039992082747630775 0.9102829173207283 0.9391313791275024 21219 41219 20000 44.131457805633545 3837.323042564094 15.349292170256376 17.59768151678145 160.0 250
10 cb3238dc-3946-42a5-aad8-9b9a54226363 49204 我是2023年、2024年1月份购置的迈腾3302023款轿车 0 mid_turn_pause 0.632370263338089 1 0 0.367629736661911 0.6323491334915161 0.298109769821167 0.7018820643424988 0.00010875277075683698 3.1170831789495423e-05 0.8600987195968628 0.9226682409644127 29204 49204 20000 42.79612470418215 4056.103840470314 16.224415361881256 22.201924864202724 160.0 250
11 cb3238dc-3946-42a5-aad8-9b9a54226363 73640 轮胎开裂，行驶28000公里，轮胎开裂 0 mid_turn_pause 0.6731171607971191 1 0 0.32688283920288086 0.6730939745903015 0.2690482437610626 0.7309429049491882 0.00043130325502716005 4.166780490777455e-05 0.45827627182006836 0.6812975704669952 53640 73640 20000 71.1151659488678 3739.254044368863 14.957016177475452 16.975108766928315 160.0 250