wx44wx/xiaobailing-turn-detection
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

新增 Mimi 与仅用户 VAP 对比并统一流式评测

Browse Source
This commit is contained in:
Xin Wang
2026-10-28 22:44:36 +08:00
parent 19d4e3c767
commit 6785e3a07b
55 changed files with 6160 additions and 31 deletions
Download Patch File Download Diff File Expand all files Collapse all files
experiments/maai-ch-kyoto/results/user-only/errors.csv
+22
View File
@@ -0,0 +1,22 @@
call_id,decision_ms,user_text_at_decision,can_reply_now,confidence,reason,annotator,can_reply_score,stereo_can_reply_score,p_now_user,p_now_robot,p_future_user,p_future_robot,vad_user,vad_robot,prediction_05,correct_05,stereo_prediction_05,audio_start_ms,audio_end_ms,context_ms,robot_input_peak_abs,replay_inference_ms,stereo_replay_inference_ms
2c83253a-7977-4e3c-a387-0aa1ea06fbe1,48125,型号是24年380大众帕萨特星空龙腾版。,0,low,mid_turn_pause,xlsx_draft,0.712736040353775,0.5122989416122437,0.287263959646225,0.7127270102500916,0.30030158162117004,0.699691653251648,0.0005045763682574034,0.2013741433620453,1,0,1,28125,48125,20000,0.0,1064.420540817082,1044.8135826736689
2c83253a-7977-4e3c-a387-0aa1ea06fbe1,76672,恒泰轮胎前门两条轮胎开裂,0,low,unfinished_expression,xlsx_draft,0.8640106171369553,0.7066852748394012,0.13598938286304474,0.8640027642250061,0.2139778882265091,0.7860152125358582,0.0002717908064369112,0.4948178827762604,1,0,1,56672,76672,20000,0.0,1032.4355829507113,1016.6379176080227
2c83253a-7977-4e3c-a387-0aa1ea06fbe1,88482,尽快，已经影响行车安全了。,1,low,completed_answer,xlsx_draft,0.16062873601913452,0.11465108394622803,0.8393712639808655,0.16061516106128693,0.6462375521659851,0.35375407338142395,0.022112371399998665,0.020942039787769318,0,0,0,68482,88482,20000,0.0,1036.321542225778,1105.0837496295571
40ae686c-8196-4d7b-b7ad-3e12a427ebb6,65298,轮胎裂纹。,0,low,mid_turn_pause,xlsx_draft,0.8862891793251038,0.16463828086853027,0.11371082067489624,0.8862825036048889,0.21822746098041534,0.7817663550376892,0.000534569553565234,0.6663311123847961,1,0,0,45298,65298,20000,0.0,1049.0985000506043,1046.0005421191454
40ae686c-8196-4d7b-b7ad-3e12a427ebb6,67943,轮胎裂纹同意更换新轮胎。但是,0,low,mid_turn_pause,xlsx_draft,0.6981820166110992,0.1254715919494629,0.30181798338890076,0.6981750130653381,0.462412565946579,0.5375813841819763,0.00029004551470279694,0.5384137034416199,1,0,0,47943,67943,20000,0.0,1025.8604157716036,1087.0674578472972
a266b9ef-5e47-4434-a04c-ce4eacd52c19,68313,轮胎质量问题规律，排水槽横向竖向龟裂。,0,low,mid_turn_pause,xlsx_draft,0.8763869255781174,0.8074509650468826,0.12361307442188263,0.8763805031776428,0.21461541950702667,0.7853786945343018,0.00010311136429663748,0.5491448640823364,1,0,1,48313,68313,20000,0.0,1024.2989165708423,1038.7848326936364
cb3238dc-3946-42a5-aad8-9b9a54226363,70745,轮胎开裂,0,low,mid_turn_pause,xlsx_draft,0.6845456063747406,0.28872406482696533,0.3154543936252594,0.6845382452011108,0.41045159101486206,0.5895419716835022,0.0003880855510942638,0.3676386773586273,1,0,0,50745,70745,20000,0.0,1027.561416849494,1026.4365831390023
e304f740-85d4-427e-9fd6-c5474e9cd737,40701,帕萨特,0,low,mid_turn_pause,xlsx_draft,0.8340967893600464,0.4185728430747986,0.1659032106399536,0.8340901136398315,0.3302589952945709,0.6697350144386292,5.8670710131991655e-05,0.6218740344047546,1,0,0,20701,40701,20000,0.0,1075.5121251568198,1022.6317914202809
e304f740-85d4-427e-9fd6-c5474e9cd737,65819,四条轮胎，最近我在。,0,low,unfinished_expression,xlsx_draft,0.6574011743068695,0.05253005027770996,0.3425988256931305,0.6573941111564636,0.5131843686103821,0.48680970072746277,0.00016322250303346664,0.5996755957603455,1,0,0,45819,65819,20000,0.0,1029.8763746395707,1034.4825834035873
872a1e67-873a-4c49-a598-b38a670afcad,47187,帕萨特L2025款 ,0,,mid_turn_pause,,0.8951215818524361,0.7005376219749451,0.10487841814756393,0.8951144218444824,0.19764570891857147,0.8023478388786316,0.0008713988936506212,0.6476827263832092,1,0,1,27187,47187,20000,0.0,1018.0150838568807,1072.5461663678288
872a1e67-873a-4c49-a598-b38a670afcad,52326,我的轮胎开裂了。,0,,mid_turn_pause,,0.6631686389446259,0.4240996241569519,0.33683136105537415,0.6631612777709961,0.43475767970085144,0.5652356743812561,0.0027947553899139166,0.4008314907550812,1,0,0,32326,52326,20000,0.0,1034.971167333424,1051.6820829361677
40ae686c-8196-4d7b-b7ad-3e12a427ebb6,48536,爱车型号是大众帕萨特，购车时间2023年10月份,0,,mid_turn_pause,,0.8199913799762726,0.5186727344989777,0.18000862002372742,0.8199833631515503,0.22936034202575684,0.770633339881897,0.00015609677939210087,0.375405877828598,1,0,1,28536,48536,20000,0.0,1050.1775424927473,1044.4884998723865
872a1e67-873a-4c49-a598-b38a670afcad,44810,帕萨特,0,,mid_turn_pause,,0.8325859755277634,0.3700411319732666,0.16741402447223663,0.832578718662262,0.29413360357284546,0.7058599591255188,0.0006242078961804509,0.6011908054351807,1,0,0,24810,44810,20000,0.0,1040.6767074018717,1023.8962080329657
872a1e67-873a-4c49-a598-b38a670afcad,49500,帕萨特L2025款2025年3月购车,1,,completed_turn,,0.4527696967124939,0.9640973135828972,0.5472303032875061,0.4527527689933777,0.42345741391181946,0.5765343904495239,0.004929132293909788,0.13983771204948425,0,0,1,29500,49500,20000,0.0,1042.2111246734858,1065.983415581286
872a1e67-873a-4c49-a598-b38a670afcad,54318,行驶里程29000公里。,1,,completed_turn,,0.48515671491622925,0.9336890131235123,0.5148432850837708,0.4851451814174652,0.4614582359790802,0.5385342240333557,0.0005555779207497835,0.16714082658290863,0,0,1,34318,54318,20000,0.0,1127.1999590098858,1034.5972077921033
a266b9ef-5e47-4434-a04c-ce4eacd52c19,41219,迈腾2023款330豪华版2.0T,0,,mid_turn_pause,,0.9391313791275024,0.9102829173207283,0.06086862087249756,0.9391252994537354,0.12826824188232422,0.871725857257843,0.00022907710808794945,0.7417447566986084,1,0,1,21219,41219,20000,0.0,1079.2017504572868,1094.9621256440878
cb3238dc-3946-42a5-aad8-9b9a54226363,41207,我是2023年,0,,mid_turn_pause,,0.7711529731750488,0.12327557802200317,0.22884702682495117,0.7711459398269653,0.35431164503097534,0.6456820964813232,0.0002079915429931134,0.5072486400604248,1,0,0,21207,41207,20000,0.0,1040.657457895577,1037.4416671693325
cb3238dc-3946-42a5-aad8-9b9a54226363,49204,我是2023年、2024年1月份购置的迈腾3302023款轿车,0,,mid_turn_pause,,0.9226682409644127,0.8600987195968628,0.07733175903558731,0.9226608872413635,0.12602370977401733,0.8739699721336365,0.00014769700646866113,0.5389497876167297,1,0,1,29204,49204,20000,0.0,1047.2399592399597,1084.025208838284
cb3238dc-3946-42a5-aad8-9b9a54226363,58424,我的轮胎,0,,mid_turn_pause,,0.7652575969696045,0.19378310441970825,0.2347424030303955,0.7652506232261658,0.3740234076976776,0.6259703636169434,0.00014432301395572722,0.49237900972366333,1,0,0,38424,58424,20000,0.0,1054.9904173240066,1021.811000071466
cb3238dc-3946-42a5-aad8-9b9a54226363,73640,轮胎开裂，行驶28000公里，轮胎开裂,0,,mid_turn_pause,,0.6812975704669952,0.45827627182006836,0.31870242953300476,0.6812891364097595,0.3468272089958191,0.6531659960746765,0.00045241721090860665,0.2853435277938843,1,0,0,53640,73640,20000,0.0,1031.7763751372695,1030.0637912005186
e304f740-85d4-427e-9fd6-c5474e9cd737,62828,四条轮胎,0,,mid_turn_pause,,0.5078669488430023,0.02205902338027954,0.4921330511569977,0.5078585147857666,0.6710895299911499,0.32890430092811584,0.00022117290063761175,0.3902367055416107,1,0,0,42828,62828,20000,0.0,1024.95929133147,1024.5867501944304
1 call_id decision_ms user_text_at_decision can_reply_now confidence reason annotator can_reply_score stereo_can_reply_score p_now_user p_now_robot p_future_user p_future_robot vad_user vad_robot prediction_05 correct_05 stereo_prediction_05 audio_start_ms audio_end_ms context_ms robot_input_peak_abs replay_inference_ms stereo_replay_inference_ms
2 2c83253a-7977-4e3c-a387-0aa1ea06fbe1 48125 型号是24年380大众帕萨特星空龙腾版。 0 low mid_turn_pause xlsx_draft 0.712736040353775 0.5122989416122437 0.287263959646225 0.7127270102500916 0.30030158162117004 0.699691653251648 0.0005045763682574034 0.2013741433620453 1 0 1 28125 48125 20000 0.0 1064.420540817082 1044.8135826736689
3 2c83253a-7977-4e3c-a387-0aa1ea06fbe1 76672 恒泰轮胎前门两条轮胎开裂 0 low unfinished_expression xlsx_draft 0.8640106171369553 0.7066852748394012 0.13598938286304474 0.8640027642250061 0.2139778882265091 0.7860152125358582 0.0002717908064369112 0.4948178827762604 1 0 1 56672 76672 20000 0.0 1032.4355829507113 1016.6379176080227
4 2c83253a-7977-4e3c-a387-0aa1ea06fbe1 88482 尽快，已经影响行车安全了。 1 low completed_answer xlsx_draft 0.16062873601913452 0.11465108394622803 0.8393712639808655 0.16061516106128693 0.6462375521659851 0.35375407338142395 0.022112371399998665 0.020942039787769318 0 0 0 68482 88482 20000 0.0 1036.321542225778 1105.0837496295571
5 40ae686c-8196-4d7b-b7ad-3e12a427ebb6 65298 轮胎裂纹。 0 low mid_turn_pause xlsx_draft 0.8862891793251038 0.16463828086853027 0.11371082067489624 0.8862825036048889 0.21822746098041534 0.7817663550376892 0.000534569553565234 0.6663311123847961 1 0 0 45298 65298 20000 0.0 1049.0985000506043 1046.0005421191454
6 40ae686c-8196-4d7b-b7ad-3e12a427ebb6 67943 轮胎裂纹同意更换新轮胎。但是 0 low mid_turn_pause xlsx_draft 0.6981820166110992 0.1254715919494629 0.30181798338890076 0.6981750130653381 0.462412565946579 0.5375813841819763 0.00029004551470279694 0.5384137034416199 1 0 0 47943 67943 20000 0.0 1025.8604157716036 1087.0674578472972
7 a266b9ef-5e47-4434-a04c-ce4eacd52c19 68313 轮胎质量问题规律，排水槽横向竖向龟裂。 0 low mid_turn_pause xlsx_draft 0.8763869255781174 0.8074509650468826 0.12361307442188263 0.8763805031776428 0.21461541950702667 0.7853786945343018 0.00010311136429663748 0.5491448640823364 1 0 1 48313 68313 20000 0.0 1024.2989165708423 1038.7848326936364
8 cb3238dc-3946-42a5-aad8-9b9a54226363 70745 轮胎开裂 0 low mid_turn_pause xlsx_draft 0.6845456063747406 0.28872406482696533 0.3154543936252594 0.6845382452011108 0.41045159101486206 0.5895419716835022 0.0003880855510942638 0.3676386773586273 1 0 0 50745 70745 20000 0.0 1027.561416849494 1026.4365831390023
9 e304f740-85d4-427e-9fd6-c5474e9cd737 40701 帕萨特 0 low mid_turn_pause xlsx_draft 0.8340967893600464 0.4185728430747986 0.1659032106399536 0.8340901136398315 0.3302589952945709 0.6697350144386292 5.8670710131991655e-05 0.6218740344047546 1 0 0 20701 40701 20000 0.0 1075.5121251568198 1022.6317914202809
10 e304f740-85d4-427e-9fd6-c5474e9cd737 65819 四条轮胎，最近我在。 0 low unfinished_expression xlsx_draft 0.6574011743068695 0.05253005027770996 0.3425988256931305 0.6573941111564636 0.5131843686103821 0.48680970072746277 0.00016322250303346664 0.5996755957603455 1 0 0 45819 65819 20000 0.0 1029.8763746395707 1034.4825834035873
11 872a1e67-873a-4c49-a598-b38a670afcad 47187 帕萨特L2025款 0 mid_turn_pause 0.8951215818524361 0.7005376219749451 0.10487841814756393 0.8951144218444824 0.19764570891857147 0.8023478388786316 0.0008713988936506212 0.6476827263832092 1 0 1 27187 47187 20000 0.0 1018.0150838568807 1072.5461663678288
12 872a1e67-873a-4c49-a598-b38a670afcad 52326 我的轮胎开裂了。 0 mid_turn_pause 0.6631686389446259 0.4240996241569519 0.33683136105537415 0.6631612777709961 0.43475767970085144 0.5652356743812561 0.0027947553899139166 0.4008314907550812 1 0 0 32326 52326 20000 0.0 1034.971167333424 1051.6820829361677
13 40ae686c-8196-4d7b-b7ad-3e12a427ebb6 48536 爱车型号是大众帕萨特，购车时间2023年10月份 0 mid_turn_pause 0.8199913799762726 0.5186727344989777 0.18000862002372742 0.8199833631515503 0.22936034202575684 0.770633339881897 0.00015609677939210087 0.375405877828598 1 0 1 28536 48536 20000 0.0 1050.1775424927473 1044.4884998723865
14 872a1e67-873a-4c49-a598-b38a670afcad 44810 帕萨特 0 mid_turn_pause 0.8325859755277634 0.3700411319732666 0.16741402447223663 0.832578718662262 0.29413360357284546 0.7058599591255188 0.0006242078961804509 0.6011908054351807 1 0 0 24810 44810 20000 0.0 1040.6767074018717 1023.8962080329657
15 872a1e67-873a-4c49-a598-b38a670afcad 49500 帕萨特L2025款2025年3月购车 1 completed_turn 0.4527696967124939 0.9640973135828972 0.5472303032875061 0.4527527689933777 0.42345741391181946 0.5765343904495239 0.004929132293909788 0.13983771204948425 0 0 1 29500 49500 20000 0.0 1042.2111246734858 1065.983415581286
16 872a1e67-873a-4c49-a598-b38a670afcad 54318 行驶里程29000公里。 1 completed_turn 0.48515671491622925 0.9336890131235123 0.5148432850837708 0.4851451814174652 0.4614582359790802 0.5385342240333557 0.0005555779207497835 0.16714082658290863 0 0 1 34318 54318 20000 0.0 1127.1999590098858 1034.5972077921033
17 a266b9ef-5e47-4434-a04c-ce4eacd52c19 41219 迈腾2023款330豪华版2.0T 0 mid_turn_pause 0.9391313791275024 0.9102829173207283 0.06086862087249756 0.9391252994537354 0.12826824188232422 0.871725857257843 0.00022907710808794945 0.7417447566986084 1 0 1 21219 41219 20000 0.0 1079.2017504572868 1094.9621256440878
18 cb3238dc-3946-42a5-aad8-9b9a54226363 41207 我是2023年 0 mid_turn_pause 0.7711529731750488 0.12327557802200317 0.22884702682495117 0.7711459398269653 0.35431164503097534 0.6456820964813232 0.0002079915429931134 0.5072486400604248 1 0 0 21207 41207 20000 0.0 1040.657457895577 1037.4416671693325
19 cb3238dc-3946-42a5-aad8-9b9a54226363 49204 我是2023年、2024年1月份购置的迈腾3302023款轿车 0 mid_turn_pause 0.9226682409644127 0.8600987195968628 0.07733175903558731 0.9226608872413635 0.12602370977401733 0.8739699721336365 0.00014769700646866113 0.5389497876167297 1 0 1 29204 49204 20000 0.0 1047.2399592399597 1084.025208838284
20 cb3238dc-3946-42a5-aad8-9b9a54226363 58424 我的轮胎 0 mid_turn_pause 0.7652575969696045 0.19378310441970825 0.2347424030303955 0.7652506232261658 0.3740234076976776 0.6259703636169434 0.00014432301395572722 0.49237900972366333 1 0 0 38424 58424 20000 0.0 1054.9904173240066 1021.811000071466
21 cb3238dc-3946-42a5-aad8-9b9a54226363 73640 轮胎开裂，行驶28000公里，轮胎开裂 0 mid_turn_pause 0.6812975704669952 0.45827627182006836 0.31870242953300476 0.6812891364097595 0.3468272089958191 0.6531659960746765 0.00045241721090860665 0.2853435277938843 1 0 0 53640 73640 20000 0.0 1031.7763751372695 1030.0637912005186
22 e304f740-85d4-427e-9fd6-c5474e9cd737 62828 四条轮胎 0 mid_turn_pause 0.5078669488430023 0.02205902338027954 0.4921330511569977 0.5078585147857666 0.6710895299911499 0.32890430092811584 0.00022117290063761175 0.3902367055416107 1 0 0 42828 62828 20000 0.0 1024.95929133147 1024.5867501944304