wx44wx/xiaobailing-turn-detection
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

记录三模型话轮检测实验、44点评估及延迟对比

Browse Source
This commit is contained in:
Xin Wang
2026-10-14 10:30:22 +08:00
parent 0204f1288a
commit 05f67739ce
75 changed files with 63467 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
experiments/maai-ch-kyoto/results/work-data-can-reply/errors.csv
+12
View File
@@ -0,0 +1,12 @@
call_id,decision_ms,user_text_at_decision,can_reply_now,confidence,reason,annotator,p_now_user,p_now_robot,p_future_user,p_future_robot,both_robot,vad_user,vad_robot,prediction_05,correct_05,prediction_08,correct_08,future_prediction_05,both_prediction_05,smart_turn_probability,smart_turn_prediction_05,smart_turn_prediction_08,audio_start_ms,audio_end_ms,context_ms,frame_count,replay_inference_ms,asr_agent_active_at_point,asr_user_segment_crosses_point,label_status
2c83253a-7977-4e3c-a387-0aa1ea06fbe1,48125,型号是24年380大众帕萨特星空龙腾版。,0,low,mid_turn_pause,xlsx_draft,0.48770105838775635,0.5122854709625244,0.3977898359298706,0.6022026538848877,0.5122854709625244,0.0005360433715395629,0.00010683283471735194,1,0,0,1,1,1,0.9848582744598389,1,1,28125,48125,20000,200,1017.8633751347661,0,1,draft
2c83253a-7977-4e3c-a387-0aa1ea06fbe1,76672,恒泰轮胎前门两条轮胎开裂,0,low,unfinished_expression,xlsx_draft,0.29331472516059875,0.7066654562950134,0.29390087723731995,0.7060902714729309,0.7060902714729309,0.00018711105803959072,0.00024062590091489255,1,0,0,1,1,1,0.9729918241500854,1,1,56672,76672,20000,200,1007.945875171572,0,1,draft
2c83253a-7977-4e3c-a387-0aa1ea06fbe1,88482,尽快，已经影响行车安全了。,1,low,completed_answer,xlsx_draft,0.885348916053772,0.11463910341262817,0.7168461680412292,0.28314584493637085,0.11463910341262817,0.022837858647108078,7.339265721384436e-05,0,0,0,0,0,0,0.9729918241500854,1,1,68482,88482,20000,200,1013.5022499598563,0,0,draft
40ae686c-8196-4d7b-b7ad-3e12a427ebb6,70430,轮胎裂纹同意更换新轮胎。但是20,0,low,unfinished_expression,xlsx_draft,0.05483492836356163,0.9451597929000854,0.1947745531797409,0.8052172064781189,0.8052172064781189,0.0005812415038235486,0.9999233484268188,1,0,1,0,1,1,0.8732463121414185,1,1,50430,70430,20000,200,1008.9897499419749,1,1,draft
40ae686c-8196-4d7b-b7ad-3e12a427ebb6,82941,可以。,1,low,completed_answer,xlsx_draft,0.7286096811294556,0.27137291431427,0.720654308795929,0.27933770418167114,0.27137291431427,0.000260786444414407,8.787301339907572e-05,0,0,0,0,0,0,0.9801466464996338,1,1,62941,82941,20000,200,988.0605833604932,0,0,draft
872a1e67-873a-4c49-a598-b38a670afcad,17153,我姓宋。,1,low,completed_answer,xlsx_draft,0.5991079807281494,0.4008772671222687,0.621396005153656,0.378596693277359,0.378596693277359,0.00047209489275701344,0.00011928172898478806,0,0,0,0,0,0,0.9880069494247437,1,1,53,17153,17100,171,824.6394577436149,0,0,draft
a266b9ef-5e47-4434-a04c-ce4eacd52c19,68313,轮胎质量问题规律，排水槽横向竖向龟裂。,0,low,mid_turn_pause,xlsx_draft,0.19254903495311737,0.8074355721473694,0.2019786387681961,0.7980139255523682,0.7980139255523682,0.00010600832320051268,0.00039402887341566384,1,0,1,0,1,1,0.9889053702354431,1,1,48313,68313,20000,200,985.129208303988,0,1,draft
e304f740-85d4-427e-9fd6-c5474e9cd737,29619,投诉。,1,low,completed_answer,xlsx_draft,0.5503987073898315,0.44958046078681946,0.5612668395042419,0.4387241005897522,0.4387241005897522,0.00015334364434238523,0.00010900569031946361,0,0,0,0,0,0,0.9604700207710266,1,1,9619,29619,20000,200,992.5864171236753,0,0,draft
872a1e67-873a-4c49-a598-b38a670afcad,47187,帕萨特L2025款 ,0,,mid_turn_pause,,0.29946237802505493,0.700522243976593,0.3146718144416809,0.6853206753730774,0.6853206753730774,0.0006991042173467577,0.00023936097568366677,1,0,0,1,1,1,0.978554368019104,1,1,27187,47187,20000,200,999.0723747760057,0,1,unconfirmed_manual
a266b9ef-5e47-4434-a04c-ce4eacd52c19,41219,迈腾2023款330豪华版2.0T,0,,mid_turn_pause,,0.0897170826792717,0.9102716445922852,0.12846434116363525,0.8715291023254395,0.8715291023254395,0.00023869278084021062,0.0010627142619341612,1,0,1,0,1,1,0.9870367050170898,1,1,21219,41219,20000,200,988.6126252822578,0,1,unconfirmed_manual
cb3238dc-3946-42a5-aad8-9b9a54226363,49204,我是2023年、2024年1月份购置的迈腾3302023款轿车,0,,mid_turn_pause,,0.1399012804031372,0.8600831627845764,0.1313445121049881,0.8686479926109314,0.8600831627845764,0.00014179428399074823,0.0002719922340475023,1,0,1,0,1,1,0.9808988571166992,1,1,29204,49204,20000,200,1011.6221671923995,0,1,unconfirmed_manual
1 call_id decision_ms user_text_at_decision can_reply_now confidence reason annotator p_now_user p_now_robot p_future_user p_future_robot both_robot vad_user vad_robot prediction_05 correct_05 prediction_08 correct_08 future_prediction_05 both_prediction_05 smart_turn_probability smart_turn_prediction_05 smart_turn_prediction_08 audio_start_ms audio_end_ms context_ms frame_count replay_inference_ms asr_agent_active_at_point asr_user_segment_crosses_point label_status
2 2c83253a-7977-4e3c-a387-0aa1ea06fbe1 48125 型号是24年380大众帕萨特星空龙腾版。 0 low mid_turn_pause xlsx_draft 0.48770105838775635 0.5122854709625244 0.3977898359298706 0.6022026538848877 0.5122854709625244 0.0005360433715395629 0.00010683283471735194 1 0 0 1 1 1 0.9848582744598389 1 1 28125 48125 20000 200 1017.8633751347661 0 1 draft
3 2c83253a-7977-4e3c-a387-0aa1ea06fbe1 76672 恒泰轮胎前门两条轮胎开裂 0 low unfinished_expression xlsx_draft 0.29331472516059875 0.7066654562950134 0.29390087723731995 0.7060902714729309 0.7060902714729309 0.00018711105803959072 0.00024062590091489255 1 0 0 1 1 1 0.9729918241500854 1 1 56672 76672 20000 200 1007.945875171572 0 1 draft
4 2c83253a-7977-4e3c-a387-0aa1ea06fbe1 88482 尽快，已经影响行车安全了。 1 low completed_answer xlsx_draft 0.885348916053772 0.11463910341262817 0.7168461680412292 0.28314584493637085 0.11463910341262817 0.022837858647108078 7.339265721384436e-05 0 0 0 0 0 0 0.9729918241500854 1 1 68482 88482 20000 200 1013.5022499598563 0 0 draft
5 40ae686c-8196-4d7b-b7ad-3e12a427ebb6 70430 轮胎裂纹同意更换新轮胎。但是20 0 low unfinished_expression xlsx_draft 0.05483492836356163 0.9451597929000854 0.1947745531797409 0.8052172064781189 0.8052172064781189 0.0005812415038235486 0.9999233484268188 1 0 1 0 1 1 0.8732463121414185 1 1 50430 70430 20000 200 1008.9897499419749 1 1 draft
6 40ae686c-8196-4d7b-b7ad-3e12a427ebb6 82941 可以。 1 low completed_answer xlsx_draft 0.7286096811294556 0.27137291431427 0.720654308795929 0.27933770418167114 0.27137291431427 0.000260786444414407 8.787301339907572e-05 0 0 0 0 0 0 0.9801466464996338 1 1 62941 82941 20000 200 988.0605833604932 0 0 draft
7 872a1e67-873a-4c49-a598-b38a670afcad 17153 我姓宋。 1 low completed_answer xlsx_draft 0.5991079807281494 0.4008772671222687 0.621396005153656 0.378596693277359 0.378596693277359 0.00047209489275701344 0.00011928172898478806 0 0 0 0 0 0 0.9880069494247437 1 1 53 17153 17100 171 824.6394577436149 0 0 draft
8 a266b9ef-5e47-4434-a04c-ce4eacd52c19 68313 轮胎质量问题规律，排水槽横向竖向龟裂。 0 low mid_turn_pause xlsx_draft 0.19254903495311737 0.8074355721473694 0.2019786387681961 0.7980139255523682 0.7980139255523682 0.00010600832320051268 0.00039402887341566384 1 0 1 0 1 1 0.9889053702354431 1 1 48313 68313 20000 200 985.129208303988 0 1 draft
9 e304f740-85d4-427e-9fd6-c5474e9cd737 29619 投诉。 1 low completed_answer xlsx_draft 0.5503987073898315 0.44958046078681946 0.5612668395042419 0.4387241005897522 0.4387241005897522 0.00015334364434238523 0.00010900569031946361 0 0 0 0 0 0 0.9604700207710266 1 1 9619 29619 20000 200 992.5864171236753 0 0 draft
10 872a1e67-873a-4c49-a598-b38a670afcad 47187 帕萨特L2025款 0 mid_turn_pause 0.29946237802505493 0.700522243976593 0.3146718144416809 0.6853206753730774 0.6853206753730774 0.0006991042173467577 0.00023936097568366677 1 0 0 1 1 1 0.978554368019104 1 1 27187 47187 20000 200 999.0723747760057 0 1 unconfirmed_manual
11 a266b9ef-5e47-4434-a04c-ce4eacd52c19 41219 迈腾2023款330豪华版2.0T 0 mid_turn_pause 0.0897170826792717 0.9102716445922852 0.12846434116363525 0.8715291023254395 0.8715291023254395 0.00023869278084021062 0.0010627142619341612 1 0 1 0 1 1 0.9870367050170898 1 1 21219 41219 20000 200 988.6126252822578 0 1 unconfirmed_manual
12 cb3238dc-3946-42a5-aad8-9b9a54226363 49204 我是2023年、2024年1月份购置的迈腾3302023款轿车 0 mid_turn_pause 0.1399012804031372 0.8600831627845764 0.1313445121049881 0.8686479926109314 0.8600831627845764 0.00014179428399074823 0.0002719922340475023 1 0 1 0 1 1 0.9808988571166992 1 1 29204 49204 20000 200 1011.6221671923995 0 1 unconfirmed_manual