142 lines
11 KiB
Plaintext
Executable File
142 lines
11 KiB
Plaintext
Executable File
Seed set to 42
|
|
Apply block causal attention
|
|
block size: 12
|
|
setting up audio projector...
|
|
setting up lora model...
|
|
loading state dict from pretrained_models/SoulX-Duplug/SoulX-Duplug-0.6B-Bilingual.pth...
|
|
load_state_dict failed: Error(s) in loading state_dict for State_Prediction_Model:
|
|
Unexpected key(s) in state_dict: "embed_tokens_func.weight". . Retry with strict=False
|
|
2026-10-13 23:42:19,313 - modelscope - INFO - Use user-specified model revision: v2.0.4
|
|
Downloading Model from https://www.modelscope.cn to directory: /mnt/58462F4C462F29E8/xiaobailing-turn-detection-experiments/cache/modelscope/models/iic/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
|
|
2026-10-13 23:42:20,474 - modelscope - INFO - Use user-specified model revision: v2.0.4
|
|
2026-10-13 23:42:20,576 - modelscope - INFO - initiate model from /mnt/58462F4C462F29E8/xiaobailing-turn-detection-experiments/cache/modelscope/models/iic/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
|
|
2026-10-13 23:42:20,577 - modelscope - INFO - initiate model from location /mnt/58462F4C462F29E8/xiaobailing-turn-detection-experiments/cache/modelscope/models/iic/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch.
|
|
2026-10-13 23:42:20,578 - modelscope - INFO - initialize model from /mnt/58462F4C462F29E8/xiaobailing-turn-detection-experiments/cache/modelscope/models/iic/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
|
|
funasr version: 1.2.6.
|
|
Downloading Model from https://www.modelscope.cn to directory: /mnt/58462F4C462F29E8/xiaobailing-turn-detection-experiments/cache/modelscope/models/iic/speech_fsmn_vad_zh-cn-16k-common-pytorch
|
|
2026-10-13 23:42:25,211 - modelscope - WARNING - Model revision not specified, use revision: v2.0.4
|
|
Downloading Model from https://www.modelscope.cn to directory: /mnt/58462F4C462F29E8/xiaobailing-turn-detection-experiments/cache/modelscope/models/iic/punc_ct-transformer_cn-en-common-vocab471067-large
|
|
2026-10-13 23:42:26,140 - modelscope - WARNING - Model revision not specified, use revision: v2.0.4
|
|
Building prefix dict from the default dictionary ...
|
|
DEBUG:jieba:Building prefix dict from the default dictionary ...
|
|
Loading model from cache /mnt/58462F4C462F29E8/xiaobailing-turn-detection-experiments/cache/tmp/jieba.cache
|
|
DEBUG:jieba:Loading model from cache /mnt/58462F4C462F29E8/xiaobailing-turn-detection-experiments/cache/tmp/jieba.cache
|
|
Loading model cost 0.538 seconds.
|
|
DEBUG:jieba:Loading model cost 0.538 seconds.
|
|
Prefix dict has been built successfully.
|
|
DEBUG:jieba:Prefix dict has been built successfully.
|
|
2026-10-13 23:42:48,634 - modelscope - WARNING - No preprocessor field found in cfg.
|
|
2026-10-13 23:42:48,634 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
|
|
2026-10-13 23:42:48,634 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': '/mnt/58462F4C462F29E8/xiaobailing-turn-detection-experiments/cache/modelscope/models/iic/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch'}. trying to build by task and model information.
|
|
2026-10-13 23:42:48,634 - modelscope - INFO - No preprocessor key ('funasr', 'auto-speech-recognition') found in PREPROCESSOR_MAP, skip building preprocessor. If the pipeline runs normally, please ignore this log.
|
|
[DuplexServer] Model loaded successfully.
|
|
[TurnModel] loaded on cuda
|
|
POINT 1/1 872a1e67 17153 label=1 p_complete=0.84656 raw=<|user_idle|> ASR='我先说' replay_ms=11449.7
|
|
{"n": 1, "tn": 0, "fp": 0, "fn": 0, "tp": 1, "accuracy": 1.0, "false_reply_rate": null, "false_hold_rate": 0.0}
|
|
SMOKE_COMPLETE
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
POINT 1/44 2c83253a 21780 label=1 p_complete=0.92592 raw=<|user_idle|> ASR='然后还是' replay_ms=13911.6
|
|
POINT 2/44 2c83253a 29860 label=1 p_complete=0.96569 raw=<|user_idle|> ASR='投诉建议' replay_ms=13351.9
|
|
POINT 3/44 2c83253a 48125 label=0 p_complete=0.79538 raw=<|user_idle|> ASR='零大众帕萨特星空' replay_ms=14653.0
|
|
POINT 4/44 2c83253a 64000 label=1 p_complete=0.84648 raw=<|user_idle|> ASR='三万公里' replay_ms=15793.2
|
|
POINT 5/44 2c83253a 76672 label=0 p_complete=0.93834 raw=<|user_idle|> ASR='条轮胎开裂' replay_ms=14400.3
|
|
POINT 6/44 2c83253a 88482 label=1 p_complete=0.99960 raw=<|user_complete|> ASR='尽快尽快已经影响行车安全了' replay_ms=16530.9
|
|
POINT 7/44 40ae686c 22007 label=1 p_complete=0.93206 raw=<|user_idle|> ASR='宣传' replay_ms=12320.9
|
|
POINT 8/44 40ae686c 31842 label=1 p_complete=0.96021 raw=<|user_idle|> ASR='投诉建议' replay_ms=12251.2
|
|
POINT 9/44 40ae686c 52348 label=1 p_complete=0.97071 raw=<|user_idle|> ASR='程两万四千多公里' replay_ms=16330.9
|
|
POINT 10/44 40ae686c 65298 label=0 p_complete=0.91318 raw=<|user_idle|> ASR='轮胎裂纹' replay_ms=14384.8
|
|
POINT 11/44 40ae686c 67943 label=0 p_complete=0.92020 raw=<|user_idle|> ASR='轮胎裂纹' replay_ms=14446.6
|
|
POINT 12/44 40ae686c 70430 label=0 p_complete=0.85751 raw=<|user_idle|> ASR='同意更换新轮胎但是' replay_ms=13489.9
|
|
POINT 13/44 40ae686c 82941 label=1 p_complete=0.97837 raw=<|user_idle|> ASR='可以' replay_ms=13458.3
|
|
POINT 14/44 872a1e67 17153 label=1 p_complete=0.84656 raw=<|user_idle|> ASR='我先说' replay_ms=11118.6
|
|
POINT 15/44 872a1e67 24846 label=1 p_complete=0.92346 raw=<|user_idle|> ASR='河南郑州市' replay_ms=13814.9
|
|
POINT 16/44 872a1e67 33471 label=1 p_complete=0.91183 raw=<|user_idle|> ASR='我的轮胎开裂了' replay_ms=13486.4
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
POINT 17/44 a266b9ef 18027 label=1 p_complete=0.86870 raw=<|user_idle|> ASR='天津市' replay_ms=13533.1
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
POINT 18/44 a266b9ef 24768 label=1 p_complete=0.97917 raw=<|user_idle|> ASR='投诉' replay_ms=13677.3
|
|
POINT 19/44 a266b9ef 51080 label=0 p_complete=0.98390 raw=<|user_nonidle|> ASR='里程是六千八百五十一公' replay_ms=18125.7
|
|
POINT 20/44 a266b9ef 68313 label=0 p_complete=0.94799 raw=<|user_idle|> ASR='排水槽横向竖向规列' replay_ms=14836.8
|
|
POINT 21/44 cb3238dc 13540 label=1 p_complete=0.94667 raw=<|user_idle|> ASR='郎' replay_ms=8769.5
|
|
POINT 22/44 cb3238dc 27520 label=1 p_complete=0.91532 raw=<|user_idle|> ASR='投诉建议' replay_ms=13392.4
|
|
POINT 23/44 cb3238dc 60790 label=0 p_complete=0.95275 raw=<|user_idle|> ASR='平时两万' replay_ms=16973.8
|
|
POINT 24/44 cb3238dc 70745 label=0 p_complete=0.99144 raw=<|user_idle|> ASR='轮胎开裂' replay_ms=14007.7
|
|
ASR recognition failed: list index out of range
|
|
POINT 25/44 e304f740 18842 label=1 p_complete=0.91236 raw=<|user_idle|> ASR='州昆山' replay_ms=12934.3
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
POINT 26/44 e304f740 29619 label=1 p_complete=0.94370 raw=<|user_idle|> ASR='投诉' replay_ms=12966.9
|
|
POINT 27/44 e304f740 40701 label=0 p_complete=0.93583 raw=<|user_idle|> ASR='帕萨特' replay_ms=12359.1
|
|
POINT 28/44 e304f740 54600 label=1 p_complete=0.98488 raw=<|user_idle|> ASR='一万五千公里左右' replay_ms=15918.9
|
|
POINT 29/44 e304f740 65819 label=0 p_complete=0.96201 raw=<|user_idle|> ASR='最近我在' replay_ms=14974.8
|
|
POINT 30/44 872a1e67 47187 label=0 p_complete=0.81395 raw=<|user_idle|> ASR='二零二五款' replay_ms=14127.0
|
|
POINT 31/44 872a1e67 52326 label=0 p_complete=0.98647 raw=<|user_idle|> ASR='购职的临时离场' replay_ms=15362.0
|
|
POINT 32/44 40ae686c 48348 label=0 p_complete=0.98766 raw=<|user_idle|> ASR='购车时间二零二三年十月份' replay_ms=15352.3
|
|
POINT 33/44 872a1e67 44810 label=0 p_complete=0.96237 raw=<|user_idle|> ASR='帕萨特pro' replay_ms=13045.6
|
|
POINT 34/44 872a1e67 49500 label=1 p_complete=0.99689 raw=<|user_idle|> ASR='二零二五年三月吧' replay_ms=15261.8
|
|
POINT 35/44 872a1e67 54318 label=1 p_complete=0.98398 raw=<|user_idle|> ASR='离场两万九千公里' replay_ms=16175.8
|
|
POINT 36/44 872a1e67 45581 label=0 p_complete=0.41397 raw=<|user_nonidle|> ASR='萨特pro 二零' replay_ms=13759.6
|
|
POINT 37/44 a266b9ef 41219 label=0 p_complete=0.87944 raw=<|user_idle|> ASR='二点零t' replay_ms=14853.8
|
|
POINT 38/44 cb3238dc 19620 label=1 p_complete=0.95707 raw=<|user_idle|> ASR='辽宁葫芦岛' replay_ms=13672.8
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
POINT 39/44 cb3238dc 41207 label=0 p_complete=0.93903 raw=<|user_idle|> ASR='我是二零二三年' replay_ms=13742.3
|
|
ASR recognition failed: list index out of range
|
|
POINT 40/44 cb3238dc 49204 label=0 p_complete=0.95886 raw=<|user_idle|> ASR='二零二三款的轿车' replay_ms=15644.8
|
|
POINT 41/44 cb3238dc 58424 label=0 p_complete=0.93730 raw=<|user_idle|> ASR='我的轮胎' replay_ms=17323.5
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
POINT 42/44 cb3238dc 73640 label=0 p_complete=0.96892 raw=<|user_idle|> ASR='平时两万八千公里轮胎开裂' replay_ms=15690.7
|
|
POINT 43/44 e304f740 11531 label=1 p_complete=0.93725 raw=<|user_idle|> ASR='姓赵' replay_ms=8022.3
|
|
POINT 44/44 e304f740 62828 label=0 p_complete=0.98666 raw=<|user_idle|> ASR='四条轮胎' replay_ms=14868.7
|
|
{"n": 44, "tn": 1, "fp": 21, "fn": 0, "tp": 22, "accuracy": 0.5227272727272727, "false_reply_rate": 0.9545454545454546, "false_hold_rate": 0.0}
|
|
EVALUATION_COMPLETE
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
ASR recognition failed: list index out of range
|
|
BENCH 2c83253a 100/552
|
|
BENCH 2c83253a 200/552
|
|
BENCH 2c83253a 300/552
|
|
BENCH 2c83253a 400/552
|
|
BENCH 2c83253a 500/552
|
|
BENCH 40ae686c 100/518
|
|
BENCH 40ae686c 200/518
|
|
BENCH 40ae686c 300/518
|
|
BENCH 40ae686c 400/518
|
|
BENCH 40ae686c 500/518
|
|
BENCH 872a1e67 100/339
|
|
BENCH 872a1e67 200/339
|
|
BENCH 872a1e67 300/339
|
|
BENCH a266b9ef 100/426
|
|
BENCH a266b9ef 200/426
|
|
BENCH a266b9ef 300/426
|
|
BENCH a266b9ef 400/426
|
|
BENCH cb3238dc 100/460
|
|
BENCH cb3238dc 200/460
|
|
BENCH cb3238dc 300/460
|
|
BENCH cb3238dc 400/460
|
|
BENCH e304f740 100/411
|
|
BENCH e304f740 200/411
|
|
BENCH e304f740 300/411
|
|
BENCH e304f740 400/411
|
|
{"n": 1956, "mean_ms": 117.67224802351365, "median_ms": 91.21004799999355, "p95_ms": 211.0119177505112, "p99_ms": 238.42288805012686, "min_ms": 87.33008800027164, "max_ms": 250.48965200039675}
|
|
ALL_COMPLETE
|