Files
xiaobailing-turn-detection/experiments/maai-ch-kyoto/results/mimi-run.log
T

176 lines
8.4 KiB
Plaintext

2026-10-27 15:04:31.764 python3[36201:79391758] 2026-10-27 15:04:31.764190 [W:onnxruntime:Default, telemetry_1ds.cc:600 operator()] Failed to persist telemetry device ID; using an in-memory identifier
WITNESS Mimi standard CPU seed=42 score=0.9191182; exact repeat, future invariance, both speakers and loading audit passed
2026-10-27 15:04:40.786 python3[36201:79391796] NetworkStorageDB:_openDBReadConnections: failed to open read connection to DB @ /Users/wangx/Library/Caches/python3/Cache.db. Error=14. Cause=unable to open database file
2026-10-27 15:04:40.786 python3[36201:79391796] The read-connection to the DB=/Users/wangx/Library/Caches/python3/Cache.db is NOT valid. Unable to determine schema version.
2026-10-27 15:04:40.786 python3[36201:79391796] NetworkStorageDB:_openDBWriteConnections: failed to open write connection to DB @ /Users/wangx/Library/Caches/python3/Cache.db. Error=14. Cause=unable to open database file
2026-10-27 15:04:40.786 python3[36201:79391796] DEBUG: there is no SQL cache DB located at /Users/wangx/Library/Caches/python3/Cache.db.
2026-10-27 15:04:40.787 python3[36201:79391796] DEBUG: there is no SQL cache DB located at /Users/wangx/Library/Caches/python3/Cache.db-shm.
2026-10-27 15:04:40.787 python3[36201:79391796] DEBUG: there is no SQL cache DB located at /Users/wangx/Library/Caches/python3/Cache.db-wal.
1/44 2c83253a 21780: label=1, Mimi=0.9191, CPC-mc=0.9598
2/44 2c83253a 29860: label=1, Mimi=0.9220, CPC-mc=0.9286
3/44 2c83253a 48125: label=0, Mimi=0.4655, CPC-mc=0.5123
4/44 2c83253a 64000: label=1, Mimi=0.7919, CPC-mc=0.9370
5/44 2c83253a 76672: label=0, Mimi=0.5828, CPC-mc=0.7067
6/44 2c83253a 88482: label=1, Mimi=0.2126, CPC-mc=0.1147
7/44 40ae686c 22007: label=1, Mimi=0.7385, CPC-mc=0.6932
8/44 40ae686c 31842: label=1, Mimi=0.4897, CPC-mc=0.7899
9/44 40ae686c 52348: label=1, Mimi=0.8557, CPC-mc=0.9598
10/44 40ae686c 65298: label=0, Mimi=0.0211, CPC-mc=0.1646
11/44 40ae686c 67943: label=0, Mimi=0.0853, CPC-mc=0.1255
12/44 40ae686c 70430: label=0, Mimi=0.9157, CPC-mc=0.9452
13/44 40ae686c 82941: label=1, Mimi=0.1312, CPC-mc=0.2714
14/44 872a1e67 17153: label=1, Mimi=0.3544, CPC-mc=0.4009
15/44 872a1e67 24846: label=1, Mimi=0.4336, CPC-mc=0.6937
16/44 872a1e67 33471: label=1, Mimi=0.4404, CPC-mc=0.8021
17/44 a266b9ef 18027: label=1, Mimi=0.8423, CPC-mc=0.5774
18/44 a266b9ef 24768: label=1, Mimi=0.4299, CPC-mc=0.5596
19/44 a266b9ef 51080: label=0, Mimi=0.0061, CPC-mc=0.0101
20/44 a266b9ef 68313: label=0, Mimi=0.7154, CPC-mc=0.8075
21/44 cb3238dc 13540: label=1, Mimi=0.8341, CPC-mc=0.9444
22/44 cb3238dc 27520: label=1, Mimi=0.9249, CPC-mc=0.9682
23/44 cb3238dc 60790: label=0, Mimi=0.0064, CPC-mc=0.0566
24/44 cb3238dc 70745: label=0, Mimi=0.1483, CPC-mc=0.2887
25/44 e304f740 18842: label=1, Mimi=0.7855, CPC-mc=0.6193
26/44 e304f740 29619: label=1, Mimi=0.6686, CPC-mc=0.4496
27/44 e304f740 40701: label=0, Mimi=0.2479, CPC-mc=0.4186
28/44 e304f740 54600: label=1, Mimi=0.6685, CPC-mc=0.7056
29/44 e304f740 65819: label=0, Mimi=0.0293, CPC-mc=0.0525
30/44 872a1e67 47187: label=0, Mimi=0.2395, CPC-mc=0.7005
31/44 872a1e67 52326: label=0, Mimi=0.5609, CPC-mc=0.4241
32/44 40ae686c 48536: label=0, Mimi=0.2708, CPC-mc=0.5187
33/44 872a1e67 44810: label=0, Mimi=0.3857, CPC-mc=0.3700
34/44 872a1e67 49500: label=1, Mimi=0.9565, CPC-mc=0.9641
35/44 872a1e67 54318: label=1, Mimi=0.9238, CPC-mc=0.9337
36/44 872a1e67 45581: label=0, Mimi=0.0142, CPC-mc=0.0232
37/44 a266b9ef 41219: label=0, Mimi=0.5353, CPC-mc=0.9103
38/44 cb3238dc 19620: label=1, Mimi=0.8876, CPC-mc=0.9731
39/44 cb3238dc 41207: label=0, Mimi=0.0127, CPC-mc=0.1233
40/44 cb3238dc 49204: label=0, Mimi=0.7771, CPC-mc=0.8601
41/44 cb3238dc 58424: label=0, Mimi=0.1450, CPC-mc=0.1938
42/44 cb3238dc 73640: label=0, Mimi=0.5421, CPC-mc=0.4583
43/44 e304f740 11531: label=1, Mimi=0.6418, CPC-mc=0.5200
44/44 e304f740 62828: label=0, Mimi=0.0510, CPC-mc=0.0221
2c83253a timeline: 932 scores, 6 checkpoints
40ae686c timeline: 834 scores, 8 checkpoints
872a1e67 timeline: 710 scores, 9 checkpoints
a266b9ef timeline: 799 scores, 5 checkpoints
cb3238dc timeline: 902 scores, 9 checkpoints
e304f740 timeline: 690 scores, 7 checkpoints
{
"main_metrics": {
"n": 44,
"tn": 15,
"fp": 7,
"fn": 7,
"tp": 15,
"accuracy": 0.6818181818181818,
"false_reply_rate": 0.3181818181818182,
"false_hold_rate": 0.3181818181818182,
"recall": 0.6818181818181818,
"precision": 0.6818181818181818,
"f1": 0.6818181818181818
},
"cpc_mc_stereo_reference": {
"n": 44,
"tn": 14,
"fp": 8,
"fn": 4,
"tp": 18,
"accuracy": 0.7272727272727273,
"false_reply_rate": 0.36363636363636365,
"false_hold_rate": 0.18181818181818182,
"recall": 0.8181818181818182,
"precision": 0.6923076923076923,
"f1": 0.75
},
"changed_vs_cpc_mc_stereo": {
"fixed": 4,
"regressed": 6
},
"elapsed_seconds": 267.65075033251196
}
WITNESS Mimi mc CPU seed=42 score=0.9657906; exact repeat, future invariance, both speakers and loading audit passed
1/44 2c83253a 21780: label=1, Mimi=0.9658, CPC-mc=0.9598
2/44 2c83253a 29860: label=1, Mimi=0.9578, CPC-mc=0.9286
3/44 2c83253a 48125: label=0, Mimi=0.4555, CPC-mc=0.5123
4/44 2c83253a 64000: label=1, Mimi=0.8707, CPC-mc=0.9370
5/44 2c83253a 76672: label=0, Mimi=0.6865, CPC-mc=0.7067
6/44 2c83253a 88482: label=1, Mimi=0.2586, CPC-mc=0.1147
7/44 40ae686c 22007: label=1, Mimi=0.7644, CPC-mc=0.6932
8/44 40ae686c 31842: label=1, Mimi=0.6238, CPC-mc=0.7899
9/44 40ae686c 52348: label=1, Mimi=0.8982, CPC-mc=0.9598
10/44 40ae686c 65298: label=0, Mimi=0.0665, CPC-mc=0.1646
11/44 40ae686c 67943: label=0, Mimi=0.0588, CPC-mc=0.1255
12/44 40ae686c 70430: label=0, Mimi=0.9187, CPC-mc=0.9452
13/44 40ae686c 82941: label=1, Mimi=0.2951, CPC-mc=0.2714
14/44 872a1e67 17153: label=1, Mimi=0.5796, CPC-mc=0.4009
15/44 872a1e67 24846: label=1, Mimi=0.4162, CPC-mc=0.6937
16/44 872a1e67 33471: label=1, Mimi=0.7418, CPC-mc=0.8021
17/44 a266b9ef 18027: label=1, Mimi=0.8496, CPC-mc=0.5774
18/44 a266b9ef 24768: label=1, Mimi=0.8364, CPC-mc=0.5596
19/44 a266b9ef 51080: label=0, Mimi=0.0073, CPC-mc=0.0101
20/44 a266b9ef 68313: label=0, Mimi=0.8308, CPC-mc=0.8075
21/44 cb3238dc 13540: label=1, Mimi=0.9350, CPC-mc=0.9444
22/44 cb3238dc 27520: label=1, Mimi=0.9325, CPC-mc=0.9682
23/44 cb3238dc 60790: label=0, Mimi=0.0127, CPC-mc=0.0566
24/44 cb3238dc 70745: label=0, Mimi=0.1671, CPC-mc=0.2887
25/44 e304f740 18842: label=1, Mimi=0.7565, CPC-mc=0.6193
26/44 e304f740 29619: label=1, Mimi=0.6641, CPC-mc=0.4496
27/44 e304f740 40701: label=0, Mimi=0.4351, CPC-mc=0.4186
28/44 e304f740 54600: label=1, Mimi=0.6718, CPC-mc=0.7056
29/44 e304f740 65819: label=0, Mimi=0.0296, CPC-mc=0.0525
30/44 872a1e67 47187: label=0, Mimi=0.1424, CPC-mc=0.7005
31/44 872a1e67 52326: label=0, Mimi=0.5535, CPC-mc=0.4241
32/44 40ae686c 48536: label=0, Mimi=0.4352, CPC-mc=0.5187
33/44 872a1e67 44810: label=0, Mimi=0.3361, CPC-mc=0.3700
34/44 872a1e67 49500: label=1, Mimi=0.9702, CPC-mc=0.9641
35/44 872a1e67 54318: label=1, Mimi=0.9644, CPC-mc=0.9337
36/44 872a1e67 45581: label=0, Mimi=0.0159, CPC-mc=0.0232
37/44 a266b9ef 41219: label=0, Mimi=0.5108, CPC-mc=0.9103
38/44 cb3238dc 19620: label=1, Mimi=0.9538, CPC-mc=0.9731
39/44 cb3238dc 41207: label=0, Mimi=0.0144, CPC-mc=0.1233
40/44 cb3238dc 49204: label=0, Mimi=0.6324, CPC-mc=0.8601
41/44 cb3238dc 58424: label=0, Mimi=0.1109, CPC-mc=0.1938
42/44 cb3238dc 73640: label=0, Mimi=0.6731, CPC-mc=0.4583
43/44 e304f740 11531: label=1, Mimi=0.7891, CPC-mc=0.5200
44/44 e304f740 62828: label=0, Mimi=0.0697, CPC-mc=0.0221
2c83253a timeline: 932 scores, 6 checkpoints
40ae686c timeline: 834 scores, 8 checkpoints
872a1e67 timeline: 710 scores, 9 checkpoints
a266b9ef timeline: 799 scores, 5 checkpoints
cb3238dc timeline: 902 scores, 9 checkpoints
e304f740 timeline: 690 scores, 7 checkpoints
{
"main_metrics": {
"n": 44,
"tn": 15,
"fp": 7,
"fn": 3,
"tp": 19,
"accuracy": 0.7727272727272727,
"false_reply_rate": 0.3181818181818182,
"false_hold_rate": 0.13636363636363635,
"recall": 0.8636363636363636,
"precision": 0.7307692307692307,
"f1": 0.7916666666666666
},
"cpc_mc_stereo_reference": {
"n": 44,
"tn": 14,
"fp": 8,
"fn": 4,
"tp": 18,
"accuracy": 0.7272727272727273,
"false_reply_rate": 0.36363636363636365,
"false_hold_rate": 0.18181818181818182,
"recall": 0.8181818181818182,
"precision": 0.6923076923076923,
"f1": 0.75
},
"changed_vs_cpc_mc_stereo": {
"fixed": 5,
"regressed": 3
},
"elapsed_seconds": 278.2951404163614
}