Commit Graph
128 Commits
Author SHA1 Message Date
Xin Wang 162b5b56ef docs: clarify agent framing in manuscript 2026-08-31 23:51:48 +08:00
Xin Wang 12430361ad docs: generalize manuscript across omni backbones 2026-08-31 23:39:15 +08:00
Xin Wang 69cec4f6bf Build ICASSP manuscript and experiment framework 2026-08-31 14:48:36 +08:00
Xin Wang 87aff8f00e Update manuscript 2026-08-31 14:18:20 +08:00
Xin Wang 383a3b72c6 docs: draft ICASSP abstract and introduction 2026-08-31 00:04:52 +08:00
Xin Wang 1b02f0f269 Add maniscript 2026-08-30 23:34:01 +08:00
Xin Wang e22b960b6c docs: add AI-friendly repository navigation 2026-08-30 19:43:54 +08:00
Xin Wang b74e905870 docs: define speaker-grounded floor experiment plan 2026-08-30 19:18:53 +08:00
Xin Wang 6f5115f299 Evaluate wearer floor changes by event 2026-08-30 18:26:15 +08:00
Xin Wang 714b530fe4 Add wearer floor-state proxy evaluation 2026-08-30 18:02:12 +08:00
Xin Wang f1fe134057 Add EasyCom floor event proxy audit 2026-08-30 17:02:13 +08:00
Xin Wang 1433961005 Merge branch 'main' of http://182.92.86.220:8300/wx44wx/icassp2027-experiment 2026-08-30 15:37:17 +08:00
Xin Wang 348c5c3343 Record speaker-aware AV research and literature 2026-08-30 15:36:28 +08:00
Xin Wang 0f6a72cfdf Fix Ego4D target compatibility in local baselines 2026-08-28 15:03:31 +08:00
Xin Wang 4abbde4f52 Allow explicitly audited Ego4D bbox tails 2026-08-28 12:17:02 +08:00
Xin Wang 4011ba9b2a Record EasyCom encoder-only results and horizon analysis 2026-08-28 11:15:09 +08:00
Xin Wang 321238a92f Add EasyCom encoder-only comparison workflow 2026-08-28 10:44:13 +08:00
Xin Wang ee5e735fc2 Add encoder-only Ego4D comparison workflow 2026-08-28 09:36:35 +08:00
Xin Wang 18e8773685 Handle two-frame Ego4D bbox tails and preserve worker errors 2026-08-28 09:26:45 +08:00
Xin Wang 668996bfa8 Handle verified Ego4D terminal bounding-box records 2026-08-28 01:11:51 +08:00
Xin Wang 5fd285e369 Add multi-GPU Ego4D local feature extraction without symlinks 2026-08-28 01:01:25 +08:00
Xin Wang 9bd204b468 Add more preview 2026-08-28 00:46:05 +08:00
Xin Wang b5ce64702a Add Ego4D local AV ablation workflow 2026-08-28 00:25:54 +08:00
Xin Wang 8b2fbd2622 Merge remote-tracking branch 'aliyun/main' 2026-08-28 00:21:47 +08:00
Xin Wang 5f45e7c115 Add EasyCom interaction weak-label pipeline 2026-08-28 00:07:54 +08:00
Xin Wang c4feeb47f4 Fix transformers version 2026-08-27 15:24:59 +08:00
Xin Wang 694473b475 Fix bbox offset 2026-08-27 15:08:38 +08:00
Xin Wang 11f197724f Add pooled local AV baselines and research notes 2026-08-27 14:19:33 +08:00
Xin Wang d34725778f Avoid upstream Omni loading-info speaker crash 2026-08-27 13:50:02 +08:00
Xin Wang 5e34563739 Support upstream Omni class for ROMA loading 2026-08-27 13:45:25 +08:00
Xin Wang 655d27a4ca Add ROMA frozen backbone extraction support 2026-08-27 13:35:59 +08:00
Xin Wang 1925ff71a7 Record preliminary transition auxiliary results 2026-08-27 09:25:08 +08:00
Xin Wang 5923b89d60 Add transition-aware R1 and R2 objectives 2026-08-26 17:18:50 +08:00
Xin Wang 0590df1e88 Record EasyCom loss structure ablation 2026-08-26 16:30:48 +08:00
Xin Wang f35b9108ac Add overlap-aware turn prediction objectives 2026-08-26 15:03:56 +08:00
Xin Wang f45ea9cbc6 Add higher-capacity last-four-layer fusion 2026-08-26 13:06:18 +08:00
Xin Wang 43e0e14cf5 Add learnable last-four-layer query fusion 2026-08-26 10:29:43 +08:00
Xin Wang dbef1fc173 Add final-layer mixture readout 2026-08-26 09:56:54 +08:00
Xin Wang ca6dd88923 Add native block phase diagnostic 2026-08-26 09:10:21 +08:00
Xin Wang 56c8fe0a0e Fix final LoRA checkpoint report 2026-08-25 09:45:47 +08:00
Xin Wang aa4278e13e Fix final-layer LoRA target matching 2026-08-24 15:38:45 +08:00
Xin Wang 7fdda297d3 Save periodic LoRA weight checkpoints 2026-08-24 15:31:44 +08:00
Xin Wang 7acab44ea2 Add low-drift LoRA training controls 2026-08-24 15:24:53 +08:00
Xin Wang b7856ece4d Archive EasyCom sparse supervision results 2026-08-24 12:02:49 +08:00
Xin Wang edd37dc36a Add offline sparse supervision control 2026-08-24 11:45:11 +08:00
Xin Wang 43cf1f386e Add frozen Thinker sparse head-only control 2026-08-24 11:32:03 +08:00
Xin Wang f6dbce30e4 Reuse global history frames in overlap working memory 2026-08-24 11:17:39 +08:00
Xin Wang 1731f2b6f7 Optimize overlap working-memory audio preprocessing 2026-08-24 10:18:55 +08:00
Xin Wang 20446c0bd8 Add overlap working-memory ablation and LoRA epoch2 record 2026-08-24 09:52:56 +08:00
Xin Wang 3cc0c3da85 Add frozen Thinker cache-path control 2026-08-24 01:07:42 +08:00