 Xin Wang
|
07f7d1a48c
|
Update targeted manuscript analysis and selected case figure
|
2026-10-25 23:02:03 +08:00 |
|
|
Xin Wang
|
f7b3ed302b
|
docs(manuscript): record F3 and microchunk screens
|
2026-09-24 08:36:39 +08:00 |
|
|
Xin Wang
|
b28688b4e8
|
Add icassp 2027 templates
|
2026-09-24 00:23:41 +08:00 |
|
|
Xin Wang
|
dcbf60a360
|
Merge branch 'main' of http://182.92.86.220:8300/wx44wx/icassp2027-experiment
|
2026-09-17 03:05:43 +08:00 |
|
|
Xin Wang
|
9bc89b556f
|
Add shared-AV multiwindow Qwen feature extraction
|
2026-09-17 03:00:05 +08:00 |
|
|
Xin Wang
|
a183fe5944
|
Restructure local-evidence manuscript and record analysis controls
|
2026-09-17 02:14:56 +08:00 |
|
|
Xin Wang
|
7344d0c469
|
Add inference-only evaluation for EgoSpeak Omni finetuning
|
2026-09-16 17:28:31 +08:00 |
|
|
Xin Wang
|
64adbef13d
|
Add selective EgoSpeak Omni stage-two finetuning
|
2026-09-16 17:04:46 +08:00 |
|
|
Xin Wang
|
eff7a5ad29
|
Record EgoSpeak Omni residual dense and raw anticipation screen
|
2026-09-16 16:53:27 +08:00 |
|
|
Xin Wang
|
8c8f835a77
|
Add frozen EgoSpeak Omni residual fusion stage
|
2026-09-16 15:39:31 +08:00 |
|
|
Xin Wang
|
02e83c0c11
|
Record Omni floor-event screening results
|
2026-09-16 03:56:33 +08:00 |
|
|
Xin Wang
|
4b4624f6b8
|
Record EgoSpeak three-level evaluation
|
2026-09-16 03:31:10 +08:00 |
|
|
Xin Wang
|
891222ddd2
|
Skip zero-duration floor opportunities
|
2026-09-16 02:32:16 +08:00 |
|
|
Xin Wang
|
89e685c830
|
Add opportunity-conditioned EgoSpeak event evaluation
|
2026-09-16 02:27:44 +08:00 |
|
|
Xin Wang
|
af4817004b
|
Audit malformed Ego4D voice segments
|
2026-09-15 13:48:29 +08:00 |
|
|
Xin Wang
|
a8a09d8fc5
|
Add EgoSpeak dense event proxy evaluation
|
2026-09-15 13:35:35 +08:00 |
|
|
Xin Wang
|
b3dc02b293
|
Handle Ego4D terminal voice endpoints
|
2026-09-15 13:27:01 +08:00 |
|
|
Xin Wang
|
86aa124a46
|
Add Ego4D AV assisted annotation review workflow
|
2026-09-15 13:23:59 +08:00 |
|
|
Xin Wang
|
74b502f770
|
Add provisional LLM review materializer
|
2026-09-15 13:00:34 +08:00 |
|
|
Xin Wang
|
e2c305facc
|
Make EasyCom adjudication resumable
|
2026-09-15 03:25:12 +08:00 |
|
|
Xin Wang
|
2ab56f48d7
|
Add annotated fixed-horizon floor evaluation
|
2026-09-15 02:27:48 +08:00 |
|
|
Xin Wang
|
65347dd75d
|
Make EasyCom event review wearer anchor first
|
2026-09-14 23:30:31 +08:00 |
|
|
Xin Wang
|
068b7ab9e6
|
Merge branch 'main' of http://182.92.86.220:8300/wx44wx/icassp2027-experiment
|
2026-09-14 21:45:55 +08:00 |
|
|
Xin Wang
|
ce5958036f
|
docs: add streaming cache ablation to manuscript
|
2026-09-14 21:43:33 +08:00 |
|
|
Xin Wang
|
7d9db4af58
|
Add manuscript-aligned EasyCom EOT INT review workflow
|
2026-09-14 16:29:25 +08:00 |
|
|
Xin Wang
|
4bfea907b8
|
Fix oracle loader timeline test fixture
|
2026-09-11 10:38:45 +08:00 |
|
|
Xin Wang
|
a57e827606
|
Add floor-event timing objective and addressee diagnostics
|
2026-09-11 00:15:34 +08:00 |
|
|
Xin Wang
|
5937971222
|
Make EgoSpeak Mamba dependency optional
|
2026-09-10 13:20:54 +08:00 |
|
|
Xin Wang
|
1e0aea0956
|
Add EgoSpeak prediction alignment for floor evaluation
|
2026-09-10 11:21:09 +08:00 |
|
|
Xin Wang
|
4b7d2c0c20
|
Add competing-risk evaluation and align ICASSP story
|
2026-09-10 11:12:02 +08:00 |
|
|
Xin Wang
|
0abefd6f77
|
oracle: add fixed four-epoch final protocol
|
2026-09-10 09:53:33 +08:00 |
|
|
Xin Wang
|
c6885d1aa5
|
Merge branch 'main' of http://182.92.86.220:8300/wx44wx/icassp2027-experiment
|
2026-09-10 07:50:25 +08:00 |
|
|
Xin Wang
|
838256a8ae
|
docs: define ICASSP acceptance storyline
|
2026-09-10 06:41:02 +08:00 |
|
|
Xin Wang
|
0534c9d3d0
|
Revise manuscript positioning around causal egocentric floor entry
|
2026-09-08 13:25:01 +08:00 |
|
|
Xin Wang
|
69cec4f6bf
|
Build ICASSP manuscript and experiment framework
|
2026-08-31 14:48:36 +08:00 |
|
|
Xin Wang
|
383a3b72c6
|
docs: draft ICASSP abstract and introduction
|
2026-08-31 00:04:52 +08:00 |
|
|
Xin Wang
|
0f6a72cfdf
|
Fix Ego4D target compatibility in local baselines
|
2026-08-28 15:03:31 +08:00 |
|
|
Xin Wang
|
8b2fbd2622
|
Merge remote-tracking branch 'aliyun/main'
|
2026-08-28 00:21:47 +08:00 |
|
|
Xin Wang
|
5f45e7c115
|
Add EasyCom interaction weak-label pipeline
|
2026-08-28 00:07:54 +08:00 |
|
|
Xin Wang
|
d34725778f
|
Avoid upstream Omni loading-info speaker crash
|
2026-08-27 13:50:02 +08:00 |
|
|
Xin Wang
|
5e34563739
|
Support upstream Omni class for ROMA loading
|
2026-08-27 13:45:25 +08:00 |
|
|
Xin Wang
|
655d27a4ca
|
Add ROMA frozen backbone extraction support
|
2026-08-27 13:35:59 +08:00 |
|
|
Xin Wang
|
f45ea9cbc6
|
Add higher-capacity last-four-layer fusion
|
2026-08-26 13:06:18 +08:00 |
|
|
Xin Wang
|
43e0e14cf5
|
Add learnable last-four-layer query fusion
|
2026-08-26 10:29:43 +08:00 |
|
|
Xin Wang
|
dbef1fc173
|
Add final-layer mixture readout
|
2026-08-26 09:56:54 +08:00 |
|
|
Xin Wang
|
ca6dd88923
|
Add native block phase diagnostic
|
2026-08-26 09:10:21 +08:00 |
|
|
Xin Wang
|
56c8fe0a0e
|
Fix final LoRA checkpoint report
|
2026-08-25 09:45:47 +08:00 |
|
|
Xin Wang
|
aa4278e13e
|
Fix final-layer LoRA target matching
|
2026-08-24 15:38:45 +08:00 |
|
|
Xin Wang
|
7fdda297d3
|
Save periodic LoRA weight checkpoints
|
2026-08-24 15:31:44 +08:00 |
|
|
Xin Wang
|
7acab44ea2
|
Add low-drift LoRA training controls
|
2026-08-24 15:24:53 +08:00 |
|
|
Xin Wang
|
b7856ece4d
|
Archive EasyCom sparse supervision results
|
2026-08-24 12:02:49 +08:00 |
|
|
Xin Wang
|
edd37dc36a
|
Add offline sparse supervision control
|
2026-08-24 11:45:11 +08:00 |
|
|
Xin Wang
|
43cf1f386e
|
Add frozen Thinker sparse head-only control
|
2026-08-24 11:32:03 +08:00 |
|
|
Xin Wang
|
f6dbce30e4
|
Reuse global history frames in overlap working memory
|
2026-08-24 11:17:39 +08:00 |
|
|
Xin Wang
|
1731f2b6f7
|
Optimize overlap working-memory audio preprocessing
|
2026-08-24 10:18:55 +08:00 |
|
|
Xin Wang
|
20446c0bd8
|
Add overlap working-memory ablation and LoRA epoch2 record
|
2026-08-24 09:52:56 +08:00 |
|
|
Xin Wang
|
3cc0c3da85
|
Add frozen Thinker cache-path control
|
2026-08-24 01:07:42 +08:00 |
|
|
Xin Wang
|
c5e2e044a8
|
Add dense-cache evaluation for Omni LoRA
|
2026-08-24 00:27:42 +08:00 |
|
|
Xin Wang
|
a755ab4fc3
|
Add candidate improvement for explicit working and long memory representation in Omni LoRA
|
2026-08-23 23:49:57 +08:00 |
|
|
Xin Wang
|
909ab66c09
|
Add adapter checkpoint support for continued training in Omni LoRA
|
2026-08-23 23:49:09 +08:00 |
|
|
Xin Wang
|
7cdb2d90c2
|
Add multi-GPU DDP for Omni LoRA training
|
2026-08-23 22:41:39 +08:00 |
|
|
Xin Wang
|
cb4abfdf82
|
Add transition-sparse Omni AV caching
|
2026-08-23 18:28:07 +08:00 |
|
|
Xin Wang
|
8b373cd19b
|
Optimize online-tail audio preprocessing
|
2026-08-23 16:49:10 +08:00 |
|
|
Xin Wang
|
c844673984
|
Add TorchCodec video backend
|
2026-08-23 16:41:05 +08:00 |
|
|
Xin Wang
|
b875a7512e
|
Optimize Omni audio preprocessing
|
2026-08-23 16:26:01 +08:00 |
|
|
Xin Wang
|
85ed8a670c
|
Batch Omni AV cache extraction
|
2026-08-23 16:03:07 +08:00 |
|
|
Xin Wang
|
c2162e1170
|
Add two-GPU AV producer for Omni LoRA
|
2026-08-23 15:29:26 +08:00 |
|
|
Xin Wang
|
dc932cc165
|
Add online current-tail LoRA benchmark
|
2026-08-23 15:10:16 +08:00 |
|
|
Xin Wang
|
1069a0beee
|
Add cached AV pipeline for Omni turn LoRA
|
2026-08-23 14:40:03 +08:00 |
|
|
Xin Wang
|
2eb61e30de
|
Add README for Omni-only Turn-Taking Experiment detailing project goals, architecture, current status, and EasyCom results. Include comparisons with EgoSpeak and clarify dataset handling and evaluation processes.
|
2026-08-19 23:09:56 +08:00 |
|
|
Xin Wang
|
2e773706bd
|
Enhance EasyCom and Ego4D integration by adding dataset support and manifest handling. Update normalization functions to accommodate both datasets, and modify training and inference scripts to require manifest files for Ego4D. Improve argument parsing and validation for dataset-specific operations, ensuring proper session management and error handling. Update documentation to reflect changes in dataset usage and evaluation processes.
|
2026-08-19 20:49:28 +08:00 |
|
|
Xin Wang
|
92bf93c96b
|
Update README with verification status of EasyCom components and add results from recent experiments comparing open-stream replay and causal-prefix methods. Introduce new metrics CSV and detailed README for the EasyCom results, including current performance metrics and required follow-up actions before publication.
|
2026-08-19 11:29:27 +08:00 |
|
|
Xin Wang
|
5fa61eed23
|
Add extract_ego4d_batch.py for efficient EgoSpeak clip extraction. This script loads the Qwen model once and processes selected manifest rows sequentially, ensuring each clip is handled independently. Update README with usage instructions and details on the extraction process, including handling of completed outputs and memory management.
|
2026-08-18 22:22:37 +08:00 |
|
|
Xin Wang
|
609b2781d4
|
Add profiling capabilities for processor components in streaming model. Introduce _patch_component_call to time component invocations and enhance _install_profiling_hooks with new processor stages. Refactor tensor conversion and device transfer functions for improved clarity and performance. Update profiling summary to include new stages and advice for optimization.
|
2026-08-18 11:20:55 +08:00 |
|
|
Xin Wang
|
43f47e8f3a
|
Add caching mechanism for completed AV blocks in streaming model. Introduce CompletedBlockPieceCache class to manage reusable blocks during strict-window replay, enhancing efficiency. Update profiling hooks for cache operations and refine README documentation to reflect changes in block handling and replay strategies.
|
2026-08-18 11:02:42 +08:00 |
|
|
Xin Wang
|
d610305355
|
Add profiling script for GPU bottleneck analysis in EasyCom extraction. Introduce command-line options for GPU ID, log directory, and sampling period. Implement stage profiling to measure extraction performance and synchronize CUDA operations. Enhance CausalSourceAV class with new parameters for decoder threads and open readers, optimizing video decoding process.
|
2026-08-18 10:30:19 +08:00 |
|
|
Xin Wang
|
24cb92f1f4
|
Add support for NVDEC backend in video processing and enhance README documentation. Introduce a new script for extracting EasyCom sessions on specific GPUs, detailing session management and error handling. Update requirements.txt to include PyNvVideoCodec as an optional dependency. Refactor streaming_turn_model_directly.py to accommodate multiple decoder backends and improve frame indexing with ffprobe.
|
2026-08-18 08:41:54 +08:00 |
|
|
Xin Wang
|
e4fb62ba60
|
Add script for extracting EasyCom sessions with three workers per GPU. This script manages session assignments, ensures serialized worker launches, and includes error handling for session readiness and logging. Enhances the EasyCom pipeline for improved session management and feature extraction.
|
2026-08-17 23:43:34 +08:00 |
|
|
Xin Wang
|
d815b59def
|
Refactor README and streaming_turn_model.py to clarify fixed-grid frame ownership and update documentation. Remove merge conflict markers and enhance explanations regarding session launching conditions and audio slicing behavior.
|
2026-08-17 22:59:02 +08:00 |
|
|
Xin Wang
|
a6dea1529a
|
Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/icassp2027-experiment
|
2026-08-17 22:46:44 +08:00 |
|
|
Xin Wang
|
5ee371f0ae
|
Update README and streaming_turn_model.py to implement half-open interval ownership for fixed-grid AV frames. Adjust verification parameters to 1 for testing, and enhance documentation for clarity on audio slicing and frame selection. Add runtime checks to prevent overlapping temporal coordinates in open-stream intervals.
|
2026-08-17 22:45:17 +08:00 |
|
|
Xin WangandCursor
|
bde72487bb
|
Initial commit: Omni-only turn-taking experiment scaffold.
Add EasyCom prep, Qwen2.5-Omni feature extraction, streaming turn model prototype, and docs for the ICASSP 2027 ego-speak study.
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-08-16 00:02:58 +08:00 |
|