docs: add streaming cache ablation to manuscript

This commit is contained in:
Xin Wang
2026-09-14 21:43:33 +08:00
parent 7d9db4af58
commit ce5958036f
3 changed files with 90 additions and 15 deletions
+33 -5
View File
@@ -17,7 +17,9 @@ behavior-aligned multi-other event protocol.
Current Qwen2.5-Omni-3B results are exploratory motivation only. They neither
prove a limitation shared by Omni models nor establish track-consistent fusion
as the final method. Qwen2.5-Omni-3B is primary; Qwen2.5-Omni-7B is an optional
capacity control. MiniCPM-o and a cross-family sweep are outside the core paper.
capacity control. MiniCPM-o remains outside the core method and main comparison;
it is permitted only as a diagnostic streaming/cache ablation with a matched
Qwen refresh-rate control.
The four-page paper has only three contributions: temporal--role adaptation
mismatch, one causal local floor adapter, and causal behavioral evidence.
@@ -63,6 +65,26 @@ a model cannot expose a comparable causal state, report that protocol as
unsupported. Raw scores are not a pure architecture ranking; emphasize
within-backbone deltas.
For the diagnostic streaming/cache ablation:
- [ ] compare Qwen full causal-prefix recomputation and cache reuse at the
same 5-Hz cutoffs, recording numerical agreement, throughput, and memory;
- [ ] map the native MiniCPM-o one-second output to 5-Hz rows by causal
forward-hold only, never by backfilling the state into earlier rows;
- [ ] run a Qwen 1-Hz update-and-hold control with the same physical chunk
boundaries and report the within-Qwen 5-Hz versus 1-Hz delta;
- [ ] freeze initialization before the first completed chunk and reset every
modality/language-model cache at session and source-gap boundaries;
- [ ] before admitting a MiniCPM-o 5-Hz cached-branch row, compare it against
full causal-prefix recomputation at sampled cutoffs under a frozen cosine and
maximum-absolute-error tolerance;
- [ ] run future-media intervention tests at every tested cutoff and record
throughput, peak memory, feature dimensionality, and exact code revision.
If the 5-Hz cached branch fails equivalence or leakage tests, omit that row and
report only the native 1-Hz causal-hold diagnostic. Do not present unmatched
Qwen--MiniCPM raw scores as a pure backbone comparison.
## P2 — Establish the compact adaptation matrix
Run three seeds for the primary backbone with the same data, physical cutoffs,
@@ -144,17 +166,23 @@ Examples explain rates; they never replace them.
2. Audit the Qwen2.5-Omni-3B readout and matched PEFT baseline.
3. Complete the frozen/PEFT/audio/matched-temporal/local-AV matrix.
4. Run correct/time-shift/remove-vision controls and the optional 7B scaling row.
5. Consider track continuity only if the no-ID method already passes.
6. Produce one confirmatory event table and one mechanism-ablation table.
7. Draw one compact final system figure; remove rejected methods from the main
5. Run the Qwen refresh-rate control and the scoped MiniCPM-o streaming/cache
diagnostic; admit the 5-Hz MiniCPM-o row only after equivalence and leakage
audits.
6. Consider track continuity only if the no-ID method already passes.
7. Produce one confirmatory event table and one mechanism-ablation table.
8. Draw one compact final system figure; remove rejected methods from the main
narrative.
8. Replace every visible TODO and verify the ICASSP 2027 kit/page limit.
9. Replace every visible TODO and verify the ICASSP 2027 kit/page limit.
## Stop/go decisions
- **Claim boundary:** with Qwen-only evidence, describe a Qwen2.5-Omni case
study and the tested adaptation mechanism; do not generalize to all Omni
models.
- **Streaming boundary:** call native MiniCPM-o 1-Hz plus causal hold a held-state
baseline, not native 5-Hz inference; a 5-Hz cache result exists only after
cached/full-prefix equivalence and future-input invariance pass.
- **Audio-local reframe:** local audio improves but all visual variants fail;
claim a fine-grained acoustic readout bottleneck, not social visual reasoning.
- **Track-aware method:** correct continuity beats pooled vision, temporal