Add competing-risk evaluation and align ICASSP story

This commit is contained in:
Xin Wang
2026-09-10 11:12:02 +08:00
parent 0abefd6f77
commit 4b7d2c0c20
30 changed files with 3420 additions and 724 deletions
+22 -26
View File
@@ -25,32 +25,28 @@ main/
build/ # generated, ignored
```
The author/affiliation, final results, Method, Experimental Setup, Results and
Conclusion are still explicit TODOs. Do not turn planned experiments into
reported findings.
The manuscript is intentionally a content skeleton with visible TODOs. Do not
turn planned implementations, controls, or results into completed claims.
The current paper thesis is model-agnostic and deliberately narrower than
addressee prediction. It asks whether general-purpose omni representations
expose the fine-grained evidence needed for 200 ms wearer floor-action
projection, whether PEFT can recover it, and whether causal local audio/person
evidence provides a reliable complement. The initial planned backbone set is:
The frozen paper story is documented in
[`../../docs/icassp2027_acceptance_storyline_2026-09-10.md`](../../docs/icassp2027_acceptance_storyline_2026-09-10.md).
The paper asks how long-context Omni understanding can be adapted into
sub-second, wearer-relative floor control for an invisible egocentric wearer.
Its single candidate contribution is a causal local floor-evidence adapter:
- Qwen2.5-Omni-3B;
- Qwen2.5-Omni-7B;
- MiniCPM-o 4.5.
- Qwen2.5-Omni-3B is the primary global backbone;
- matched LoRA/PEFT is a baseline, not a separate contribution;
- Qwen2.5-Omni-7B is an optional capacity-scaling control;
- the primary local method uses an anonymous, no-ID visible-person set;
- track continuity is conditional and must defeat no-ID/shuffled/capacity
controls before entering the paper;
- MiniCPM-o and a cross-family sweep are removed from the core plan;
- the oracle is analysis-only motivation, not a deployable method or headline;
- the publication gate is lower competing-risk-censored multi-other false
entry at matched wearer-onset recall without worse valid onset or yield.
The backbone and final fusion method are **not frozen yet**. Current Qwen-3B
numbers are exploratory motivation, not evidence that every omni model has the
same limitation. Compare frozen, PEFT, and local-evidence protocols within each
backbone; report common local encoders separately from model-native local
encoders. Raw cross-model scores are secondary because the models expose
different streaming/readout interfaces.
Track-consistent person fusion remains one candidate after pooled and
capacity-matched controls. If selected, dataset participant IDs route
short-term causal state only; they are not semantic inputs. The publication
gate is an event-level reduction in multi-other false entries at matched
wearer-onset recall without degrading onset latency or wearer-yield behavior.
A general omni claim requires a consistent result across at least two backbone
families; otherwise the paper must state a model-specific finding. Selected
examples are explanatory evidence only.
Competing-risk censoring and training-side threshold calibration are now
implemented and unit-tested. The remaining P0 blocker is the real-data event
audit and protocol/scenario freeze; until then, event values are timing-derived
proxies. Already viewed Sessions 1--3 numbers are exploratory internal evidence
and must not appear in the confirmatory paper table.