5.8 KiB
5.8 KiB
Documentation index
Documents are grouped by authority rather than by date. “Planned” never means implemented or validated.
Active paper definition
| Document | Role |
|---|---|
| manuscript_local_evidence_structure_2026-09-17.md | Current narrowed four-page manuscript scope; supersedes older semantic/person-grounded descriptions for the default draft |
| local_evidence_analysis_experiment_log_2026-09-17.md | Pending local evidence, tail/audio, context, cross-backbone transfer, persistence, error and efficiency controls; Omni LoRA deferred |
| icassp2027_acceptance_storyline_2026-09-10.md | Submission-focused paper story, evidence bar, pruning decisions and go/no-go criteria |
| global_local_omni_paper_position_2026-09-07.md | Evidence-backed paper thesis after the causal oracle information screen |
| progressive_feature_fusion_route_2026-09-02.md | Gated route from pooled local evidence to Frame-set Attention, temporal person memory and Thinker adapters |
omni_speaker_floor_experiment_plan_2026-08-30.md |
Current hypotheses, experiment gates, main table and stopping rules |
multiparty_egocentric_floor_gap_audit_2026-08-30.md |
Novelty boundary, closest work and restricted claims |
These documents supersede earlier documents when discussing the paper's main question. They do not supersede verified implementation details in code and tests.
Current implementation runbooks
| Document | Use when |
|---|---|
easycom_multiwindow_features.md |
Shared-AV extraction of independent Qwen 2/4/6/8/10/12-second context banks, GPU smoke and matched head training |
local_feature_baseline.md |
Extracting/validating EasyCom pooled local Qwen visual and audio sidecars |
easycom_encoder_only.md |
Comparing EasyCom Qwen encoder-only A/V/AV representations |
easycom_fullframe_qwen_av.md |
No-box F2/F3 full-frame Qwen spatial and causal spatiotemporal fusion |
ego4d_encoder_only.md |
Preparing and running the Ego4D encoder-only comparison |
ego4d_local_baselines.md |
Previewing Ego4D boxes, extracting local features and running 8-GPU jobs |
easycom_track_gru_residual.md |
Matched pooled-to-track GRU experiment, causal identity contract and L20 commands |
easycom_causal_person_adapter_v2.md |
Dynamic-gated, zero-output causal person-track residual and matched L20 screen |
easycom_egospeak_style_person_gru.md |
Controlled V2 temporal-stem ablation using EgoSpeak MiniROADA's layer order |
easycom_egospeak_omni_residual.md |
Stage-one frozen released MiniROADA plus zero-initialized tail-aware Omni residual fusion |
easycom_egospeak_omni_finetune.md |
Stage-two selective MiniROADA GRU/head continuation with immutable stage-one/base references and raw endpoint AP |
easycom_highrate_person_av.md |
Frozen 25 Hz causal ASD person evidence fused with 5 Hz global Omni context |
easycom_muvap_stage3_baseline.md |
MuVAP-only frozen VAP+ASD Stage-3 paper reconstruction on EgoSpeak/EasyCom targets |
easycom_oracle_information.md |
Causal oracle per-person speaking-history upper bound and Session-12 screening commands |
easycom_competing_risk_floor_evaluation.md |
Running and auditing the competing-risk entry/yield evaluator with training-side threshold calibration |
easycom_floor_event_diagnostics.md |
Separating boundary observability, event-objective mismatch and addressee information with remote commands |
easycom_event_review_tool.md |
Reviewing automatically mined EasyCom floor-event candidates against local video and transcripts |
easycom_opportunity_event_evaluation.md |
Current opportunity-conditioned ENTRY/YIELD evaluation from EgoSpeak-compatible wearer forecasts |
easycom_egospeak_event_proxy.md |
Scoring the EgoSpeak wearer trajectory over equal-width causal decision regions as an activity-derived ENTRY/INT proxy |
easycom_annotated_floor_evaluation.md |
Reproducing the legacy asymmetric point-positive/region-negative fixed-horizon diagnostic |
Design history and implementation options
| Document | Status |
|---|---|
speaker_aware_thinker_plan_2026-08-28.md |
Historical design exploration; useful implementation detail, not current priority order |
trainable_speaker_fusion_survey_2026-08-28.md |
Detailed person-branch/adapter survey feeding the current plan |
Where new material belongs
- Current research decisions: a dated file in
docs/, then link it from this index andPROJECT_CONTEXT.md. - Dataset or command runbook:
docs/<dataset>_<task>.md. - Measured experiment:
results/<dataset>_<question>_<date>/with its own README and machine-readable summary. - Paper summary:
literature_notes/NN_short_name.mdand update its index. - Generated audit report:
reports/; do not present it as a hand-written source of truth.