Add floor-event timing objective and addressee diagnostics
This commit is contained in:
+13
-1
@@ -138,6 +138,14 @@ scenario definitions. These values remain timing-derived behavior proxies,
|
||||
not semantic EOT/INT or addressee ground truth. See the
|
||||
[`runbook`](docs/easycom_competing_risk_floor_evaluation.md).
|
||||
|
||||
Three explanation-oriented diagnostics are implemented but unmeasured: a
|
||||
separately identified post-boundary reactive evaluator, a direct
|
||||
competing-risk response/yield probe over the same frozen Omni/audio/oracle
|
||||
inputs, and a privileged direct-to-wearer `Target_of_Speech` oracle with an
|
||||
equal-width zero-channel control. They diagnose timing, objective and
|
||||
addressee-information limitations respectively; none changes or freezes P0.
|
||||
See [`docs/easycom_floor_event_diagnostics.md`](docs/easycom_floor_event_diagnostics.md).
|
||||
|
||||
### Next experiment gates
|
||||
|
||||
The user has temporarily chosen to run the dense-AP model screen while P0 is
|
||||
@@ -296,7 +304,7 @@ Do not reorganize them physically without compatibility wrappers.
|
||||
| `derive_easycom_interaction_events.py` | Deterministic transcript/timing proxies |
|
||||
| `adjudicate_easycom_interaction_events.py` | Optional ambiguous-event adjudication |
|
||||
| `audit_easycom_floor_events.py` | Count EOT/takeover/backchannel candidates |
|
||||
| `prepare_easycom_oracle_features.py` | Build explicit past-only oracle person-activity sidecars for information-value screening |
|
||||
| `prepare_easycom_oracle_features.py` | Build explicit past-only oracle person-activity sidecars and analysis-only addressee controls |
|
||||
|
||||
### Local features
|
||||
|
||||
@@ -312,9 +320,13 @@ Do not reorganize them physically without compatibility wrappers.
|
||||
| `train_turn_head.py` | Frozen-backbone head training, optional local fusion/auxiliary losses |
|
||||
| `infer_turn_head.py` | Save EgoSpeak-compatible predictions and AP/mAP |
|
||||
| `evaluate_floor_state_changes.py` | CPU floor-state/event proxy evaluation |
|
||||
| `train_easycom_floor_event_probe.py` | Analysis-only direct response/yield probe with shared competing-risk labels |
|
||||
| `summarize_easycom_floor_event_probes.py` | Compare direct event-probe conditions under one evaluation contract |
|
||||
| `summarize_local_baselines.py` | Aggregate local baseline `metrics.json` files |
|
||||
| `run_easycom_track_gru_residual.sh` | Matched pooled and anonymous track-GRU training/inference launcher |
|
||||
| `run_easycom_oracle_information.sh` | Prepare and screen aggregate/per-person/shuffled/delayed oracle conditions on Session 12 |
|
||||
| `run_easycom_floor_event_probes.sh` | Prepare, train and compare aggregate/addressee direct event probes |
|
||||
| `run_easycom_post_boundary_eval.sh` | Compare existing dense runs after the aggregate-other boundary is observed |
|
||||
| `train_omni_turn_lora.py` | Thinker LoRA training from cached AV |
|
||||
| `eval_omni_turn_lora.py` | Thinker LoRA evaluation |
|
||||
|
||||
|
||||
Reference in New Issue
Block a user