Merge remote-tracking branch 'aliyun/main'

This commit is contained in:
Xin Wang
2026-08-28 00:21:47 +08:00
24 changed files with 1826 additions and 28 deletions
+11
View File
@@ -7,6 +7,10 @@ EgoSpeak** for egocentric turn-taking anticipation.
The persistent paper index and Chinese summaries are maintained in
[literature_notes](literature_notes/README.md).
The pooled local-feature B1 experiment (frozen Qwen face crops + recent audio,
native 2048D sidecars, optional trainable projection, four-epoch ablations) is
documented in [docs/local_feature_baseline.md](docs/local_feature_baseline.md).
The main experiment is deliberately simple:
```text
@@ -2030,6 +2034,13 @@ open-stream replay path uses version-specific Thinker internals. On Linux,
compatible NVIDIA GPU, optionally install `flash-attn` and pass
`--flash-attention-2`.
The separate B1 local extractor, `extract_turn_local_features.py`, is tested
with both Transformers 4.52.3 and 4.57.6. An existing 4.57.6 GPU container does
not need to be downgraded for local extraction. This does not change the replay
API's dependency assumptions. Keep all local sidecars for one experiment on
the same version; their metadata records the actual runtime version. See
[the local feature guide](docs/local_feature_baseline.md).
## Ego4D Audio-Visual Diarization download
Do not download the complete Ego4D release for this experiment. Download only