Merge remote-tracking branch 'aliyun/main'
This commit is contained in:
@@ -7,6 +7,10 @@ EgoSpeak** for egocentric turn-taking anticipation.
|
||||
The persistent paper index and Chinese summaries are maintained in
|
||||
[literature_notes](literature_notes/README.md).
|
||||
|
||||
The pooled local-feature B1 experiment (frozen Qwen face crops + recent audio,
|
||||
native 2048D sidecars, optional trainable projection, four-epoch ablations) is
|
||||
documented in [docs/local_feature_baseline.md](docs/local_feature_baseline.md).
|
||||
|
||||
The main experiment is deliberately simple:
|
||||
|
||||
```text
|
||||
@@ -2030,6 +2034,13 @@ open-stream replay path uses version-specific Thinker internals. On Linux,
|
||||
compatible NVIDIA GPU, optionally install `flash-attn` and pass
|
||||
`--flash-attention-2`.
|
||||
|
||||
The separate B1 local extractor, `extract_turn_local_features.py`, is tested
|
||||
with both Transformers 4.52.3 and 4.57.6. An existing 4.57.6 GPU container does
|
||||
not need to be downgraded for local extraction. This does not change the replay
|
||||
API's dependency assumptions. Keep all local sidecars for one experiment on
|
||||
the same version; their metadata records the actual runtime version. See
|
||||
[the local feature guide](docs/local_feature_baseline.md).
|
||||
|
||||
## Ego4D Audio-Visual Diarization download
|
||||
|
||||
Do not download the complete Ego4D release for this experiment. Download only
|
||||
|
||||
Reference in New Issue
Block a user