docs(manuscript): record F3 and microchunk screens

This commit is contained in:
Xin Wang
2026-09-24 08:36:39 +08:00
parent b28688b4e8
commit f7b3ed302b
2 changed files with 46 additions and 7 deletions
+7
View File
@@ -34,6 +34,13 @@ remain records of their dates. The new scoped decision is
unmeasured placeholders, not zero or mixed-protocol confirmatory numbers. unmeasured placeholders, not zero or mixed-protocol confirmatory numbers.
Historical main-table screens are identified explicitly. Already inspected Historical main-table screens are identified explicitly. Already inspected
official-test runs remain exploratory despite additional seed repetitions. official-test runs remain exploratory despite additional seed repetitions.
- The main table now includes an exploratory F3 seed-0 no-box full-frame screen
and the re-evaluated G+A dense horizon curve, both under
`causal_valid_only`. F3's 0.2-s/ten-horizon mAP is 82.38/65.54 versus
G+A's 81.72/65.11. This is not a matched visual-motion claim: F2, matched
capacity/history controls, boundary evaluation, and repeat seeds are still
missing. Source records: [F3](../../results/easycom_fullframe_qwen_av/f3_seed0/README.md)
and [G+A](../../results/easycom_omni_audio_recheck_2026-09-24/official_test/README.md).
- Backbone transfer adds paired G/GA controls for Qwen2.5-Omni 3B/7B and - Backbone transfer adds paired G/GA controls for Qwen2.5-Omni 3B/7B and
MiniCPM-o 4.5, fixing the same local audio sidecar. Compact table deltas are MiniCPM-o 4.5, fixing the same local audio sidecar. Compact table deltas are
pending and require readout/refresh/history audits; MiniCPM is not yet pending and require readout/refresh/history audits; MiniCPM is not yet
+39 -7
View File
@@ -261,18 +261,21 @@ detection latency claim.
\subsection{Main Comparison} \subsection{Main Comparison}
Table~\ref{tab:main} retains exploratory references and reserves the locked Table~\ref{tab:main} retains exploratory references and reserves the locked
comparison. Historical runs have unmatched training/selection protocols; comparison. The G+A and F3 seed-0 rows use the same official test split and
the three-seed F1 screen establishes stability, not matched superiority. \texttt{causal\_valid\_only} dense protocol, but their head capacity, visual
history, and training batch differ. The three-seed F1 screen establishes
stability, not matched superiority.
\todo{Fill the locked rows with three-seed mean and sample standard deviation.} \todo{Fill the locked rows with three-seed mean and sample standard deviation.}
\begin{table*}[t] \begin{table*}[t]
\caption{EasyCom Sessions~1--3 dense future-activity and raw-boundary \caption{EasyCom Sessions~1--3 dense future-activity and raw-boundary
screening. All values are percentages. ``Avg.'' averages dense mAP over the ten screening. All values are percentages. ``Avg.'' averages dense mAP over the ten
horizons; On/Off are mean raw wearer onset/offset AP and are timing diagnostics, horizons; On/Off are mean raw wearer onset/offset AP and are timing diagnostics,
not semantic ENTRY/INT scores. $\dagger$ denotes historical seed-0 runs with an not semantic ENTRY/INT scores. $\dagger$ denotes exploratory seed-0 runs
unmatched training/selection protocol; $\ddagger$ denotes a three-seed screen. without a complete matched capacity/history comparison; $\ddagger$ denotes a
Missing horizon curves and the final matched comparison will be filled after three-seed screen. F3 uses a two-frame causal full-frame token history without
the matched dense/boundary reruns.} person boxes. Dashes indicate unmeasured values; locked rows await the final
matched dense/boundary reruns.}
\label{tab:main} \label{tab:main}
\centering \centering
\scriptsize \scriptsize
@@ -290,11 +293,14 @@ EgoSpeak MiniROADA A+V
& 74.20 & 68.35 & 64.31 & 61.13 & 59.77 & 58.81 & 57.50 & 57.09 & 55.95 & 54.82 & 74.20 & 68.35 & 64.31 & 61.13 & 59.77 & 58.81 & 57.50 & 57.09 & 55.95 & 54.82
& 61.19 & 24.49 & 38.02\\ & 61.19 & 24.49 & 38.02\\
Omni $G{+}A^{\dagger}$ Omni $G{+}A^{\dagger}$
& 81.72 & -- & -- & -- & -- & -- & -- & -- & -- & -- & 81.72 & 75.92 & 70.38 & 66.46 & 63.81 & 61.37 & 60.00 & 58.32 & 56.95 & 56.16
& 65.11 & 25.96 & 45.25\\ & 65.11 & 25.96 & 45.25\\
Omni $G{+}A{+}$pooled-$V^{\dagger}$ Omni $G{+}A{+}$pooled-$V^{\dagger}$
& 82.03 & -- & -- & -- & -- & -- & -- & -- & -- & -- & 82.03 & -- & -- & -- & -- & -- & -- & -- & -- & --
& 65.40 & 26.02 & 45.37\\ & 65.40 & 26.02 & 45.37\\
No-box full-frame F3$^{\dagger}$
& 82.38 & 76.42 & 70.78 & 66.35 & 63.93 & 61.87 & 60.41 & 59.11 & 57.61 & 56.53
& 65.54 & -- & --\\
Current-frame F1$^{\ddagger}$ Current-frame F1$^{\ddagger}$
& $81.78{\pm}0.16$ & -- & -- & -- & -- & -- & -- & -- & -- & -- & $81.78{\pm}0.16$ & -- & -- & -- & -- & -- & -- & -- & -- & --
& $64.95{\pm}0.09$ & -- & --\\ & $64.95{\pm}0.09$ & -- & --\\
@@ -328,6 +334,16 @@ global-only head as a capacity control. These branches expose different
history ranges, so the comparison is not a pure Thinker-versus-encoder test. history ranges, so the comparison is not a pure Thinker-versus-encoder test.
Past-delayed local inputs provide separate fixed-checkpoint sensitivity Past-delayed local inputs provide separate fixed-checkpoint sensitivity
tests, not substitutes for retrained modality-removal controls. tests, not substitutes for retrained modality-removal controls.
In a seed-0 exploratory screen, no-box full-frame F3 uses two strictly causal
2-FPS spatial-token observations per grid position and a shared GRU. On
Sessions~1--3, its 0.2-s mAP is 82.38\% and ten-horizon mean mAP is 65.54\%,
versus 81.72\% and 65.11\% for the existing $G+A$ head (differences of
+0.66 and +0.43 points). This comparison shares the global states, recent
Qwen audio source, test split, and dense evaluation protocol, but adds visual
input and temporal parameters and uses a different training batch. It does
not isolate visual motion or establish wearer floor-control improvement;
F2, capacity/history-matched controls, boundary metrics, and repeat seeds
remain outstanding.
\todo{Insert audio and visual marginal deltas in wearer, onset, and offset \todo{Insert audio and visual marginal deltas in wearer, onset, and offset
AP; retain negative findings even if overall mAP increases.} AP; retain negative findings even if overall mAP increases.}
@@ -345,6 +361,7 @@ comparison. Completed-only states update at 2-s closures and are causally
held between them; tail-aware states use the observed partial block at every held between them; tail-aware states use the observed partial block at every
cutoff. Enabled local audio remains 5~Hz. Common startup rows and valid pairs cutoff. Enabled local audio remains 5~Hz. Common startup rows and valid pairs
are used. This tests whether the two paths are complementary or redundant. are used. This tests whether the two paths are complementary or redundant.
The global-only chunk screen below is separate from this matched factorial.
\begin{table}[t] \begin{table}[t]
\caption{Planned controls. M/W: mean mAP/wearer AP; On/Off: mean endpoint \caption{Planned controls. M/W: mean mAP/wearer AP; On/Off: mean endpoint
@@ -377,6 +394,21 @@ MiniCPM-o 4.5 & -- & -- & -- & --\\
\end{tabular} \end{tabular}
\end{table} \end{table}
\textbf{Exploratory 200-ms chunk screen.}
With frozen Qwen2.5-Omni-3B global features, 8-s memory, and 2-FPS video, we
trained separate seed-0 heads for ten epochs on Sessions 4--12 and evaluated
Sessions 1--3 under the causal-valid protocol. A native 2-s completed-block
hold, non-native 200-ms
payload commits, and completed blocks with an observed partial tail obtain
59.62/67.05/70.85\% mAP at the 0.2-s horizon, respectively; their
ten-horizon mean mAPs are 55.19/57.84/59.17\%. The microchunk advantage
over hold remains after excluding the first nine startup decisions per
session, but requires 95,453 versus 9,539 processor calls over all 12
sessions. This previously inspected, single-seed test-set screen measures
dense activity forecasting, not floor events or native 200-ms streaming.
Freshness and chunk construction both change, and the older partial-tail
feature bank is not a fully matched extraction-version control.
The planned 4/8/16-s context-cap comparison keeps local evidence at 1~s The planned 4/8/16-s context-cap comparison keeps local evidence at 1~s
and reports actual history spans and block phases. Each cap requires its and reports actual history spans and block phases. Each cap requires its
own extracted states and matched training; a fixed-checkpoint context own extracted states and matched training; a fixed-checkpoint context