Fix opportunity competing-risk evaluation

This commit is contained in:
Xin Wang
2026-09-16 04:31:18 +08:00
parent 02e83c0c11
commit d4c900ab13
10 changed files with 310 additions and 88 deletions
+6 -7
View File
@@ -406,8 +406,8 @@ verify identical targets, causal validity, and evaluation.}
\begin{table}[t]
\caption{Confirmatory EasyCom results. Entry and INT false-positive rates use
the opportunity-conditioned activity score at matched recall $R=0.8$; E/I AP
is the corresponding opportunity AP. $\dagger$ denotes provisional
LLM-assisted labels pending human review.}
is the corresponding opportunity AP. Event results will be populated only
after protocol-v2 reruns and human adjudication.}
\label{tab:main}
\centering
\small
@@ -417,7 +417,7 @@ LLM-assisted labels pending human review.}
Method & 0.2-s mAP $\uparrow$ & Mean mAP $\uparrow$
& Entry FPR@$R=.8$ $\downarrow$ & INT FPR@$R=.8$ $\downarrow$ & E/I AP $\uparrow$\\
\hline
EgoSpeak MiniROADA A+V & 74.12 & 61.16 & \todo{--} & \todo{--} & $52.49/20.13^\dagger$\\
EgoSpeak MiniROADA A+V & 74.12 & 61.16 & \todo{--} & \todo{--} & \todo{--/--}\\
Omni-3B frozen $G$ & \todo{--} & \todo{--} & \todo{--} & \todo{--} & \todo{--/--}\\
Omni-3B matched PEFT & \todo{--} & \todo{--} & \todo{--} & \todo{--} & \todo{--/--}\\
$G+$local audio & \todo{--} & \todo{--} & \todo{--} & \todo{--} & \todo{--/--}\\
@@ -430,10 +430,9 @@ Omni-7B scaling control & \todo{--} & \todo{--} & \todo{--} & \todo{--} & \t
\textbf{Dense forecasting.}
The EgoSpeak baseline reaches 74.12\% 0.2-s mAP and 61.16\% mean mAP; its raw
wearer-onset/offset mean APs are 24.49/38.02\%. On provisional reviewed
opportunities, ENTRY AP is 52.49\% versus 32.73\% prevalence, whereas INT AP is
20.13\% versus 20.44\%; continuous wearer-score plots therefore do not alone
establish semantic floor-yield selectivity.
wearer-onset/offset mean APs are 24.49/38.02\%. Opportunity-conditioned values
remain pending a protocol-v2 rerun and human review; continuous wearer-score
plots do not alone establish semantic floor-yield selectivity.
The proposed local AV adapter improves 0.2-s mAP from
\todo{$X$ to $Y$} over the strongest matched baseline and improves
mean mAP by \todo{$Z$ points}.