Delegate wearer boundary semantics to review
This commit is contained in:
+46
-44
@@ -233,14 +233,16 @@ participant timeline is retained to derive committed interaction events for
|
||||
behavioral evaluation.
|
||||
|
||||
\textbf{Behavioral event annotation.}
|
||||
We use floor-level wearer transitions as high-recall anchors for positive-event
|
||||
annotation. Each wearer onset is examined retrospectively for a preceding
|
||||
non-wearer floor release as contextual metadata and labeled as a wearer-entry
|
||||
whenever the subsequent wearer speech constitutes a genuine floor take,
|
||||
including re-entry while another speaker is active. Similarly, each wearer offset
|
||||
is examined for a new competing non-wearer onset during the current wearer turn
|
||||
and labeled as INT-yield only when the competing speaker genuinely takes over
|
||||
the floor. We use permissive temporal retrieval and let an LLM jointly inspect
|
||||
We use every observed wearer activity transition as a high-recall semantic
|
||||
candidate. For each wearer onset, nearby preceding non-wearer releases, the
|
||||
intervening silence gap, and concurrent activity are retained as contextual
|
||||
facts; the onset is labeled as wearer entry only when the subsequent wearer
|
||||
speech constitutes a genuine floor take, including re-entry while another
|
||||
speaker is active. For each wearer offset, nearby non-wearer onsets and offsets,
|
||||
pre-existing and newly active speakers, overlap durations, and subsequent
|
||||
speakers are retained without a timing-based takeover gate; the offset is
|
||||
labeled as INT-yield only when a non-wearer genuinely takes over and the wearer
|
||||
relinquishes the floor. We let an LLM jointly inspect
|
||||
participant-resolved timing and transcripts to provide a semantic pre-label,
|
||||
followed by mandatory human adjudication. Separately, we mine regions with no
|
||||
wearer response that nevertheless constitute false-positive opportunities:
|
||||
@@ -272,7 +274,9 @@ HN: other backchannel & \todo{--} & \todo{--} \\
|
||||
HN: non-takeover overlap & \todo{--} & \todo{--} \\
|
||||
HN: wearer holds floor & \todo{--} & \todo{--} \\
|
||||
\hline
|
||||
Excluded / fallback & \todo{--} & \todo{--} \\
|
||||
Excluded: valid but out of scope & \todo{--} & \todo{--} \\
|
||||
Excluded: insufficient evidence & \todo{--} & \todo{--} \\
|
||||
Excluded: data quality & \todo{--} & \todo{--} \\
|
||||
\textbf{Scoring-eligible total} & \todo{--} & \todo{--} \\
|
||||
\hline
|
||||
\end{tabular}
|
||||
@@ -557,42 +561,38 @@ because, by definition, many contain no wearer transition.
|
||||
|
||||
\subsection{Positive-event mining}
|
||||
|
||||
\textbf{Floor-level transitions.}
|
||||
Short wearer-silence gaps are conditionally merged before positive mining. In
|
||||
the current audit configuration, a raw onset after at most 0.8~s of silence is
|
||||
treated as a within-turn resumption unless the gap contains sustained competing
|
||||
non-wearer activity. Short feedback-like activity does not by itself split the
|
||||
wearer episode. This grouping changes only the behavioral-event layer, not the
|
||||
source intervals or dense targets.
|
||||
\textbf{Wearer activity transitions.}
|
||||
We preserve every raw wearer $0\!\rightarrow\!1$ and $1\!\rightarrow\!0$
|
||||
boundary as a semantic review candidate. Candidate construction does not merge
|
||||
short silence gaps, infer within-turn resumption, or decide whether overlapping
|
||||
speech constitutes takeover. It only records participant-resolved temporal and
|
||||
transcript facts. The source intervals and dense targets remain unchanged.
|
||||
|
||||
\textbf{Wearer entry.}
|
||||
Every floor-level wearer onset at $t_b$ is proposed as a wearer-entry candidate.
|
||||
We additionally search backward for plausible non-wearer floor releases. A
|
||||
release at $t_r$ is retained as a contextual option
|
||||
only when the interval from $t_r$ to $t_b$ contains neither intervening wearer
|
||||
speech nor a competing non-wearer onset. Each wearer onset contributes at most
|
||||
one review item: $t_b$ is its immutable \emph{behavior anchor}, and the item
|
||||
stores every admissible \emph{opportunity-anchor} option and response delay.
|
||||
Silence duration alone does not reject an option. A preceding release is not
|
||||
required for a positive entry: the wearer may enter after a release, from
|
||||
silence, or while another speaker remains active. When a release clearly
|
||||
prompts the entry, the LLM or human may select one supplied option; neither may
|
||||
invent or move a trigger timestamp. The release relation is metadata for
|
||||
response-oriented analyses, not part of the positive entry label.
|
||||
Every raw wearer onset at $t_b$ is proposed as one wearer-entry review item.
|
||||
We search backward within the retrieval window for non-wearer offsets and store
|
||||
each one with its response delay and factual indicators of intervening wearer
|
||||
speech, intervening other onsets, and concurrent activity. These are possible
|
||||
context anchors rather than deterministically admissible causes. The LLM and
|
||||
human reviewer decide whether the boundary is a genuine new entry, a
|
||||
within-turn resumption, a wearer backchannel, or an excluded non-event. A
|
||||
preceding release is not required for a positive entry: the wearer may enter
|
||||
after a release, from silence, or while another speaker remains active. When a
|
||||
release clearly prompts the entry, the LLM or human may select one supplied
|
||||
option; neither may invent or move a timestamp.
|
||||
|
||||
\textbf{INT-yield.}
|
||||
Starting from an episode-ending wearer offset $t_y$, we search backward inside
|
||||
the current wearer episode for a new competing non-wearer onset $t_o$. With
|
||||
$t_w$ denoting the wearer-episode start, an INT candidate must satisfy
|
||||
\begin{equation}
|
||||
t_w < t_o < t_y < t_o^{\mathrm{off}}.
|
||||
\label{eq:int_candidate}
|
||||
\end{equation}
|
||||
The current audit allows a one-frame (50-ms) tolerance only at the offset
|
||||
boundary. Pre-existing other activity, post-completion onsets, offsets inside a
|
||||
merged wearer episode, and completion-to-silence remain controls. Timing only
|
||||
retrieves a possible interruption; the LLM and human annotator decide whether
|
||||
the competitor genuinely takes over and the wearer yields.
|
||||
Every raw wearer offset $t_y$ is proposed as an INT-yield review item. The
|
||||
generator records the current wearer activity-run start, all nearby non-wearer
|
||||
onsets and offsets, activity immediately before and after $t_y$, whether an
|
||||
other speaker is pre-existing or begins during wearer speech, strict and
|
||||
50-ms-tolerant boundary crossing, overlap duration, the next speech onset,
|
||||
transcripts, and target-of-speech metadata. Relations such as
|
||||
$t_w<t_o<t_y<t_o^{\mathrm{off}}$ are descriptive evidence only: they neither
|
||||
admit nor reject a candidate and do not establish takeover. The LLM and human
|
||||
annotator answer whether the wearer stopped because a non-wearer genuinely took
|
||||
over the floor. Natural completion, post-completion activity, and within-turn
|
||||
pauses are therefore resolved semantically rather than pre-filtered.
|
||||
|
||||
\subsection{False-positive opportunity mining}
|
||||
|
||||
@@ -624,9 +624,11 @@ relabel it, or exclude an
|
||||
unscorable region. Only human-confirmed \textsc{Wearer-Entry},
|
||||
\textsc{INT-Yield}, and hard-negative opportunities enter evaluation;
|
||||
\textsc{Exclude} candidates do not. Thus \textsc{Exclude} is the sole
|
||||
non-scoring outcome for out-of-scope non-events (e.g., natural wearer completion
|
||||
that merely coincides with feedback), insufficient evidence, unresolvable data
|
||||
quality, or pre-label disagreement.
|
||||
non-scoring verdict, but every exclusion retains a closed-vocabulary reason and
|
||||
derived aggregation group. We report valid-but-out-of-scope behavior (e.g.,
|
||||
natural wearer completion coincident with feedback), insufficient semantic
|
||||
evidence, and data-quality failures separately; model-pass disagreement belongs
|
||||
to insufficient evidence and is never counted as corrupt data.
|
||||
Annotation-only transcripts, identities, target-of-speech metadata, LLM output,
|
||||
and future observations are never supplied to the evaluated forecasting model.
|
||||
|
||||
|
||||
Reference in New Issue
Block a user