Add caching mechanism for completed AV blocks in streaming model. Introduce CompletedBlockPieceCache class to manage reusable blocks during strict-window replay, enhancing efficiency. Update profiling hooks for cache operations and refine README documentation to reflect changes in block handling and replay strategies.

2026-08-18 11:02:42 +08:00
parent d610305355
commit 43f47e8f3a
4 changed files with 220 additions and 22 deletions
@@ -1130,6 +1130,11 @@ def main() -> None:
                    if persistent_memory
                    else "rolling_complete_blocks_plus_current_partial_block"
                ),
+                "rolling_replay_inputs": (
+                    None
+                    if persistent_memory
+                    else "reuse_cached_complete_block_av_embeddings"
+                ),
            }
            if args.mode == "open-stream-replay"
            else None