WeKnora/internal/infrastructure/chunker
wizardchen c193b949aa fix(chunker): require space after English ? and ! in overlap boundaries
Align English question and exclamation marks with period handling so
URL query strings are not split during overlap. Add regression tests for
URL overlap and inline code protection.
2026-07-28 22:02:30 +08:00
..
header_tracker.go feat(parser): add OpenDataLoader, PaddleOCR-VL engines, and parser improvements 2026-06-03 12:29:13 +08:00
heading_hierarchy.go feat(chunker): heading hierarchy tracker 2026-05-06 17:17:07 +08:00
heading_hierarchy_test.go feat(chunker): heading hierarchy tracker 2026-05-06 17:17:07 +08:00
heading_splitter.go fix(chunker): carry deep sub-heading context into large-section chunks 2026-06-16 16:56:57 +08:00
heading_splitter_test.go fix(chunker): carry deep sub-heading context into large-section chunks 2026-06-16 16:56:57 +08:00
heuristic_splitter.go fix(chunker): trim surrounding whitespace before embedding 2026-05-06 21:16:48 +08:00
heuristic_splitter_test.go fix(chunker): heuristic splitter drops boundaries inside protected spans 2026-05-06 21:16:48 +08:00
patterns.go fix(chunker): recognise CN chapter titles and multi-level numeric headings 2026-05-06 22:14:16 +08:00
patterns_test.go fix(chunker): recognise CN chapter titles and multi-level numeric headings 2026-05-06 22:14:16 +08:00
profiler.go refactor(chunker): drop redundant TierRecursive 2026-05-06 20:23:05 +08:00
profiler_test.go refactor(chunker): drop redundant TierRecursive 2026-05-06 20:23:05 +08:00
splitter.go fix(chunker): require space after English ? and ! in overlap boundaries 2026-07-28 22:02:30 +08:00
splitter_test.go fix(chunker): require space after English ? and ! in overlap boundaries 2026-07-28 22:02:30 +08:00
strategy.go feat(chunker): SplitParentChild children honour configured strategy 2026-05-06 21:16:48 +08:00
strategy_diagnostics_test.go fix(chunker): post-review fixes for preview endpoint robustness 2026-05-06 17:17:07 +08:00
strategy_test.go fix(chunker): keep top-level heading chunks separate 2026-05-19 17:08:56 +08:00
strategy_token_test.go feat(chunker): recursive priority splitting + token-aware budget 2026-05-06 17:17:07 +08:00
tokens.go fix(chunker): post-review fixes for preview endpoint robustness 2026-05-06 17:17:07 +08:00
tokens_test.go feat(chunker): foundation for adaptive 3-tier chunking 2026-05-06 17:17:07 +08:00
validator.go feat(chunker): foundation for adaptive 3-tier chunking 2026-05-06 17:17:07 +08:00