WeKnora/internal/searchutil
wizardchen e0ea453e3f fix(chunks): trim trusted overlaps by exact position, not text search
Position-aware merging still routed trimming through AppendWithOverlap,
which searches for the longest suffix match inside a window. On periodic
text (table rows, log lines) that search mistakes the repetition for the
overlap and drops real content, and with a zero overlap there is nothing
to search for in the first place.

When coordinates are trusted the overlap is already known, so verify it
character for character and cut exactly, falling back to the text matcher
only when the bodies disagree inside the overlap.
2026-08-06 12:26:15 +08:00
..
chunkmerge.go fix(chunks): trim trusted overlaps by exact position, not text search 2026-08-06 12:26:15 +08:00
chunkmerge_test.go test(chunks): pin exact-overlap contracts for trusted merges 2026-08-06 12:26:15 +08:00
conversion.go feat(web-search): refactor web search provider 2026-03-31 20:22:34 +08:00
imageinfo.go fix(docparser): resolve remote images referenced by HTML img tags (#2355) 2026-07-28 21:08:31 +08:00
imageinfo_html_test.go fix(docparser): resolve remote images referenced by HTML img tags (#2355) 2026-07-28 21:08:31 +08:00
imageinfo_match.go fix(docparser): resolve remote images referenced by HTML img tags (#2355) 2026-07-28 21:08:31 +08:00
imageinfo_match_test.go fix(chunks): keep edited retrieval content consistent 2026-07-28 20:23:48 +08:00
normalize.go refactor: Introduce searchutil package for web search result conversion and keyword score normalization 2025-12-01 18:27:12 +08:00
textutil.go refactor(chat_pipeline): enhance merging logic and add partial overlap removal 2026-03-25 22:08:29 +08:00