WeKnora/internal/infrastructure/docparser
wizardchen 74c845a1f4 fix(docparser): normalize PaddleOCR-VL HTML tables (#1725)
PaddleOCR-VL renders tables as HTML with per-cell text-align styles.
These waste tokens on layout markup and bypass the chunker's
table-protection logic (which only recognizes Markdown pipe tables),
causing large tables to be split mid-row.

Convert inline HTML <table> blocks to GFM Markdown tables when possible,
and strip presentational attributes (style/class/align/...) for tables
using rowspan/colspan that Markdown cannot express.

Refs: https://github.com/Tencent/WeKnora/issues/1725
2026-06-22 17:31:26 +08:00
..
builtin_converter.go fix(docparser): preserve standalone image uploads from icon filter 2026-04-29 11:58:02 +08:00
engine_registry.go feat: add EPUB and MHTML document support 2026-06-16 11:25:27 +08:00
grpc_parser.go refactor(parser): reorganize Markdown parser and enhance gRPC document reading 2026-06-03 12:29:13 +08:00
helpers.go feat(weknoracloud): implement credential management and status checks 2026-04-14 17:36:01 +08:00
html_table_normalizer.go fix(docparser): normalize PaddleOCR-VL HTML tables (#1725) 2026-06-22 17:31:26 +08:00
html_table_normalizer_test.go fix(docparser): normalize PaddleOCR-VL HTML tables (#1725) 2026-06-22 17:31:26 +08:00
http_parser.go feat(weknoracloud): implement credential management and status checks 2026-04-14 17:36:01 +08:00
image_resolver.go fix: preserve MHTML image resolution and Markdown structure (#1743) 2026-06-22 15:53:54 +08:00
image_resolver_relative_html_test.go fix(docparser): address review feedback on PR #1404 2026-05-21 11:42:56 +08:00
image_resolver_test.go fix: preserve MHTML image resolution and Markdown structure (#1743) 2026-06-22 15:53:54 +08:00
json_converter.go feat(docparser): enhance sortedKeys function for numeric string sorting 2026-03-25 22:08:29 +08:00
json_converter_test.go feat(i18n): add JSON file type support across multiple locales 2026-03-25 22:08:29 +08:00
markdown_image_scanner.go fix(docparser): rename close variable to avoid shadowing builtin 2026-06-22 15:57:41 +08:00
markdown_image_scanner_test.go fix: preserve MHTML image resolution and Markdown structure (#1743) 2026-06-22 15:53:54 +08:00
mineru_cloud_converter.go refactor(parser): reorganize Markdown parser and enhance gRPC document reading 2026-06-03 12:29:13 +08:00
mineru_converter.go fix(docparser): address review feedback on PR #1404 2026-05-21 11:42:56 +08:00
mineru_converter_test.go fix(docparser): address review feedback on PR #1404 2026-05-21 11:42:56 +08:00
paddleocr_vl_cloud_converter.go refactor(parser): reorganize Markdown parser and enhance gRPC document reading 2026-06-03 12:29:13 +08:00
paddleocr_vl_converter.go fix(docparser): normalize PaddleOCR-VL HTML tables (#1725) 2026-06-22 17:31:26 +08:00
resolve_remote_images_test.go fix: deep-copy stored files and images when cloning a knowledge base 2026-06-03 14:45:59 +08:00
weknoracloud_http_reader.go feat(weknoracloud): implement credential management and status checks 2026-04-14 17:36:01 +08:00