WeKnora/docreader/tests
sufan721 3842068d22
fix: stop markdown table regex catastrophic backtracking (#2770)
* fix: stop markdown table regex catastrophic backtracking

The line_pattern in MarkdownTableUtil used overlapping character classes
([\t ]* and [^|\r\n]*) so a `|`-prefixed line missing its trailing `|`
forced the engine to explore an exponential number of backtracking paths,
stalling the single-threaded docreader gRPC event loop (100% CPU, health
check timeout).

Replace whole-text regex substitution with an O(n) line-based pass that
only treats rows beginning and ending with `|` as tables, and preserves
the previous align_pattern semantics via _is_alignment_row.

Fixes #2768

Co-Authored-By: Claude <noreply@anthropic.com>

* fix: keep lone pipe rows and normalize CRLF in table formatter

A single "|" was rewritten into an empty table row and then dropped.
Unify CR/LF before the line scan so exported Markdown tables format
without mixed endings.

---------

Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: wizardchen <wizardchen@tencent.com>
2026-08-24 18:08:07 +08:00
..
fixtures fix(docreader): preserve vertically merged table cells (#2657) 2026-08-12 10:59:49 +08:00
test_config.py test(docreader): align pdf JPEG quality default assertion 2026-06-17 17:18:57 +08:00
test_docx_merge.py fix(docreader): preserve vertically merged table cells (#2657) 2026-08-12 10:59:49 +08:00
test_epub_parser.py feat: add EPUB and MHTML document support 2026-06-16 11:25:27 +08:00
test_excel_parser.py fix(docreader): avoid chart serialization during xlsx preprocessing 2026-08-12 13:26:19 +08:00
test_html_parser.py fix(knowledge): support local HTML uploads 2026-07-29 20:11:17 +08:00
test_markdown_table_util.py fix: stop markdown table regex catastrophic backtracking (#2770) 2026-08-24 18:08:07 +08:00
test_mhtml_parser.py fix: preserve MHTML image resolution and Markdown structure (#1743) 2026-06-22 15:53:54 +08:00
test_opendataloader_parser.py fix(security): harden outbound URL SSRF protection (#2626) 2026-08-10 13:24:14 +08:00
test_parser_concurrency.py fix(docreader): throttle heavy parser concurrency 2026-05-07 17:36:09 +08:00
test_parser_routing.py feat(docreader): add XMind outline parsing (#2713) 2026-08-20 19:49:48 +08:00
test_pdf_embedded_images.py fix(docreader): keep pdfium bitmap alive while copying SMask pixels 2026-08-24 14:41:54 +08:00
test_pdf_router.py feat(docreader): support forcing PDF scanned-page OCR parsing 2026-06-25 17:30:22 +08:00
test_ppt_convert.py ci: add app frontend and docreader checks 2026-07-30 14:13:15 +08:00
test_ssrf.py fix(security): harden outbound URL SSRF protection (#2626) 2026-08-10 13:24:14 +08:00
test_web_parser.py fix(security): block SSRF via redirects in knowledge URL import 2026-07-02 12:27:48 +08:00
test_xmind_parser.py feat(docreader): add XMind outline parsing (#2713) 2026-08-20 19:49:48 +08:00