WeKnora/docreader/parser
lyingbug 1030832c4b
fix(security): harden outbound URL SSRF protection (#2626)
* fix(security): harden outbound URL SSRF protection

* test(security): add SSRF validation tests for outbound URL caching

Introduce tests for outbound SSRF validation cache to ensure proper handling of URL validation, including cache reuse for the same origin, cache invalidation on whitelist changes, and expiration of cached entries. This enhances the robustness of SSRF protection mechanisms in the application.

* refactor: clean up whitespace in engine_factory.go and ssrf_outbound_cache.go

Removed unnecessary blank lines in engine_factory.go and adjusted variable declarations for consistency in ssrf_outbound_cache.go. This improves code readability without altering functionality.
2026-08-10 13:24:14 +08:00
..
__init__.py fix(knowledge): support local HTML uploads 2026-07-29 20:11:17 +08:00
base_parser.py feat: introduce WeKnora Lite edition with lightweight configuration and deployment 2026-03-02 21:21:49 +08:00
chain_parser.py feat(metadata): enhance document processing to include metadata extraction and handling 2026-04-01 15:49:47 +08:00
concurrency.py fix(docreader): throttle heavy parser concurrency 2026-05-07 17:36:09 +08:00
doc_parser.py fix(doc_parser): enhance DOC to DOCX conversion reliability 2026-06-01 20:50:02 +08:00
docx2_parser.py feat: 新增文档模型类,调整配置与解析逻辑,优化日志及导入 2025-11-18 22:37:01 +08:00
docx_parser.py fix(docreader): remove default 100-page limit for DOCX parsing 2026-04-28 21:50:15 +08:00
epub_parser.py feat: add EPUB and MHTML document support 2026-06-16 11:25:27 +08:00
excel_convert.py feat(parser): add OpenDataLoader, PaddleOCR-VL engines, and parser improvements 2026-06-03 12:29:13 +08:00
excel_parser.py fix(docreader): align XLS header override behavior with XLSX 2026-07-28 22:00:36 +08:00
html_parser.py fix(knowledge): support local HTML uploads 2026-07-29 20:11:17 +08:00
image_parser.py feat: introduce WeKnora Lite edition with lightweight configuration and deployment 2026-03-02 21:21:49 +08:00
markdown_parser.py refactor(parser): reorganize Markdown parser and enhance gRPC document reading 2026-06-03 12:29:13 +08:00
markitdown_parser.py feat(parser): add OpenDataLoader, PaddleOCR-VL engines, and parser improvements 2026-06-03 12:29:13 +08:00
mhtml_parser.py fix(knowledge): support local HTML uploads 2026-07-29 20:11:17 +08:00
opendataloader_parser.py fix(security): harden outbound URL SSRF protection (#2626) 2026-08-10 13:24:14 +08:00
parser.py fix(docreader): detect legacy doc payloads 2026-07-11 12:21:56 +08:00
pdf_parser.py fix: harden document pipeline concurrency and diagnostics 2026-07-09 13:26:40 +08:00
ppt_convert.py feat(parser): add OpenDataLoader, PaddleOCR-VL engines, and parser improvements 2026-06-03 12:29:13 +08:00
pptx_media.py feat(parser): add OpenDataLoader, PaddleOCR-VL engines, and parser improvements 2026-06-03 12:29:13 +08:00
registry.py fix: pptx/ppt attachment parsing fails — missing parser engine + markitdown extras (#2621) 2026-08-09 16:23:36 +08:00
web_parser.py fix(security): block SSRF via redirects in knowledge URL import 2026-07-02 12:27:48 +08:00
xlsx_merge.py feat(parser): add OpenDataLoader, PaddleOCR-VL engines, and parser improvements 2026-06-03 12:29:13 +08:00
xlsx_repair.py feat(parser): add OpenDataLoader, PaddleOCR-VL engines, and parser improvements 2026-06-03 12:29:13 +08:00