WeKnora/internal/infrastructure/docparser
linus-liu-web 9de0946e53
fix(docparser): anydoc 内嵌 EMF/WMF 图片的扩展名与 Rust 侧对齐 (#3938)
anydoc 把内嵌图片就地渲染成 `![alt](images/image-N<ext>)`,`<ext>` 来自
asset_links.rs::extension_for;ImageResolver 再拿这个字符串去一张 map 里查,
键是 anydoc.ImageDir + Asset.Name,而 Name 由 backend_cgo.go::extensionFor 拼出。
查表是精确匹配,两边必须逐字符一致。

EMF/WMF 上两边并不一致:anydoc 对这两类 part 硬编码产出 image/emf 与
image/wmf(shared/assets.rs::media_type_for、shared/officeart.rs),Rust 表
落到 `.bin`,而 Go 侧去查平台 MIME 注册表——在装了 media-types 的 Debian
镜像上拿到 `.emf`/`.wmf`。链接与 ref 于是永远对不上,saveReferencedImage
找不到条目,图片字节从不落盘,且没有任何日志。

- asset_links.rs::extension_for 补 image/emf 与 image/wmf
- backend_cgo.go::extensionFor 补同样两项,并改成纯查表

去掉 mime.ExtensionsByType 是有意的:让扩展名取决于宿主的 /etc/mime.types
正是这个 bug 的成因,何况这张表本来就要和 Rust 的静态表逐字符对齐。未知
类型两边都落到 .bin,仍满足「不写出无扩展名 blob」的原意。

新增 TestEmbeddedVectorImageLinksResolve:在内存里构造一个含一张 EMF 与
一张 WMF 的最小 docx,转换后要求每一条 Markdown 图片引用都能在 resolver
建的 ImageRef 表里命中,并固定扩展名为 .emf/.wmf(避免两边一起退化成
.bin 也能通过)。

Co-authored-by: linus-liu-web <linus-liu-web@users.noreply.github.com>
2026-10-08 01:21:57 +08:00
..
anydoc fix(docparser): anydoc 内嵌 EMF/WMF 图片的扩展名与 Rust 侧对齐 (#3938) 2026-10-08 01:21:57 +08:00
anydoc_reader.go feat(docparser): upgrade AnyDoc to 0.2.4 and parse assets once 2026-09-30 15:25:01 +08:00
anydoc_reader_linked_test.go feat(docparser): upgrade AnyDoc to 0.2.4 and parse assets once 2026-09-30 15:25:01 +08:00
anydoc_reader_test.go feat(docparser): 引入 anydoc 引擎,在 Go 进程内解析 office 文档 2026-08-16 11:37:27 +08:00
anydoc_vector_image_test.go fix(docparser): anydoc 内嵌 EMF/WMF 图片的扩展名与 Rust 侧对齐 (#3938) 2026-10-08 01:21:57 +08:00
builtin_converter.go fix(docparser): preserve standalone image uploads from icon filter 2026-04-29 11:58:02 +08:00
doc.go feat(docparser): 引入 anydoc 引擎,在 Go 进程内解析 office 文档 2026-08-16 11:37:27 +08:00
engine_registry.go revert: take the plugin system back out of main 2026-09-26 14:58:18 +08:00
engine_registry_reader_test.go fix(parser): default ppt/pptx to markitdown when no engine rules (#2882) 2026-08-31 14:58:15 +08:00
engine_registry_test.go fix(parser): keep PDFs on builtin instead of defaulting to anydoc 2026-09-21 16:28:02 +08:00
engines.go feat(docparser): support MinerU 4.0 V1 API for self-hosted MinerU 2026-09-24 20:40:52 +08:00
grpc_parser.go fix(milvus): validate connections and preserve gRPC resolver defaults (#3654) 2026-10-08 00:48:45 +08:00
grpc_parser_resolver_test.go fix(milvus): validate connections and preserve gRPC resolver defaults (#3654) 2026-10-08 00:48:45 +08:00
helpers.go fix(docparser): make the MinerU parse timeouts configurable 2026-09-25 18:38:25 +08:00
html_table_normalizer.go fix(chunking): 修复内联 HTML 表格与保护模式导致的超长 chunk (#3404) 2026-09-18 21:10:17 +08:00
html_table_normalizer_test.go fix(chunking): 修复内联 HTML 表格与保护模式导致的超长 chunk (#3404) 2026-09-18 21:10:17 +08:00
http_parser.go feat(chat): open cited documents at the cited passage (#3700) 2026-09-25 13:26:16 +08:00
image_resolver.go feat(chat): open cited documents at the cited passage (#3700) 2026-09-25 13:26:16 +08:00
image_resolver_relative_html_test.go fix(docparser): address review feedback on PR #1404 2026-05-21 11:42:56 +08:00
image_resolver_test.go fix: preserve MHTML image resolution and Markdown structure (#1743) 2026-06-22 15:53:54 +08:00
json_converter.go fix(knowledge): reject invalid JSON uploads before async parse (#3360) 2026-09-25 22:23:27 +08:00
json_converter_test.go fix(knowledge): reject invalid JSON uploads before async parse (#3360) 2026-09-25 22:23:27 +08:00
markdown_image_scanner.go fix(graph): feed OCR chunks to graph extraction instead of image-link placeholders (#3092) 2026-09-08 19:23:13 +08:00
markdown_image_scanner_test.go fix(graph): feed OCR chunks to graph extraction instead of image-link placeholders (#3092) 2026-09-08 19:23:13 +08:00
mineru_cloud_converter.go fix(docparser): make the MinerU parse timeouts configurable 2026-09-25 18:38:25 +08:00
mineru_converter.go fix(docparser): make the MinerU parse timeouts configurable 2026-09-25 18:38:25 +08:00
mineru_converter_ssrf_test.go feat(docparser): support MinerU 4.0 V1 API for self-hosted MinerU 2026-09-24 20:40:52 +08:00
mineru_converter_test.go feat(docparser): support MinerU 4.0 V1 API for self-hosted MinerU 2026-09-24 20:40:52 +08:00
mineru_layout.go fix(citations): 修复原文定位、高亮范围与 DocReader 启动失败 (#3794) 2026-09-27 20:32:26 +08:00
mineru_layout_precision_test.go fix(citations): 修复原文定位、高亮范围与 DocReader 启动失败 (#3794) 2026-09-27 20:32:26 +08:00
mineru_timeout_test.go fix(docparser): make the MinerU parse timeouts configurable 2026-09-25 18:38:25 +08:00
mineru_v1_client.go feat(chat): open cited documents at the cited passage (#3700) 2026-09-25 13:26:16 +08:00
mineru_v1_client_test.go feat(docparser): support MinerU 4.0 V1 API for self-hosted MinerU 2026-09-24 20:40:52 +08:00
paddleocr_vl_cloud_converter.go feat(chat): open cited documents at the cited passage (#3700) 2026-09-25 13:26:16 +08:00
paddleocr_vl_converter.go fix(docparser): make the MinerU parse timeouts configurable 2026-09-25 18:38:25 +08:00
paddleocr_vl_converter_test.go fix(docparser): make PaddleOCR-VL request timeout configurable (#3537) 2026-09-23 11:58:59 +08:00
paddleocr_vl_layout.go feat(chat): open cited documents at the cited passage (#3700) 2026-09-25 13:26:16 +08:00
resolve_remote_html_images_test.go fix(docparser): resolve remote images referenced by HTML img tags (#2355) 2026-07-28 21:08:31 +08:00
resolve_remote_images_test.go fix: deep-copy stored files and images when cloning a knowledge base 2026-06-03 14:45:59 +08:00
source_blocks.go feat(chat): open cited documents at the cited passage (#3700) 2026-09-25 13:26:16 +08:00
source_blocks_test.go feat(chat): open cited documents at the cited passage (#3700) 2026-09-25 13:26:16 +08:00
weknoracloud_http_reader.go fix(security): harden outbound URL SSRF protection (#2626) 2026-08-10 13:24:14 +08:00