WeKnora/frontend
wizardchen 3d645d2578 fix(datasource/ima): retry transient sync failures instead of losing documents
The sync cursor was built from the raw IMA listing before any content was
fetched, so an item whose get_media_info or download failed was still recorded
as "seen with this media_id". Every later incremental sync then skipped it as
unchanged and the document was silently missing from the knowledge base for
good. Track the listed keys and the successfully synced keys separately: the
cursor now only remembers what was actually resolved, while delete detection
keeps using the full listing so a failed download is never mistaken for a
document that vanished. Deterministic skips (unsupported media types, items
with no URL) are still recorded so they are not re-probed every cycle.

Alongside that:

- Drop media_type from logicalKey. get_knowledge_list omits the field, so
  folding it in meant every external_id would shift the day IMA starts
  populating it, which reads downstream as "every document deleted".
- Download URL-backed media that carry auth headers rather than handing the
  bare URL to the ingest layer, which cannot replay those headers.
- Derive image extensions from the response Content-Type; IMA reports every
  image as media_type=9, so a JPEG was being written as .png.
- Stop logging API response bodies, which carry pre-signed storage URLs and
  per-request auth headers.
- Validate media URLs against the SSRF policy before the first connection.
- Stop writing the redundant kb_media map into the persisted cursor.
- Say in the connector description that notes and AI sessions are skipped.
2026-08-12 14:56:25 +08:00
..
packages chore: Update Dockerfile and package-lock.json for xlsx package management 2025-11-17 13:15:10 +08:00
public fix(i18n): harden DEFAULT_LOCALE runtime config after #2658 2026-08-12 10:53:23 +08:00
src fix(datasource/ima): retry transient sync failures instead of losing documents 2026-08-12 14:56:25 +08:00
.dockerignore feat(docker): streamline frontend build process and update Docker configuration 2026-06-10 16:04:11 +08:00
.gitignore init commit 2025-08-05 15:08:07 +08:00
Dockerfile fix(frontend): pin nginx base image by digest for old-host compatibility 2026-07-20 19:41:17 +08:00
docker-entrypoint.sh fix(i18n): harden DEFAULT_LOCALE runtime config after #2658 2026-08-12 10:53:23 +08:00
embed.html feat(embed): add widget, visitor chat, and management UI (#1657) 2026-06-12 23:10:39 +08:00
env.d.ts feat(frontend): inject commit ID into frontend build for version tracking 2026-06-09 18:08:57 +08:00
index.html fix(frontend): bundle tdesign-icons sprite locally for offline deploys 2026-04-23 18:21:49 +08:00
nginx.conf fix(im): render resource:// images in IM channels (nginx /r/ + config guards) 2026-07-28 21:25:12 +08:00
package-lock.json chore(release): prepare v0.7.1 2026-07-24 16:53:25 +08:00
package.json docs(release): prepare v0.7.2 release notes and version bump 2026-08-07 11:37:05 +08:00
package.json.md5 fix: update environment configuration for debugging and logging, enhance SQLite FTS5 table management, and improve API base URL handling 2026-04-11 18:51:16 +08:00
pnpm-workspace.yaml fix(frontend): configure pnpm v11 build approvals in workspace file 2026-05-08 16:34:33 +08:00
tsconfig.app.json fix lint and test failures 2026-07-01 17:31:42 +08:00
tsconfig.json init commit 2025-08-05 15:08:07 +08:00
tsconfig.node.json init commit 2025-08-05 15:08:07 +08:00
vite.config.ts fix(frontend): keep custom theme tokens in production builds 2026-07-21 20:29:02 +08:00