WeKnora/internal/models
wizardchen 6fb858105a feat(llm): add prompt-cache observability and wiki cache-friendly prompts
Normalize provider-specific cache counters into TokenUsage, propagate call
purpose and prefix fingerprints through context for logging and Langfuse,
and restructure wiki page-modify prompts with warmup/singleflight to improve
prefix cache hit rates during reduce batches.
2026-07-23 19:17:30 +08:00
..
asr fix(security): harden model client redirects 2026-07-02 19:15:46 +08:00
chat feat(llm): add prompt-cache observability and wiki cache-friendly prompts 2026-07-23 19:17:30 +08:00
embedding refactor(http): share SSRF-safe transport across model clients 2026-07-23 12:00:05 +08:00
limiter feat(system): expose model concurrency stats on runtime queues dashboard 2026-07-11 07:17:28 +08:00
provider fix(rerank): batch Volcengine rerank requests over API document limit 2026-07-20 20:07:21 +08:00
rerank refactor(http): share SSRF-safe transport across model clients 2026-07-23 12:00:05 +08:00
utils feat: integrate ChatBot provider and docreader 2026-04-13 17:47:24 +08:00
vlm feat(system): expose model concurrency stats on runtime queues dashboard 2026-07-11 07:17:28 +08:00