WeKnora/internal/models
wizardchen 0bb1a581de feat(agent): enhance token management and context handling in AgentEngine
- Added token usage tracking to the AgentEngine, allowing for better estimation of current context token counts.
- Implemented a new method to estimate current tokens based on previous usage and newly appended messages, improving context management.
- Updated context window management to utilize estimated token counts for more efficient message consolidation.
- Enhanced streaming methods to include token usage information, providing better insights into LLM interactions.
- Refactored the token estimator to support BPE tokenization, ensuring accurate token counts for messages.
- Added unit tests to validate new token estimation and context management functionalities.
2026-03-25 22:08:29 +08:00
..
chat feat(agent): enhance token management and context handling in AgentEngine 2026-03-25 22:08:29 +08:00
embedding fix: enforce 7500 char limit in chunker to prevent embedding API errors 2026-03-15 23:59:34 +08:00
provider feat(provider): add Novita AI as LLM provider 2026-03-24 22:10:42 +08:00
rerank feat: enhance multimodal support and image handling 2026-03-16 02:26:47 +08:00
utils refactor: Update function signatures across multiple files to improve readability by adding context parameters and enhancing code structure 2025-11-28 16:17:52 +08:00
vlm feat: implement image upload and multimodal support 2026-03-16 02:26:47 +08:00