- Added token usage tracking to the AgentEngine, allowing for better estimation of current context token counts. - Implemented a new method to estimate current tokens based on previous usage and newly appended messages, improving context management. - Updated context window management to utilize estimated token counts for more efficient message consolidation. - Enhanced streaming methods to include token usage information, providing better insights into LLM interactions. - Refactored the token estimator to support BPE tokenization, ensuring accurate token counts for messages. - Added unit tests to validate new token estimation and context management functionalities. |
||
|---|---|---|
| .. | ||
| chat.go | ||
| chat_provider_spec.go | ||
| image_resolve.go | ||
| json_field_extractor.go | ||
| json_field_extractor_test.go | ||
| ollama.go | ||
| remote_api.go | ||
| remote_api_test.go | ||
| sse_reader.go | ||