WeKnora/internal/infrastructure/web_search
lyingbug 647848f395
fix(agent): improve web search and persistent page reading (#3086)
* fix(agent): improve web search and persistent page reading

* fix(agent): make web fetch snapshots waitable and retryable

Keep in-flight page fetches independent of a caller's short deadline so
content=true and continuations cannot cancel a shared download or miss a
snapshot that is still loading. Mark snapshot_expired as retryable, fetch
only the first three search hits in parallel, and stop forcing Brave's
country to US.
2026-09-07 23:09:27 +08:00
..
baidu.go fix(security): harden outbound URL SSRF protection (#2626) 2026-08-10 13:24:14 +08:00
bing.go feat: search engine adds proxy addresses and adds SSRF verification. 2026-04-17 16:38:02 +08:00
bocha.go feat(web-search): add Bocha AI Search provider (#3036) 2026-09-07 20:06:26 +08:00
bocha_test.go feat(web-search): add Bocha AI Search provider (#3036) 2026-09-07 20:06:26 +08:00
brave.go fix(agent): improve web search and persistent page reading (#3086) 2026-09-07 23:09:27 +08:00
brave_test.go fix(agent): improve web search and persistent page reading (#3086) 2026-09-07 23:09:27 +08:00
duckduckgo.go feat: search engine adds proxy addresses and adds SSRF verification. 2026-04-17 16:38:02 +08:00
exa.go feat: add Exa WebSearch (#2617) 2026-08-11 17:05:52 +08:00
exa_test.go feat: add Exa WebSearch (#2617) 2026-08-11 17:05:52 +08:00
google.go feat: search engine adds proxy addresses and adds SSRF verification. 2026-04-17 16:38:02 +08:00
keenable.go fix(web-search): polish Keenable provider integration after #1946 2026-07-07 17:14:39 +08:00
keenable_test.go fix(web-search): polish Keenable provider integration after #1946 2026-07-07 17:14:39 +08:00
metaso.go feat: add Metaso web search provider 2026-08-10 13:33:55 +08:00
metaso_test.go feat: add Metaso web search provider 2026-08-10 13:33:55 +08:00
ollama.go fix(security): harden outbound URL SSRF protection (#2626) 2026-08-10 13:24:14 +08:00
proxy.go fix(security): harden outbound URL SSRF protection (#2626) 2026-08-10 13:24:14 +08:00
proxy_test.go fix(security): harden outbound URL SSRF protection (#2626) 2026-08-10 13:24:14 +08:00
registry.go feat(web-search): refactor web search provider 2026-03-31 20:22:34 +08:00
searxng.go fix(web-search): improve SearXNG test connection error messages 2026-06-24 14:28:49 +08:00
searxng_test.go fix(web-search): improve SearXNG test connection error messages 2026-06-24 14:28:49 +08:00
tavily.go feat: search engine adds proxy addresses and adds SSRF verification. 2026-04-17 16:38:02 +08:00
test_errors.go feat: add Exa WebSearch (#2617) 2026-08-11 17:05:52 +08:00
test_errors_test.go feat: add Exa WebSearch (#2617) 2026-08-11 17:05:52 +08:00
zhipu.go feat(web-search): add Zhipu AI web search provider support 2026-07-20 12:15:35 +08:00
zhipu_test.go feat(web-search): add Zhipu AI web search provider support 2026-07-20 12:15:35 +08:00