WeKnora/internal/infrastructure/web_fetch
lyingbug 647848f395
fix(agent): improve web search and persistent page reading (#3086)
* fix(agent): improve web search and persistent page reading

* fix(agent): make web fetch snapshots waitable and retryable

Keep in-flight page fetches independent of a caller's short deadline so
content=true and continuations cannot cancel a shared download or miss a
snapshot that is still loading. Mark snapshot_expired as retryable, fetch
only the first three search hits in parallel, and stop forcing Brave's
country to US.
2026-09-07 23:09:27 +08:00
..
testdata/extraction fix(agent): improve web search and persistent page reading (#3086) 2026-09-07 23:09:27 +08:00
fetcher.go fix(agent): improve web search and persistent page reading (#3086) 2026-09-07 23:09:27 +08:00
fetcher_ssrf_test.go fix(security): harden web_fetch and datasource connector SSRF paths 2026-07-02 12:27:48 +08:00
fetcher_test.go fix(web_fetch): address review follow-ups for structured fetch results 2026-07-28 22:17:31 +08:00
markdown.go fix(agent): improve web search and persistent page reading (#3086) 2026-09-07 23:09:27 +08:00
markdown_test.go fix(agent): improve web search and persistent page reading (#3086) 2026-09-07 23:09:27 +08:00