WeKnora/internal/im
Captain 171097f06e
feat(security): add a whitelist-only outbound mode that refuses before DNS (#3393)
* feat(security): add a whitelist-only outbound mode that refuses before DNS

A penetration test of a private deployment found that a host outside
SSRF_WHITELIST still produces a DNS query: every outbound guard resolves
the name first and judges the addresses afterwards, which is what makes
it immune to DNS rebinding, but it also means an attacker-chosen name
reaches the resolver and can carry data out of an otherwise offline
network (#3378).

SSRF_DNS_WHITELIST_ONLY makes the whitelist the whole egress policy, and
the check is placed wherever a name is still in hand.

Where a URL is available, CheckSSRFWhitelistOnly refuses a host the
whitelist does not name, IP literals included: URL validation, the
sandbox outbound policy, and the web-fetch target resolver.

Where only a dial address is available, CheckDialWhitelistOnly judges
hostnames and leaves addresses to the checks that already exist, because
an IP arriving at a dialer is either a name something else resolved or a
literal the URL layer already refused. That covers the shared SSRF-safe
dialer, the web-fetch dialer, the Yunzhijia webhook dialer, and every
sandbox transport: the HTTP and websocket data planes, the guarded
transport and the Docker engine now share one GuardedDialContext instead
of each building its own dialer.

Where the client resolves its own target, the name is judged before the
client exists. gRPC's resolver runs before any dialer it was given, so
the env-configured qdrant and milvus clients are built through small
constructors that refuse a non-whitelisted host outright; a whitelisted
one is resolved by gRPC as before.

docreader enforces the same switch in its own validator, and compose
passes the variable to both services.

Matching is by name only in this mode: the whitelist's CIDR entries
still match an IP literal, but a hostname is no longer resolved to see
whether its addresses fall inside one, because that lookup is the query
the mode exists to prevent.

The value is parsed with ParseBool, and a non-empty value that parses as
neither enables the mode: silently leaving an egress lockdown off
because an operator wrote "yes" is the one failure mode a security
control must not have.

Still not covered, and documented as such: the Langfuse OTLP exporter
builds its own client and never reaches these guards; and with
HTTP(S)_PROXY set the proxy host is dialled unguarded when the dial
address equals the proxy URL's host exactly, while a mismatch makes the
proxy host itself subject to the whitelist.

The switch defaults to off, so nothing changes for deployments that do
not set it.

* docs(security): document SSRF_DNS_WHITELIST_ONLY in website-docs

docs/ has been retired in favour of website-docs/ (#3580), so the notes that
lived in docs/QA.md move to the configuration table: the new switch, what to
whitelist before turning it on, and the three outbound paths it still does
not cover.

The existing SSRF_WHITELIST row was also stale: compose gives only the app its
SSRF_WHITELIST_EXTRA default (which now includes minio), and docreader's is
empty, so "shared by app and docreader" held for SSRF_WHITELIST alone.
2026-09-23 12:02:06 +08:00
..
dingtalk fix: align client sessions and integration request handling (#3305) 2026-09-16 16:20:57 +08:00
feishu fix: align client sessions and integration request handling (#3305) 2026-09-16 16:20:57 +08:00
mattermost fix: align client sessions and integration request handling (#3305) 2026-09-16 16:20:57 +08:00
qqbot fix: align client sessions and integration request handling (#3305) 2026-09-16 16:20:57 +08:00
slack fix: align client sessions and integration request handling (#3305) 2026-09-16 16:20:57 +08:00
telegram fix: align client sessions and integration request handling (#3305) 2026-09-16 16:20:57 +08:00
wechat refactor: remove unused private Go helpers 2026-09-17 15:51:51 +08:00
wecom fix(im): handle WeCom 32-byte PKCS7 padding (#2848) 2026-08-28 15:40:42 +08:00
yunzhijia feat(security): add a whitelist-only outbound mode that refuses before DNS (#3393) 2026-09-23 12:02:06 +08:00
adapter.go fix(im/feishu): show progress card in full output mode (#2909) 2026-09-01 13:09:11 +08:00
callback_validation_test.go fix: align client sessions and integration request handling (#3305) 2026-09-16 16:20:57 +08:00
channel_agent_name_test.go fix(i18n): 修复内置智能体名称与描述不随界面语言切换的问题 (#2828) 2026-08-27 11:53:45 +08:00
channel_kb_scope_test.go fix(security): close the low-severity shared-space findings (#3416) 2026-09-18 22:58:46 +08:00
channel_mapping_test.go feat(im,datasource): support Lark, Feishu's international edition 2026-07-17 11:05:54 +08:00
channel_security.go fix: align client sessions and integration request handling (#3305) 2026-09-16 16:20:57 +08:00
channel_security_test.go fix: align client sessions and integration request handling (#3305) 2026-09-16 16:20:57 +08:00
cmd_clear.go feat(im): add slash-command system with /help, /info, /search, /stop, /clear 2026-03-20 15:49:59 +08:00
cmd_help.go feat(im): add slash-command system with /help, /info, /search, /stop, /clear 2026-03-20 15:49:59 +08:00
cmd_info.go feat(im): add slash-command system with /help, /info, /search, /stop, /clear 2026-03-20 15:49:59 +08:00
cmd_search.go fix(search): apply tag filters to knowledge search 2026-07-06 23:30:33 +08:00
cmd_stop.go feat(im): add slash-command system with /help, /info, /search, /stop, /clear 2026-03-20 15:49:59 +08:00
command.go feat(im): add slash-command system with /help, /info, /search, /stop, /clear 2026-03-20 15:49:59 +08:00
command_registry.go feat(im): add slash-command system with /help, /info, /search, /stop, /clear 2026-03-20 15:49:59 +08:00
content_rewrite_test.go fix: align client sessions and integration request handling (#3305) 2026-09-16 16:20:57 +08:00
credentials.go refactor(im): move adapter factories into per-platform subpackages 2026-04-29 20:08:22 +08:00
file_message_test.go fix(im): tighten DingTalk rich-text follow-up handling 2026-08-24 14:51:04 +08:00
full_output_test.go fix(feishu): preserve active streams during long-running QA 2026-09-14 22:19:53 +08:00
identity_test.go feat(im): add per-channel reply locale (#3455) 2026-09-23 12:01:01 +08:00
im_config_warning_test.go fix(im): render resource:// images in IM channels (nginx /r/ + config guards) 2026-07-28 21:25:12 +08:00
im_file_service_test.go refactor(storage): extract storage reference URL rewriting into internal/storageurl 2026-08-05 14:42:51 +08:00
mode.go refactor(im): move adapter factories into per-platform subpackages 2026-04-29 20:08:22 +08:00
oauth_notice_test.go feat(im): include per-service MCP OAuth URLs in IM auth notices 2026-07-01 17:53:54 +08:00
qa_exit_test.go fix(im): finalize replies after agent QA returns (#3261) 2026-09-15 17:37:40 +08:00
qaqueue.go feat: add unit tests for COS object name parsing and enhance error handling 2026-05-29 13:47:32 +08:00
service.go feat(im): add per-channel reply locale (#3455) 2026-09-23 12:01:01 +08:00
service_agent_test.go fix(integrations): polish agent filter UX and embed session rebind 2026-06-24 20:09:19 +08:00
service_lifecycle_test.go feat(im): add per-channel reply locale (#3455) 2026-09-23 12:01:01 +08:00
service_quote_test.go fix(im): anti-hallucination for non-text quotes and unprocessable media messages 2026-04-03 11:34:22 +08:00
session_not_found_test.go fix(im): recover from deleted session when GetSession returns app sentinel (#1499) 2026-05-27 11:51:11 +08:00
session_test.go fix(im): tighten DingTalk rich-text follow-up handling 2026-08-24 14:51:04 +08:00
session_title_test.go feat(im): IM session improvements — titles, in-flight recovery, classification 2026-06-12 17:01:28 +08:00
stream_delivery_test.go fix(feishu): preserve active streams during long-running QA 2026-09-14 22:19:53 +08:00
stream_display_test.go feat(memory): add cross-session long-term memory 2026-08-13 18:00:02 +08:00
stream_exit_test.go fix(im): preserve errors emitted after agent completion 2026-09-15 17:56:54 +08:00
stream_lifecycle_test.go fix(im): address stream display review feedback 2026-06-24 10:33:55 +08:00
stream_section.go fix(im): address stream display review feedback 2026-06-24 10:33:55 +08:00
stream_test.go feat(memory): add cross-session long-term memory 2026-08-13 18:00:02 +08:00
supervisor.go fix(im): prevent DingTalk stream connection from going stale 2026-06-22 15:04:23 +08:00
think.go feat(im,datasource): support Lark, Feishu's international edition 2026-07-17 11:05:54 +08:00
think_test.go feat(memory): add cross-session long-term memory 2026-08-13 18:00:02 +08:00
tool_display.go refactor(agent): consolidate knowledge retrieval tools into search_knowledge, read_document, list_documents (#3381) 2026-09-18 14:12:22 +08:00
tool_display_test.go feat(agent): stream live +/- progress for sandbox write and edit 2026-09-02 23:36:58 +08:00
types.go feat(im): add per-channel reply locale (#3455) 2026-09-23 12:01:01 +08:00
types_summary_test.go feat(im): add per-channel reply locale (#3455) 2026-09-23 12:01:01 +08:00
types_test.go feat(im): add per-channel reply locale (#3455) 2026-09-23 12:01:01 +08:00