Local AI Broker
The Local AI Broker is a loopback-only HTTP proxy that speaks the OpenAI and Anthropic wire formats. Point your AI tool at it, and every request is scanned and redacted on your machine before it is forwarded to the real provider — so secrets and PII are stripped in transit, not just in the editor.
Runs locally in your editor. Secret, PII, prompt-injection, and MCP scanning happen on your machine before anything reaches an AI model.
Drop-in base URLs for chat completions and messages. Copy the broker URL and paste it into any tool that supports a custom endpoint.
The broker binds to localhost on a configurable port (default 47321). It is not exposed to your network.
Requests pass through the same detectors as the editor scans: secrets, PII, and prompt-injection signatures are redacted before forwarding.
Broker tokens are stored locally and can be rotated or cleared on demand. Upstream provider URLs are configured locally.
A built-in “Test Broker Protection” command lets you confirm redaction is working with a fake canary before you trust it.
Start the broker
Launch it from the command palette. It runs on loopback only and reports its status in the SoterAI panel.
Point your tool at the broker URL
Copy the OpenAI- or Anthropic-compatible URL and set it as the base URL / endpoint in your AI client.
Send prompts as usual
Requests are scanned and redacted locally, then forwarded to your configured upstream provider.
Verify with a canary
Run Test Broker Protection to confirm a planted fake secret is stripped before the upstream call.
No security tool is perfect. Here is what this feature does not claim to do, so you can layer defenses appropriately.
No. The broker scans and redacts on your machine first, then forwards the redacted request to the upstream provider you configured.
Any client that lets you set a custom OpenAI- or Anthropic-compatible base URL. You paste the loopback broker URL as the endpoint.
It binds to localhost on a configurable port (default 47321) and is never exposed beyond loopback.
Install SoterAI IDE Guard and scan secrets, prompts, MCP tools, and terminal commands locally before they ever reach an AI model.
Install for VS Code