c1112b91fc
use windows select ( #56 )
...
* use windows select
* factor out platform-specific stdin waiting
2025-05-21 09:43:00 +02:00
e18c6b5bdb
Add an option to add extra metadata that is pushed and passed to Guardrails during an MCP session ( #47 )
...
* use select() before readline
* support for setting static metadata for MCP sessions
* nest extra mcp metadata in metadata object
* unify session metadata
* extra metadata tests
* use empty object as parameters, if None
* list_tools as tool call
* offset indices in tests
* test: adjust addresses
* mcp: make error reporting configurable
* line logging
* log version
* verbose logging + loud exception failure
* add server and client name to policy get
* append trace even if not pushing
* port tools/list message support to SSE
* use python -m build
* adjust guardrail failure address
* support for blocking tools/list in SSE
* use error-based failure response format by default
* tools/list test
* don't list_tools in stdio connect
* flaky test: handle second possible result in anthropic streaming case
---------
Co-authored-by: knielsen404 <kristian@invariantlabs.ai >
2025-05-19 13:44:37 +02:00
4dbb400620
Move invariant api key check to __main__.py so that the same check can work for both mcp and server commands.
2025-05-16 14:33:00 +05:30
f33b2392f6
Fix the Dockerfle for gateway to copy correctly.
2025-05-16 14:33:00 +05:30
876eb44c78
Make MCP stdio gateway fully async. With sync and async mixed behaviour for running background tasks we were running into issues.
2025-05-16 14:33:00 +05:30
a214837b1e
Add message to session store for MCP sse in post path before returning.
2025-05-14 15:44:52 +02:00
e32ec74ed2
Fix paths to pyproject.toml and README in dockerfile.gateway. Also update context in publish-images.yml
2025-05-14 18:05:14 +05:30
e2e004b7b1
Move dockerfiles inside gateway/ and update main CLI script to be able to run build, up, down and logs on a local gateway server instance.
2025-05-14 14:21:48 +05:30
edd9fd9a5c
When tool_call is blocked in MCP Post method, add the error message to a pending error messages list. Create two queues in the MCP SSE Get endpoint which correspond to the MCP server events and these pending error messages. These two queues are merged to return events back to the client.
2025-05-09 11:05:33 +05:30
794aae0326
Add MCP guardrailing for SSE.
2025-05-08 20:40:28 +05:30
40ec6d2db2
Add MCP SSE server proxying in gateway.
2025-05-08 14:11:22 +05:30
1f6e2ed7fb
Update streaming in anthropic route to handle chunks with incomplete events. Introduce an sse_buffer which keeps track of the current incomplete event from the last processed chunk.
2025-05-07 01:08:15 +05:30
aec7808e3e
Fix broken integration tests.
2025-05-07 01:08:15 +05:30
86ec75ba2d
use select() before readline ( #45 )
2025-05-06 16:07:50 +02:00
52f5359d36
Add MCP client and server names in trace metadata for Explorer.
2025-04-24 15:48:36 +02:00
7287065940
Improve on request reads from byte by byte to line by line.
2025-04-24 15:48:36 +02:00
55874d552e
feat: append_and_push_trace uses configurable API URL
2025-04-23 13:08:57 +01:00
ed63a4b592
fix typo ( #42 )
2025-04-23 09:28:45 +01:00
20d1e0afd4
fix: print breaks claude
2025-04-17 14:59:59 +02:00
2b9785de11
Update README.md
2025-04-17 10:05:28 +02:00
45d384b7a3
Update README for mcp.
2025-04-17 09:54:26 +02:00
e8deb8feda
Rename dataset-name flag for MCP to project-name and change CLI command to run mcp
2025-04-17 07:15:28 +02:00
2c34205c4c
Fix asyncio and threading. Dedupe annotations before pushing. Add README.
2025-04-17 07:15:28 +02:00
66c6dcb8f9
Add mcp.py
2025-04-17 07:15:28 +02:00
15210997a7
Add the invariant-gateway CLI script.
2025-04-17 07:15:28 +02:00
5bf121bbda
Use pyproject.toml instead of requirements.txt and fix some broken tests.
2025-04-17 07:15:28 +02:00
6b6f33bde6
fix: don't hardcode preview
2025-04-04 10:38:14 +02:00
c4dd3f3b19
Allow to specify different API keys for the guardrailing service ( #36 )
...
* minor refactor for getting invariant api keys for guardrailing
* allow different guardrailing api key
* tests
* fix comment + import
* improved unauthorized handling
2025-04-03 12:15:30 +02:00
e17b53b927
Extract guardrails from header if provided ( #33 )
...
* guardrails from header
* use in-file guardrails in client.py
* support case without request
* remove client script
* tests: guardrailing rule passed in header
* include checked guardrails in annotation extra metadata
* include guardrailing action
* update guardrail metadata
2025-04-03 08:56:15 +02:00
760b739894
Correct user API GET call to fetch policies.
2025-04-03 00:02:19 +02:00
6d3366b91b
Add OPTIONS preflight support for routes.
2025-04-02 22:42:22 +02:00
37005c03be
fix: add tests (and found bug)
2025-04-02 16:03:51 +02:00
7b6d77e0a5
feat: add litellm support
2025-04-02 15:22:39 +02:00
f3a56e1e43
Add preguardrailing tests for guardrails pulled from explorer.
2025-04-02 13:40:52 +02:00
55f0f741c0
Add tests for guardrails integration with explorer.
2025-04-02 13:40:52 +02:00
9aef873a74
Correct header name before calling explorer to fetch guardrails.
2025-04-02 13:40:52 +02:00
750c83d3f8
Add calls to execute logging guardrails before pushing to explorer.
2025-04-02 13:40:52 +02:00
050ec1ba58
Fetch guardrails from explorer. These have higher precedence than than the guardrails from file.
2025-04-02 13:40:52 +02:00
f45a973f51
Small formatting changes.
2025-04-02 13:40:52 +02:00
7c0bb957fb
Pipelined Guardrails ( #32 )
...
* initial draft: pipelined guardrails
* documentation on stream instrumentation
* more comments
* fix: return earlier
* non-streaming case
* handle non-streaming case
* fix more cases
* simplify request instrumentation
* improve comments
* fix import issues
* extend tests for input guardrailing
* anthropic integration of pipelined and pre-guardrailing
* fix gemini streamed refusal
2025-03-31 14:13:58 +02:00
e55df73487
Add guardrails for gemini integration.
2025-03-27 12:26:17 +01:00
8191c83c12
Revert "Add debug logs for metadata push."
...
This reverts commit f247682fa3
2025-03-26 19:57:00 +01:00
f247682fa3
Add debug logs for metadata push.
2025-03-26 15:20:26 +01:00
c9cdbd7eb5
Update metadata for gemini streaming case.
2025-03-25 11:49:07 +01:00
3df9e73249
Add some tests for the Anthropic conversion functions. Add support for system message in Anthropic. Rename some variables.
2025-03-21 00:56:52 +01:00
4a9930c30d
Add guardrails checks for Anthropic.
2025-03-21 00:56:52 +01:00
781c6224d9
Anthropic with stream=False complains about content-length not matching with the response size.
2025-03-20 10:59:27 +01:00
a4ee5f0c47
Add metadata before pushing to Explorer.
2025-03-20 10:59:27 +01:00
ab3169938d
Add preload guardrails api call for anthropic and gemini.
2025-03-19 09:51:56 +01:00
44988c3535
Add a preload guardrails API call.
2025-03-19 09:39:23 +01:00
Luca Beurer-Kellner