e18c6b5bdb
Add an option to add extra metadata that is pushed and passed to Guardrails during an MCP session ( #47 )
...
* use select() before readline
* support for setting static metadata for MCP sessions
* nest extra mcp metadata in metadata object
* unify session metadata
* extra metadata tests
* use empty object as parameters, if None
* list_tools as tool call
* offset indices in tests
* test: adjust addresses
* mcp: make error reporting configurable
* line logging
* log version
* verbose logging + loud exception failure
* add server and client name to policy get
* append trace even if not pushing
* port tools/list message support to SSE
* use python -m build
* adjust guardrail failure address
* support for blocking tools/list in SSE
* use error-based failure response format by default
* tools/list test
* don't list_tools in stdio connect
* flaky test: handle second possible result in anthropic streaming case
---------
Co-authored-by: knielsen404 <kristian@invariantlabs.ai >
2025-05-19 13:44:37 +02:00
780e5f6ee7
Skip test_generate_content_with_image for gemini. Getting 500.
2025-05-16 14:33:00 +05:30
876eb44c78
Make MCP stdio gateway fully async. With sync and async mixed behaviour for running background tasks we were running into issues.
2025-05-16 14:33:00 +05:30
a6c1124076
Update test_mcp.py
2025-05-15 15:00:31 +05:30
0ffde69391
Fix test_mcp_sse_with_gateway_hybrid_guardrails so that we don't rely on order of annotations.
2025-05-15 15:00:31 +05:30
fefc22eea0
Update test_mcp.py to include the transport parameter in the hybrid guardrails test.
2025-05-14 15:32:05 +02:00
ed50670bef
Add MCP gateway tests with hybrid guardrails (both blocking and logging). Also refactor tests so that we can parameterize the transport type - stdio or sse.
2025-05-14 18:05:14 +05:30
8eae198eb0
Add integration tests for MCP SSE via gateway with guardrails.
2025-05-14 14:21:48 +05:30
e2e004b7b1
Move dockerfiles inside gateway/ and update main CLI script to be able to run build, up, down and logs on a local gateway server instance.
2025-05-14 14:21:48 +05:30
dbab86e0ac
Fix broken tests.
2025-05-09 12:17:14 +05:30
132eedab0a
Update tests_ci.yml so that the CI run fails even when unit tests fail.
2025-05-07 02:03:06 +05:30
1f6e2ed7fb
Update streaming in anthropic route to handle chunks with incomplete events. Introduce an sse_buffer which keeps track of the current incomplete event from the last processed chunk.
2025-05-07 01:08:15 +05:30
aec7808e3e
Fix broken integration tests.
2025-05-07 01:08:15 +05:30
88ba17a803
Move MCP testing stdio server and client into a separate folder.
2025-04-29 15:56:37 +05:30
dbeb4bc660
Add blocking guardrails based test for MCP gateway.
2025-04-29 09:00:04 +02:00
d877e5a1e6
Add logging guardrails based test for MCP gateway.
2025-04-29 09:00:04 +02:00
d983b7431b
Add tests for MCP integration in gateway.
2025-04-29 09:00:04 +02:00
5bf121bbda
Use pyproject.toml instead of requirements.txt and fix some broken tests.
2025-04-17 07:15:28 +02:00
e17b53b927
Extract guardrails from header if provided ( #33 )
...
* guardrails from header
* use in-file guardrails in client.py
* support case without request
* remove client script
* tests: guardrailing rule passed in header
* include checked guardrails in annotation extra metadata
* include guardrailing action
* update guardrail metadata
2025-04-03 08:56:15 +02:00
7b6d77e0a5
feat: add litellm support
2025-04-02 15:22:39 +02:00
f3a56e1e43
Add preguardrailing tests for guardrails pulled from explorer.
2025-04-02 13:40:52 +02:00
55f0f741c0
Add tests for guardrails integration with explorer.
2025-04-02 13:40:52 +02:00
eced3755b2
Refactor tests.
2025-04-02 13:40:52 +02:00
750c83d3f8
Add calls to execute logging guardrails before pushing to explorer.
2025-04-02 13:40:52 +02:00
050ec1ba58
Fetch guardrails from explorer. These have higher precedence than than the guardrails from file.
2025-04-02 13:40:52 +02:00
7c0bb957fb
Pipelined Guardrails ( #32 )
...
* initial draft: pipelined guardrails
* documentation on stream instrumentation
* more comments
* fix: return earlier
* non-streaming case
* handle non-streaming case
* fix more cases
* simplify request instrumentation
* improve comments
* fix import issues
* extend tests for input guardrailing
* anthropic integration of pipelined and pre-guardrailing
* fix gemini streamed refusal
2025-03-31 14:13:58 +02:00
4671c8b67e
Add tests for gemini guardrails integration.
2025-03-27 12:26:17 +01:00
35cb889f1a
Update guardrails test after annotations ranges filtering.
2025-03-27 12:26:17 +01:00
ad49e688f0
Add tests for Anthropic guardrails.
2025-03-21 00:56:52 +01:00
22acb38131
Add tests for the guardrails integration for open_ai route.
2025-03-18 14:46:22 +01:00
c4ecc01a59
Remove unnecessary playwright dependency for tests.
2025-03-13 10:12:55 +01:00
6558f23604
Add unit tests and move the current integration tests into a separate directory.
2025-03-12 23:57:00 +01:00
Luca Beurer-Kellner