edd9fd9a5c
When tool_call is blocked in MCP Post method, add the error message to a pending error messages list. Create two queues in the MCP SSE Get endpoint which correspond to the MCP server events and these pending error messages. These two queues are merged to return events back to the client.
2025-05-09 11:05:33 +05:30
794aae0326
Add MCP guardrailing for SSE.
2025-05-08 20:40:28 +05:30
40ec6d2db2
Add MCP SSE server proxying in gateway.
2025-05-08 14:11:22 +05:30
2c34205c4c
Fix asyncio and threading. Dedupe annotations before pushing. Add README.
2025-04-17 07:15:28 +02:00
66c6dcb8f9
Add mcp.py
2025-04-17 07:15:28 +02:00
5bf121bbda
Use pyproject.toml instead of requirements.txt and fix some broken tests.
2025-04-17 07:15:28 +02:00
c4dd3f3b19
Allow to specify different API keys for the guardrailing service ( #36 )
...
* minor refactor for getting invariant api keys for guardrailing
* allow different guardrailing api key
* tests
* fix comment + import
* improved unauthorized handling
2025-04-03 12:15:30 +02:00
e17b53b927
Extract guardrails from header if provided ( #33 )
...
* guardrails from header
* use in-file guardrails in client.py
* support case without request
* remove client script
* tests: guardrailing rule passed in header
* include checked guardrails in annotation extra metadata
* include guardrailing action
* update guardrail metadata
2025-04-03 08:56:15 +02:00
37005c03be
fix: add tests (and found bug)
2025-04-02 16:03:51 +02:00
7b6d77e0a5
feat: add litellm support
2025-04-02 15:22:39 +02:00
050ec1ba58
Fetch guardrails from explorer. These have higher precedence than than the guardrails from file.
2025-04-02 13:40:52 +02:00
7c0bb957fb
Pipelined Guardrails ( #32 )
...
* initial draft: pipelined guardrails
* documentation on stream instrumentation
* more comments
* fix: return earlier
* non-streaming case
* handle non-streaming case
* fix more cases
* simplify request instrumentation
* improve comments
* fix import issues
* extend tests for input guardrailing
* anthropic integration of pipelined and pre-guardrailing
* fix gemini streamed refusal
2025-03-31 14:13:58 +02:00
e55df73487
Add guardrails for gemini integration.
2025-03-27 12:26:17 +01:00
a5ea86a64e
Show logs if the docker container doesn't start on doing up(). Tested when the guardrails file contained unparseable policy.
2025-03-17 07:45:45 +01:00
e773cc9f2d
Add Guardrails verification logic for openai route.
2025-03-17 07:45:45 +01:00
e40ea3e2a9
instructions + port configuration option
2025-03-11 17:38:41 +01:00
20f8a12032
Formatting changes.
2025-03-10 15:18:13 +01:00
e107be4fea
Add push to explorer support for Gemini for non streaming.
2025-03-10 15:18:13 +01:00
7008f73310
Rename proxy to gateway.
2025-03-05 14:35:39 +01:00
Hemang