14 Commits

Author SHA1 Message Date
Luca Beurer-Kellner fd9f65aabd wip: mcp integratio 2025-04-07 10:38:34 +02:00
Luca Beurer-Kellner c4dd3f3b19 Allow to specify different API keys for the guardrailing service (#36)
* minor refactor for getting invariant api keys for guardrailing

* allow different guardrailing api key

* tests

* fix comment + import

* improved unauthorized handling
2025-04-03 12:15:30 +02:00
Luca Beurer-Kellner e17b53b927 Extract guardrails from header if provided (#33)
* guardrails from header

* use in-file guardrails in client.py

* support case without request

* remove client script

* tests: guardrailing rule passed in header

* include checked guardrails in annotation extra metadata

* include guardrailing action

* update guardrail metadata
2025-04-03 08:56:15 +02:00
Marco Milanta 37005c03be fix: add tests (and found bug) 2025-04-02 16:03:51 +02:00
Marco Milanta 7b6d77e0a5 feat: add litellm support 2025-04-02 15:22:39 +02:00
Hemang 050ec1ba58 Fetch guardrails from explorer. These have higher precedence than than the guardrails from file. 2025-04-02 13:40:52 +02:00
Luca Beurer-Kellner 7c0bb957fb Pipelined Guardrails (#32)
* initial draft: pipelined guardrails

* documentation on stream instrumentation

* more comments

* fix: return earlier

* non-streaming case

* handle non-streaming case

* fix more cases

* simplify request instrumentation

* improve comments

* fix import issues

* extend tests for input guardrailing

* anthropic integration of pipelined and pre-guardrailing

* fix gemini streamed refusal
2025-03-31 14:13:58 +02:00
Hemang e55df73487 Add guardrails for gemini integration. 2025-03-27 12:26:17 +01:00
Hemang a5ea86a64e Show logs if the docker container doesn't start on doing up(). Tested when the guardrails file contained unparseable policy. 2025-03-17 07:45:45 +01:00
Hemang e773cc9f2d Add Guardrails verification logic for openai route. 2025-03-17 07:45:45 +01:00
Luca Beurer-Kellner e40ea3e2a9 instructions + port configuration option 2025-03-11 17:38:41 +01:00
Hemang 20f8a12032 Formatting changes. 2025-03-10 15:18:13 +01:00
Hemang e107be4fea Add push to explorer support for Gemini for non streaming. 2025-03-10 15:18:13 +01:00
Hemang 7008f73310 Rename proxy to gateway. 2025-03-05 14:35:39 +01:00