ed50670bef
Add MCP gateway tests with hybrid guardrails (both blocking and logging). Also refactor tests so that we can parameterize the transport type - stdio or sse.
2025-05-14 18:05:14 +05:30
8eae198eb0
Add integration tests for MCP SSE via gateway with guardrails.
2025-05-14 14:21:48 +05:30
e2e004b7b1
Move dockerfiles inside gateway/ and update main CLI script to be able to run build, up, down and logs on a local gateway server instance.
2025-05-14 14:21:48 +05:30
dbab86e0ac
Fix broken tests.
2025-05-09 12:17:14 +05:30
132eedab0a
Update tests_ci.yml so that the CI run fails even when unit tests fail.
2025-05-07 02:03:06 +05:30
d057aa5c37
Add httpx as unit test dependencies.
2025-05-07 01:27:13 +05:30
1f6e2ed7fb
Update streaming in anthropic route to handle chunks with incomplete events. Introduce an sse_buffer which keeps track of the current incomplete event from the last processed chunk.
2025-05-07 01:08:15 +05:30
aec7808e3e
Fix broken integration tests.
2025-05-07 01:08:15 +05:30
dc9ac9c3c6
Fix broken unit tests.
2025-05-07 01:08:15 +05:30
88ba17a803
Move MCP testing stdio server and client into a separate folder.
2025-04-29 15:56:37 +05:30
dbeb4bc660
Add blocking guardrails based test for MCP gateway.
2025-04-29 09:00:04 +02:00
d877e5a1e6
Add logging guardrails based test for MCP gateway.
2025-04-29 09:00:04 +02:00
d983b7431b
Add tests for MCP integration in gateway.
2025-04-29 09:00:04 +02:00
5bf121bbda
Use pyproject.toml instead of requirements.txt and fix some broken tests.
2025-04-17 07:15:28 +02:00
c4dd3f3b19
Allow to specify different API keys for the guardrailing service ( #36 )
...
* minor refactor for getting invariant api keys for guardrailing
* allow different guardrailing api key
* tests
* fix comment + import
* improved unauthorized handling
2025-04-03 12:15:30 +02:00
e17b53b927
Extract guardrails from header if provided ( #33 )
...
* guardrails from header
* use in-file guardrails in client.py
* support case without request
* remove client script
* tests: guardrailing rule passed in header
* include checked guardrails in annotation extra metadata
* include guardrailing action
* update guardrail metadata
2025-04-03 08:56:15 +02:00
37005c03be
fix: add tests (and found bug)
2025-04-02 16:03:51 +02:00
7b6d77e0a5
feat: add litellm support
2025-04-02 15:22:39 +02:00
f3a56e1e43
Add preguardrailing tests for guardrails pulled from explorer.
2025-04-02 13:40:52 +02:00
55f0f741c0
Add tests for guardrails integration with explorer.
2025-04-02 13:40:52 +02:00
eced3755b2
Refactor tests.
2025-04-02 13:40:52 +02:00
750c83d3f8
Add calls to execute logging guardrails before pushing to explorer.
2025-04-02 13:40:52 +02:00
050ec1ba58
Fetch guardrails from explorer. These have higher precedence than than the guardrails from file.
2025-04-02 13:40:52 +02:00
7c0bb957fb
Pipelined Guardrails ( #32 )
...
* initial draft: pipelined guardrails
* documentation on stream instrumentation
* more comments
* fix: return earlier
* non-streaming case
* handle non-streaming case
* fix more cases
* simplify request instrumentation
* improve comments
* fix import issues
* extend tests for input guardrailing
* anthropic integration of pipelined and pre-guardrailing
* fix gemini streamed refusal
2025-03-31 14:13:58 +02:00
4671c8b67e
Add tests for gemini guardrails integration.
2025-03-27 12:26:17 +01:00
35cb889f1a
Update guardrails test after annotations ranges filtering.
2025-03-27 12:26:17 +01:00
0a9cc244c8
Add tool_result type in the coverter test for Anthropic.
2025-03-21 00:56:52 +01:00
ad49e688f0
Add tests for Anthropic guardrails.
2025-03-21 00:56:52 +01:00
3df9e73249
Add some tests for the Anthropic conversion functions. Add support for system message in Anthropic. Rename some variables.
2025-03-21 00:56:52 +01:00
22acb38131
Add tests for the guardrails integration for open_ai route.
2025-03-18 14:46:22 +01:00
c4ecc01a59
Remove unnecessary playwright dependency for tests.
2025-03-13 10:12:55 +01:00
6558f23604
Add unit tests and move the current integration tests into a separate directory.
2025-03-12 23:57:00 +01:00
c9535e0a72
Fix test_chat_completion_with_tool_call_without_streaming.
2025-03-12 21:56:19 +01:00
032d60e23e
Fix broken test test_chat_completion_with_image.
2025-03-12 21:41:28 +01:00
300130e815
Fix broken tests.
2025-03-12 19:17:13 +01:00
2fe0f55cb3
Don't block on push to explorer call for the routes.
2025-03-10 17:25:39 +01:00
20f8a12032
Formatting changes.
2025-03-10 15:18:13 +01:00
abbc80890d
Add tests with tool_calls for Gemini.
2025-03-10 15:18:13 +01:00
fdc9da16c0
Add tests for some non tool_call cases for Gemini integration.
2025-03-10 15:18:13 +01:00
7576f245bd
Add a converter module to house conversion from different LLM provider formats to Invariant API format.
2025-03-10 15:18:13 +01:00
adfabd5b12
Update the format where the user passes the invariant key in the llm provider key header. ( #18 )
2025-03-06 10:57:32 +01:00
7008f73310
Rename proxy to gateway.
2025-03-05 14:35:39 +01:00
79c934ef45
fix anthropic test
2025-02-27 10:30:33 +01:00
1795fd4a23
Rename containers
2025-02-27 10:30:13 +01:00
320c410493
Add test for OpenAI so that we verify that the Invariant API Key can be passed inside the OpenAI Key header.
2025-02-26 09:59:08 +01:00
6afbcd3ea0
Add API endpoints so that the Proxy can be used without pushing to Explorer.
2025-02-25 22:38:15 +01:00
4ed63ec4e3
add anthropic image handle
...
add anthropic image handle
2025-02-24 10:17:24 +01:00
2825b25754
change anthropic test
2025-02-21 16:47:52 +01:00
65b0693299
add anthropic image handle
2025-02-21 12:02:37 +01:00
daa7128971
Anthropic related add
...
Anthropic related add
2025-02-20 17:24:05 +01:00
Hemang