Commit Graph

238 Commits

Author SHA1 Message Date
Hemang eced3755b2 Refactor tests. 2025-04-02 13:40:52 +02:00
Hemang 750c83d3f8 Add calls to execute logging guardrails before pushing to explorer. 2025-04-02 13:40:52 +02:00
Hemang 050ec1ba58 Fetch guardrails from explorer. These have higher precedence than than the guardrails from file. 2025-04-02 13:40:52 +02:00
Hemang f45a973f51 Small formatting changes. 2025-04-02 13:40:52 +02:00
Luca Beurer-Kellner 7c0bb957fb Pipelined Guardrails (#32)
* initial draft: pipelined guardrails

* documentation on stream instrumentation

* more comments

* fix: return earlier

* non-streaming case

* handle non-streaming case

* fix more cases

* simplify request instrumentation

* improve comments

* fix import issues

* extend tests for input guardrailing

* anthropic integration of pipelined and pre-guardrailing

* fix gemini streamed refusal
2025-03-31 14:13:58 +02:00
Hemang 4671c8b67e Add tests for gemini guardrails integration. 2025-03-27 12:26:17 +01:00
Hemang 35cb889f1a Update guardrails test after annotations ranges filtering. 2025-03-27 12:26:17 +01:00
Hemang e55df73487 Add guardrails for gemini integration. 2025-03-27 12:26:17 +01:00
Hemang 8191c83c12 Revert "Add debug logs for metadata push."
This reverts commit f247682fa3.
2025-03-26 19:57:00 +01:00
Hemang f247682fa3 Add debug logs for metadata push. 2025-03-26 15:20:26 +01:00
Hemang c9cdbd7eb5 Update metadata for gemini streaming case. 2025-03-25 11:49:07 +01:00
Hemang 0a9cc244c8 Add tool_result type in the coverter test for Anthropic. 2025-03-21 00:56:52 +01:00
Hemang ad49e688f0 Add tests for Anthropic guardrails. 2025-03-21 00:56:52 +01:00
Hemang 3df9e73249 Add some tests for the Anthropic conversion functions. Add support for system message in Anthropic. Rename some variables. 2025-03-21 00:56:52 +01:00
Hemang 4a9930c30d Add guardrails checks for Anthropic. 2025-03-21 00:56:52 +01:00
Hemang 781c6224d9 Anthropic with stream=False complains about content-length not matching with the response size. 2025-03-20 10:59:27 +01:00
Hemang a4ee5f0c47 Add metadata before pushing to Explorer. 2025-03-20 10:59:27 +01:00
Hemang ab3169938d Add preload guardrails api call for anthropic and gemini. 2025-03-19 09:51:56 +01:00
Hemang 44988c3535 Add a preload guardrails API call. 2025-03-19 09:39:23 +01:00
Hemang 22acb38131 Add tests for the guardrails integration for open_ai route. 2025-03-18 14:46:22 +01:00
Hemang 5dc9485831 Remove tool_calls modification before calling guardrails service. 2025-03-18 14:46:22 +01:00
Hemang 66973dbf30 Handle streaming with openai for guardrails. Only check guardrails on the last stream chunk. 2025-03-17 15:09:14 +01:00
Hemang ca3c43ef76 Refactor guardrails check for openai route. 2025-03-17 07:45:45 +01:00
Hemang a5ea86a64e Show logs if the docker container doesn't start on doing up(). Tested when the guardrails file contained unparseable policy. 2025-03-17 07:45:45 +01:00
Hemang e773cc9f2d Add Guardrails verification logic for openai route. 2025-03-17 07:45:45 +01:00
Hemang 5e452af1ae Remove extra /api/v1/user/signup POST call in integration tests. 2025-03-13 10:42:36 +01:00
Hemang c4ecc01a59 Remove unnecessary playwright dependency for tests. 2025-03-13 10:12:55 +01:00
Luca Beurer-Kellner 31b4e9bba7 Update README.md 2025-03-13 09:21:17 +01:00
Luca Beurer-Kellner 545ab05b19 Update README.md 2025-03-13 09:20:57 +01:00
Hemang fd4c64256f Add env variable for docker compose down command in run.sh down() 2025-03-12 23:58:28 +01:00
Hemang 6558f23604 Add unit tests and move the current integration tests into a separate directory. 2025-03-12 23:57:00 +01:00
Hemang Sarkar d49acd9001 Merge pull request #21 from invariantlabs-ai/ghcr
Publish GitHub Container Images + Self-Hosted Setup Instructions
2025-03-12 22:04:30 +01:00
Hemang c9535e0a72 Fix test_chat_completion_with_tool_call_without_streaming. 2025-03-12 21:56:19 +01:00
Hemang 032d60e23e Fix broken test test_chat_completion_with_image. 2025-03-12 21:41:28 +01:00
Luca Beurer-Kellner 0a43da3b1c Merge branch 'main' into ghcr 2025-03-12 19:36:30 +01:00
Hemang 300130e815 Fix broken tests. 2025-03-12 19:17:13 +01:00
Luca Beurer-Kellner c5d9f075a4 update image names 2025-03-11 17:51:50 +01:00
Luca Beurer-Kellner ee013de105 fig tags in CI 2025-03-11 17:48:29 +01:00
Luca Beurer-Kellner 8709ff4bd8 enable CI 2025-03-11 17:47:53 +01:00
Luca Beurer-Kellner d47cfef51c root redirect 2025-03-11 17:44:35 +01:00
Luca Beurer-Kellner 9205538f60 update readme 2025-03-11 17:43:20 +01:00
Luca Beurer-Kellner 266ad2f368 update readme 2025-03-11 17:41:50 +01:00
Luca Beurer-Kellner 400870e0b5 update readme 2025-03-11 17:41:04 +01:00
Luca Beurer-Kellner e40ea3e2a9 instructions + port configuration option 2025-03-11 17:38:41 +01:00
Luca Beurer-Kellner dc7d19d510 signal handling 2025-03-11 15:08:05 +01:00
Luca Beurer-Kellner 5ec6d3403a testing tags 2025-03-11 14:45:33 +01:00
Luca Beurer-Kellner 2f8a019ae0 testing tags 2025-03-11 14:44:24 +01:00
Luca Beurer-Kellner 68fbdc49a3 fix trigger 2025-03-11 14:43:37 +01:00
Luca Beurer-Kellner eb969c24df fix condition 2025-03-11 14:43:17 +01:00
Luca Beurer-Kellner a34e88b9c7 fix trigger 2025-03-11 14:42:48 +01:00