Commit Graph

102 Commits

Author SHA1 Message Date
Adam Wilson
42e4962063 base classes 2025-08-18 20:24:36 -06:00
Adam Wilson
2694962fc8 try smaller batches 2025-08-18 19:46:51 -06:00
Adam Wilson
8c6230e0dc try smaller batches 2025-08-18 18:00:08 -06:00
Adam Wilson
a1c7313833 fix for template selection 2025-08-18 15:16:27 -06:00
Adam Wilson
2e1c43b819 unneeded param 2025-08-18 14:49:05 -06:00
Adam Wilson
73b25d2ae4 fix arg 2025-08-18 14:38:37 -06:00
Adam Wilson
3d335d047c dead code 2025-08-18 14:31:46 -06:00
Adam Wilson
36c11703cb dynamic template and model selection 2025-08-18 11:22:50 -06:00
Adam Wilson
a1e07e6a4f support multiple templates 2025-08-16 19:47:26 -06:00
Adam Wilson
e138a14d5f support multiple templates 2025-08-16 19:30:05 -06:00
Adam Wilson
d5beccb774 remove additional reflexion support 2025-08-16 19:26:12 -06:00
Adam Wilson
e014e6c321 remove reflexion 2025-08-16 19:25:34 -06:00
Adam Wilson
1eadd81d77 new test for GH actions 2025-08-16 18:57:08 -06:00
Adam Wilson
82c987404b templates 2025-08-16 16:00:35 -06:00
Adam Wilson
11028c6b4e + model support (Apple OpenELM 270M Instruct, Meta TinyLlama 1.1B Chat) 2025-08-16 12:33:18 -06:00
Adam Wilson
75c048c00d :( 2025-08-05 15:07:37 -06:00
Adam Wilson
28518e6c17 fixes for basic prompt template 2025-07-30 07:17:48 -06:00
Adam Wilson
51e966e1ec escape braces 2025-07-28 14:55:32 -06:00
Adam Wilson
058b281f25 default risk threshold; scores lower down in JSON serialization 2025-07-28 13:40:54 -06:00
Adam Wilson
d39d7f1f1f don't send back alternate after guidelines 2025-07-28 13:29:21 -06:00
Adam Wilson
393b76faf4 small fix 2025-07-28 13:19:50 -06:00
Adam Wilson
bc119ed50e don't overprocess results 2025-07-28 13:10:03 -06:00
Adam Wilson
24e28c0182 fix JSON serialization for logging test result 2025-07-28 12:06:56 -06:00
Adam Wilson
df14a01fe9 log full completion result with semantic similarity comparison results 2025-07-28 11:49:07 -06:00
Adam Wilson
b971df0a7a risk threshold is too low 2025-07-28 10:47:57 -06:00
Adam Wilson
2659e6e43c more updates for reflexion 2025-07-28 10:31:55 -06:00
Adam Wilson
5bc9f480f9 all domain unit tests pass 2025-07-27 18:53:30 -06:00
Adam Wilson
a621ad82a9 Reflexion guardrails updates 2025-07-27 16:39:06 -06:00
Adam Wilson
99ec0ddf98 WIP reflexion service 2025-07-27 13:59:01 -06:00
Adam Wilson
eddacd87fa LLM config output 2025-07-27 11:21:12 -06:00
Adam Wilson
a7a6873e73 update prompt templates; support LLM config logging 2025-07-26 22:10:04 -06:00
Adam Wilson
5b27d4c2e3 refactor for examples 2025-07-26 16:31:49 -06:00
Adam Wilson
27dad236ef avoid unclosed curly braces 2025-07-26 15:50:10 -06:00
Adam Wilson
16ba9c15ee test output for test_02_malicious_prompts 2025-07-26 08:22:35 -06:00
Adam Wilson
741629908c updates for RAG + CoT tests 2025-07-25 18:11:49 -06:00
Adam Wilson
72785c6420 updates for RAG + CoT 2025-07-25 17:24:01 -06:00
Adam Wilson
a770a5211c create/update all Phi-3 templates 2025-07-25 16:35:19 -06:00
Adam Wilson
d15e9d6794 more test and template setup 2025-07-25 09:45:03 -06:00
Adam Wilson
3a62ecfae8 add test 0 results 2025-07-25 08:47:56 -06:00
Adam Wilson
85d33feffe comment 2025-07-24 20:46:28 -06:00
Adam Wilson
4f2e539996 updates 2025-07-24 18:51:18 -06:00
Adam Wilson
ae279a512d log LLM config 2025-07-23 20:21:42 -06:00
Adam Wilson
cb92890bb9 break tests into separate files; test 0 results 2025-07-23 19:06:27 -06:00
Adam Wilson
91afa1e7e4 test run logs 2025-07-19 15:19:28 -06:00
Adam Wilson
296669ac49 add env var for prompt template dir; error handling 2025-07-19 07:59:54 -06:00
Adam Wilson
41afb99622 dependency fixes, test setup 2025-07-18 18:18:56 -06:00
Adam Wilson
7f77e82a5c guidelines close to complete; prior to tests 2025-07-18 13:48:19 -06:00
Adam Wilson
fec4d711bf implement singular guidelines calls in main service 2025-07-18 12:33:51 -06:00
Adam Wilson
c1b4a130f9 base service class 2025-07-17 20:32:13 -06:00
Adam Wilson
f3dd8e9208 more for templates 2025-07-16 21:07:37 -06:00