Commit Graph

23 Commits

Author SHA1 Message Date
Adam Wilson 2659e6e43c more updates for reflexion 2025-07-28 10:31:55 -06:00
Adam Wilson cb92890bb9 break tests into separate files; test 0 results 2025-07-23 19:06:27 -06:00
Adam Wilson 41afb99622 dependency fixes, test setup 2025-07-18 18:18:56 -06:00
Adam Wilson fec4d711bf implement singular guidelines calls in main service 2025-07-18 12:33:51 -06:00
Adam Wilson 1dba565236 service implementations 2025-07-16 20:21:10 -06:00
Adam Wilson c788431416 prompt template IDs; fluent text generation service stubs 2025-07-12 12:18:19 -06:00
Adam Wilson 36820f9c54 pseudo-code for fluent text generation service call 2025-07-11 15:51:01 -06:00
Adam Wilson a647060644 skip guidelines method; stubs for service calls in test class 2025-07-10 07:10:26 -06:00
Adam Wilson b4b2d792fc more progress on fluent service call 2025-07-09 21:56:44 -06:00
Adam Wilson af75e9aabf support prompt template loading 2025-07-07 21:38:42 -06:00
Adam Wilson 911b629217 notes on violation vs. false refusal rates, effectiveness metrics 2025-07-06 18:34:12 -06:00
Adam Wilson 7d49d160b9 more test cases and notes 2025-07-06 17:47:49 -06:00
Adam Wilson ffa2d73ae0 guardrail analyzed response, etc. 2025-07-06 15:15:59 -06:00
Adam Wilson a1d3a8c1b7 adjust assertions for test 3 2025-07-05 20:21:35 -06:00
Adam Wilson 640c261b26 naming updates; fix static analysis script 2025-07-05 13:01:28 -06:00
Adam Wilson f0fcc64258 support sampling and averages during testing 2025-06-28 13:15:32 -06:00
Adam Wilson cb1be6746f support testing malicious prompts with no guidelines 2025-06-28 12:18:35 -06:00
Adam Wilson 036d36bf4f compare math prompt completions to DAN response 2025-06-25 21:47:22 -06:00
Adam Wilson eed481ee77 document intended test cases/methodology; math prompts 2025-06-25 15:41:11 -06:00
Adam Wilson 5022c8f45c document intended test cases/methodology 2025-06-25 15:23:56 -06:00
Adam Wilson 9057b0e977 refactor to use services instead of language model objects directly 2025-06-25 06:28:05 -06:00
Adam Wilson c2abf2e81f more tests 2025-06-24 14:24:10 -06:00
Adam Wilson 92e00b9eb2 integration tests 2025-06-24 10:57:44 -06:00