Commit Graph

34 Commits

Author SHA1 Message Date
Adam Wilson
28a962facd support casing 2025-08-18 20:48:43 -06:00
Adam Wilson
7b466d9bf2 try smaller batches 2025-08-18 19:46:11 -06:00
Adam Wilson
b1a2672d14 test result folders 2025-08-18 15:50:07 -06:00
Adam Wilson
935e5b9a5b updated test results table with metrics from Aug 5 re-run of test_4 2025-08-05 18:30:26 -06:00
Adam Wilson
757eb64c35 new test run results for test_04_malicious_prompts_rag_and_cot 2025-08-05 18:24:36 -06:00
Adam Wilson
ab7cd56d7e test archival 2025-08-05 18:24:15 -06:00
Adam Wilson
b7c22809a6 archiving tests 2025-08-05 18:23:06 -06:00
Adam Wilson
5252342701 add violation rate column to results table, based on 100 - (< thresh %) 2025-08-02 10:18:13 -06:00
Adam Wilson
b65e531049 results table 2025-08-01 20:00:14 -06:00
Adam Wilson
6d5d53bad5 summary of test results (tests 0-4) 2025-08-01 19:38:19 -06:00
Adam Wilson
bef6ba9ef5 JSON results: test_00_benign_prompts_no_mitigation 2025-07-30 12:19:53 -06:00
Adam Wilson
24c6eaae28 JSON schema script 2025-07-30 11:13:20 -06:00
Adam Wilson
1624019272 JSON results: test_01_malicious_prompts_no_mitigation 2025-07-30 11:08:46 -06:00
Adam Wilson
0aaa4036df JSON results: test_02_malicious_prompts_cot 2025-07-30 05:53:33 -06:00
Adam Wilson
c7deca79da JSON results: test_03_malicious_prompts_rag 2025-07-29 22:13:56 -06:00
Adam Wilson
4f26df0755 JSON results: test_04_malicious_prompts_rag_and_cot 2025-07-29 15:27:39 -06:00
Adam Wilson
cf4e2d48fa JSON results: test_05_malicious_prompts_cot_with_reflexion 2025-07-29 11:54:00 -06:00
Adam Wilson
bf8396bb03 JSON results: test_06_malicious_prompts_rag_with_reflexion 2025-07-29 06:09:29 -06:00
Adam Wilson
df6d5e644b JSON results: test_07_malicious_prompts_rag_and_cot_reflexion 2025-07-28 20:51:31 -06:00
Adam Wilson
780a4e529f archive tests 2025-07-28 15:27:04 -06:00
Adam Wilson
51e966e1ec escape braces 2025-07-28 14:55:32 -06:00
Adam Wilson
047c161006 archive test results 2025-07-28 13:43:28 -06:00
Adam Wilson
16ba9c15ee test output for test_02_malicious_prompts 2025-07-26 08:22:35 -06:00
Adam Wilson
3a62ecfae8 add test 0 results 2025-07-25 08:47:56 -06:00
Adam Wilson
4f2e539996 updates 2025-07-24 18:51:18 -06:00
Adam Wilson
cb92890bb9 break tests into separate files; test 0 results 2025-07-23 19:06:27 -06:00
Adam Wilson
1b5b808ff6 use new garak true positives in tests 2025-07-23 15:59:56 -06:00
Adam Wilson
1096ee38a8 compiled failure req/resp pairs from NVIDIA garak runs in single JSON file 2025-07-23 14:49:13 -06:00
Adam Wilson
dba261b10c move log/results files 2025-07-23 14:18:06 -06:00
Adam Wilson
82a0c724d3 delete empty test logs 2025-07-21 19:18:36 -06:00
Adam Wilson
2305d3cb9e move garak test run result files 2025-07-21 19:10:37 -06:00
Adam Wilson
46daee7553 add failed attr 2025-07-19 18:36:46 -06:00
Adam Wilson
5bc2ac81ba SQLi echo tests, take 2 2025-07-19 18:35:52 -06:00
Adam Wilson
91afa1e7e4 test run logs 2025-07-19 15:19:28 -06:00