Commit Graph

7865 Commits

Author SHA1 Message Date
Adam Wilson
d15e9d6794 more test and template setup 2025-07-25 09:45:03 -06:00
Adam Wilson
3a62ecfae8 add test 0 results 2025-07-25 08:47:56 -06:00
Adam Wilson
85d33feffe comment 2025-07-24 20:46:28 -06:00
Adam Wilson
4f2e539996 updates 2025-07-24 18:51:18 -06:00
Adam Wilson
ae279a512d log LLM config 2025-07-23 20:21:42 -06:00
Adam Wilson
cb92890bb9 break tests into separate files; test 0 results 2025-07-23 19:06:27 -06:00
Adam Wilson
1b5b808ff6 use new garak true positives in tests 2025-07-23 15:59:56 -06:00
Adam Wilson
1096ee38a8 compiled failure req/resp pairs from NVIDIA garak runs in single JSON file 2025-07-23 14:49:13 -06:00
Adam Wilson
dba261b10c move log/results files 2025-07-23 14:18:06 -06:00
Adam Wilson
acb2336f68 test runs from garak probe 'latentinjection.LatentInjectionResume' 2025-07-23 10:54:48 -06:00
Adam Wilson
db4608d157 test runs from garak probe 'latentinjection.LatentInjectionReport' 2025-07-23 05:13:50 -06:00
Adam Wilson
f639aa272c test runs from garak probe 'latentinjection.LatentInjectionFactSnippetLegal' 2025-07-22 05:06:24 -06:00
Adam Wilson
82a0c724d3 delete empty test logs 2025-07-21 19:18:36 -06:00
Adam Wilson
2305d3cb9e move garak test run result files 2025-07-21 19:10:37 -06:00
Adam Wilson
81dc7a75a0 test runs from garak probe 'promptinject.HijackKillHumans' 2025-07-21 19:02:31 -06:00
Adam Wilson
12f1948d7d test runs from garak probe 'phrasing.FutureTense' 2025-07-21 12:57:40 -06:00
Adam Wilson
5c0b47fd6f test runs from garak probe 'latentinjection.LatentJailbreak' 2025-07-21 10:38:03 -06:00
Adam Wilson
7e88ac3e45 garak test runs for 'malwaregen.Payload' 2025-07-21 06:49:00 -06:00
Adam Wilson
a7da342717 test runs for 'promptinject.HijackHateHumans' 2025-07-21 05:03:50 -06:00
Adam Wilson
cf3bb6ba40 'topic.WordnetAllowedWords' 2025-07-20 18:42:42 -06:00
Adam Wilson
caa68581f3 snowball.Primes test runs 2025-07-20 16:30:33 -06:00
Adam Wilson
d6eb817522 test run results for malwaregen.Evasion 2025-07-20 14:53:43 -06:00
Adam Wilson
9d6591c4e3 latentinjection.LatentWhois tests 2025-07-20 13:43:59 -06:00
Adam Wilson
e8b80d30fd results from grandma.Win11 2025-07-20 06:23:39 -06:00
Adam Wilson
638bb5ee4d results from grandma.Substances 2025-07-20 06:06:17 -06:00
Adam Wilson
dc349feace more examples 2025-07-19 19:05:23 -06:00
Adam Wilson
938074ef22 add fail notes 2025-07-19 18:56:22 -06:00
Adam Wilson
b5b4ab14be results for exploitation.SQLInjectionSystem 2025-07-19 18:50:36 -06:00
Adam Wilson
761246e19a update reqs 2025-07-19 18:39:24 -06:00
Adam Wilson
46daee7553 add failed attr 2025-07-19 18:36:46 -06:00
Adam Wilson
5bc2ac81ba SQLi echo tests, take 2 2025-07-19 18:35:52 -06:00
Adam Wilson
7291621fd8 SQLi echo tests 2025-07-19 18:35:28 -06:00
Adam Wilson
5a99798499 dan.DAN_Jailbreak run and logs 2025-07-19 15:28:30 -06:00
Adam Wilson
91afa1e7e4 test run logs 2025-07-19 15:19:28 -06:00
Adam Wilson
296669ac49 add env var for prompt template dir; error handling 2025-07-19 07:59:54 -06:00
Adam Wilson
41afb99622 dependency fixes, test setup 2025-07-18 18:18:56 -06:00
Adam Wilson
0843a5a388 dependency fixes, test setup 2025-07-18 18:15:44 -06:00
Adam Wilson
7f77e82a5c guidelines close to complete; prior to tests 2025-07-18 13:48:19 -06:00
Adam Wilson
fec4d711bf implement singular guidelines calls in main service 2025-07-18 12:33:51 -06:00
Adam Wilson
c1b4a130f9 base service class 2025-07-17 20:32:13 -06:00
Adam Wilson
f3dd8e9208 more for templates 2025-07-16 21:07:37 -06:00
Adam Wilson
1dba565236 service implementations 2025-07-16 20:21:10 -06:00
Adam Wilson
cd0e4b9de9 building guidelines services 2025-07-15 21:19:28 -06:00
Adam Wilson
51cce1545a few shot template WIP 2025-07-12 20:35:43 -06:00
Adam Wilson
c788431416 prompt template IDs; fluent text generation service stubs 2025-07-12 12:18:19 -06:00
Adam Wilson
36820f9c54 pseudo-code for fluent text generation service call 2025-07-11 15:51:01 -06:00
Adam Wilson
a647060644 skip guidelines method; stubs for service calls in test class 2025-07-10 07:10:26 -06:00
Adam Wilson
b4b2d792fc more progress on fluent service call 2025-07-09 21:56:44 -06:00
Adam Wilson
5470554d28 stub for fluent guidelines service 2025-07-08 17:18:57 -06:00
Adam Wilson
fabf36675d TODO notes 2025-07-08 15:54:19 -06:00