92 Commits

Author	SHA1	Message	Date
Adam Wilson	4f2e539996	updates	2025-07-24 18:51:18 -06:00
Adam Wilson	ae279a512d	log LLM config	2025-07-23 20:21:42 -06:00
Adam Wilson	cb92890bb9	break tests into separate files; test 0 results	2025-07-23 19:06:27 -06:00
Adam Wilson	1b5b808ff6	use new garak true positives in tests	2025-07-23 15:59:56 -06:00
Adam Wilson	1096ee38a8	compiled failure req/resp pairs from NVIDIA garak runs in single JSON file	2025-07-23 14:49:13 -06:00
Adam Wilson	dba261b10c	move log/results files	2025-07-23 14:18:06 -06:00
Adam Wilson	acb2336f68	test runs from garak probe 'latentinjection.LatentInjectionResume'	2025-07-23 10:54:48 -06:00
Adam Wilson	db4608d157	test runs from garak probe 'latentinjection.LatentInjectionReport'	2025-07-23 05:13:50 -06:00
Adam Wilson	f639aa272c	test runs from garak probe 'latentinjection.LatentInjectionFactSnippetLegal'	2025-07-22 05:06:24 -06:00
Adam Wilson	82a0c724d3	delete empty test logs	2025-07-21 19:18:36 -06:00
Adam Wilson	2305d3cb9e	move garak test run result files	2025-07-21 19:10:37 -06:00
Adam Wilson	81dc7a75a0	test runs from garak probe 'promptinject.HijackKillHumans'	2025-07-21 19:02:31 -06:00
Adam Wilson	12f1948d7d	test runs from garak probe 'phrasing.FutureTense'	2025-07-21 12:57:40 -06:00
Adam Wilson	5c0b47fd6f	test runs from garak probe 'latentinjection.LatentJailbreak'	2025-07-21 10:38:03 -06:00
Adam Wilson	7e88ac3e45	garak test runs for 'malwaregen.Payload'	2025-07-21 06:49:00 -06:00
Adam Wilson	a7da342717	test runs for 'promptinject.HijackHateHumans'	2025-07-21 05:03:50 -06:00
Adam Wilson	cf3bb6ba40	'topic.WordnetAllowedWords'	2025-07-20 18:42:42 -06:00
Adam Wilson	caa68581f3	snowball.Primes test runs	2025-07-20 16:30:33 -06:00
Adam Wilson	d6eb817522	test run results for malwaregen.Evasion	2025-07-20 14:53:43 -06:00
Adam Wilson	9d6591c4e3	latentinjection.LatentWhois tests	2025-07-20 13:43:59 -06:00
Adam Wilson	e8b80d30fd	results from grandma.Win11	2025-07-20 06:23:39 -06:00
Adam Wilson	638bb5ee4d	results from grandma.Substances	2025-07-20 06:06:17 -06:00
Adam Wilson	dc349feace	more examples	2025-07-19 19:05:23 -06:00
Adam Wilson	938074ef22	add fail notes	2025-07-19 18:56:22 -06:00
Adam Wilson	b5b4ab14be	results for exploitation.SQLInjectionSystem	2025-07-19 18:50:36 -06:00
Adam Wilson	46daee7553	add failed attr	2025-07-19 18:36:46 -06:00
Adam Wilson	5bc2ac81ba	SQLi echo tests, take 2	2025-07-19 18:35:52 -06:00
Adam Wilson	7291621fd8	SQLi echo tests	2025-07-19 18:35:28 -06:00
Adam Wilson	5a99798499	dan.DAN_Jailbreak run and logs	2025-07-19 15:28:30 -06:00
Adam Wilson	91afa1e7e4	test run logs	2025-07-19 15:19:28 -06:00
Adam Wilson	41afb99622	dependency fixes, test setup	2025-07-18 18:18:56 -06:00
Adam Wilson	0843a5a388	dependency fixes, test setup	2025-07-18 18:15:44 -06:00
Adam Wilson	fec4d711bf	implement singular guidelines calls in main service	2025-07-18 12:33:51 -06:00
Adam Wilson	f3dd8e9208	more for templates	2025-07-16 21:07:37 -06:00
Adam Wilson	1dba565236	service implementations	2025-07-16 20:21:10 -06:00
Adam Wilson	cd0e4b9de9	building guidelines services	2025-07-15 21:19:28 -06:00
Adam Wilson	51cce1545a	few shot template WIP	2025-07-12 20:35:43 -06:00
Adam Wilson	c788431416	prompt template IDs; fluent text generation service stubs	2025-07-12 12:18:19 -06:00
Adam Wilson	36820f9c54	pseudo-code for fluent text generation service call	2025-07-11 15:51:01 -06:00
Adam Wilson	a647060644	skip guidelines method; stubs for service calls in test class	2025-07-10 07:10:26 -06:00
Adam Wilson	b4b2d792fc	more progress on fluent service call	2025-07-09 21:56:44 -06:00
Adam Wilson	af75e9aabf	support prompt template loading	2025-07-07 21:38:42 -06:00
Adam Wilson	911b629217	notes on violation vs. false refusal rates, effectiveness metrics	2025-07-06 18:34:12 -06:00
Adam Wilson	7d49d160b9	more test cases and notes	2025-07-06 17:47:49 -06:00
Adam Wilson	ffa2d73ae0	guardrail analyzed response, etc.	2025-07-06 15:15:59 -06:00
Adam Wilson	a1d3a8c1b7	adjust assertions for test 3	2025-07-05 20:21:35 -06:00
Adam Wilson	640c261b26	naming updates; fix static analysis script	2025-07-05 13:01:28 -06:00
Adam Wilson	a9db321597	naming updates; fix static analysis script	2025-07-05 12:58:25 -06:00
Adam Wilson	a25e8f9545	updates	2025-07-02 11:34:47 -06:00
Adam Wilson	f0fcc64258	support sampling and averages during testing	2025-06-28 13:15:32 -06:00