297 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Adam Wilson	42e4962063	base classes	2025-08-18 20:24:36 -06:00
Adam Wilson	a636b7fbf7	fix test number file path; support smaller runs	2025-08-18 20:05:24 -06:00
Adam Wilson	2694962fc8	try smaller batches	2025-08-18 19:46:51 -06:00
Adam Wilson	7b466d9bf2	try smaller batches	2025-08-18 19:46:11 -06:00
Adam Wilson	8c6230e0dc	try smaller batches	2025-08-18 18:00:08 -06:00
Adam Wilson	09eac1f050	try smaller batches	2025-08-18 17:36:01 -06:00
Adam Wilson	0411049d6b	matrix strategy for tests; remove dead code	2025-08-18 16:31:32 -06:00
Adam Wilson	010933aa59	matrix strategy for tests	2025-08-18 16:12:31 -06:00
Adam Wilson	b1a2672d14	test result folders	2025-08-18 15:50:07 -06:00
Adam Wilson	a1c7313833	fix for template selection	2025-08-18 15:16:27 -06:00
Adam Wilson	2e1c43b819	unneeded param	2025-08-18 14:49:05 -06:00
Adam Wilson	73b25d2ae4	fix arg	2025-08-18 14:38:37 -06:00
Adam Wilson	3d335d047c	dead code	2025-08-18 14:31:46 -06:00
Adam Wilson	fb95e8afea	path	2025-08-18 14:04:06 -06:00
Adam Wilson	d7bffb85e1	env	2025-08-18 13:55:31 -06:00
Adam Wilson	67620f780b	test 4 - GitHub Actions	2025-08-18 13:42:44 -06:00
Adam Wilson	9f3b8b6b07	reorganize tests	2025-08-18 13:28:01 -06:00
Adam Wilson	36c11703cb	dynamic template and model selection	2025-08-18 11:22:50 -06:00
Adam Wilson	a1e07e6a4f	support multiple templates	2025-08-16 19:47:26 -06:00
Adam Wilson	e138a14d5f	support multiple templates	2025-08-16 19:30:05 -06:00
Adam Wilson	d5beccb774	remove additional reflexion support	2025-08-16 19:26:12 -06:00
Adam Wilson	7a510f03fa	commit step	2025-08-16 19:25:51 -06:00
Adam Wilson	e014e6c321	remove reflexion	2025-08-16 19:25:34 -06:00
Adam Wilson	a40c655334	old reference	2025-08-16 19:08:21 -06:00
Adam Wilson	1eadd81d77	new test for GH actions	2025-08-16 18:57:08 -06:00
Adam Wilson	82c987404b	templates	2025-08-16 16:00:35 -06:00
Adam Wilson	11028c6b4e	+ model support (Apple OpenELM 270M Instruct, Meta TinyLlama 1.1B Chat)	2025-08-16 12:33:18 -06:00
Adam Wilson	935e5b9a5b	updated test results table with metrics from Aug 5 re-run of test_4	2025-08-05 18:30:26 -06:00
Adam Wilson	757eb64c35	new test run results for test_04_malicious_prompts_rag_and_cot	2025-08-05 18:24:36 -06:00
Adam Wilson	ab7cd56d7e	test archival	2025-08-05 18:24:15 -06:00
Adam Wilson	1f0bd51ff3	fix template	2025-08-05 18:23:52 -06:00
Adam Wilson	b7c22809a6	archiving tests	2025-08-05 18:23:06 -06:00
Adam Wilson	4e161e850e	template	2025-08-05 15:09:39 -06:00
Adam Wilson	75c048c00d	:(	2025-08-05 15:07:37 -06:00
Adam Wilson	24832ef812	CoT + RAG template	2025-08-05 14:44:02 -06:00
Adam Wilson	ae3dd68f12	violation rate threshold = 15%	2025-08-04 22:04:10 -06:00
Adam Wilson	c94fbb3b9d	<=	2025-08-04 21:53:02 -06:00
Adam Wilson	a49fef62c5	use percentage not floating point	2025-08-04 21:51:24 -06:00
Adam Wilson	74f99a36ec	unneeded "build" phase	2025-08-04 21:37:35 -06:00
Adam Wilson	4c317634a3	fix order; add PR trigger	2025-08-04 21:23:56 -06:00
Adam Wilson	865a4b923a	job dependencies	2025-08-04 08:02:59 -06:00
Adam Wilson	3b5c7b9f69	CI/CD test	2025-08-04 07:59:02 -06:00
Adam Wilson	5252342701	add violation rate column to results table, based on 100 - (< thresh %)	2025-08-02 10:18:13 -06:00
Adam Wilson	b65e531049	results table	2025-08-01 20:00:14 -06:00
Adam Wilson	6d5d53bad5	summary of test results (tests 0-4)	2025-08-01 19:38:19 -06:00
Adam Wilson	bef6ba9ef5	JSON results: test_00_benign_prompts_no_mitigation	2025-07-30 12:19:53 -06:00
Adam Wilson	0171af7c94	fix confusing log message	2025-07-30 11:16:24 -06:00
Adam Wilson	24c6eaae28	JSON schema script	2025-07-30 11:13:20 -06:00
Adam Wilson	378aea7a66	100 math prompts, not 150	2025-07-30 11:13:09 -06:00
Adam Wilson	1624019272	JSON results: test_01_malicious_prompts_no_mitigation	2025-07-30 11:08:46 -06:00