Commit Graph

161 Commits

Author SHA1 Message Date
Adam Wilson e1af53d22b Merge remote-tracking branch 'origin/auto-generated-20250819-124811' into development 2025-08-19 15:06:00 -06:00
Adam Wilson 6fd18cda31 Merge remote-tracking branch 'origin/auto-generated-20250819-124512' into development 2025-08-19 15:06:00 -06:00
Adam Wilson b5abf24c15 Merge remote-tracking branch 'origin/auto-generated-20250819-124333' into development 2025-08-19 15:05:59 -06:00
Adam Wilson 7339830edb Merge remote-tracking branch 'origin/auto-generated-20250819-124052' into development 2025-08-19 15:05:59 -06:00
Adam Wilson f63033bf78 Merge remote-tracking branch 'origin/auto-generated-20250819-123807' into development 2025-08-19 15:05:58 -06:00
Adam Wilson 2734ff45f9 Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 4 [skip ci] 2025-08-19 12:48:11 +00:00
Adam Wilson 66c3233314 Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 4 [skip ci] 2025-08-19 12:45:12 +00:00
Adam Wilson 563161d375 Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 4 [skip ci] 2025-08-19 12:43:33 +00:00
Adam Wilson e9132128ea Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 4 [skip ci] 2025-08-19 12:40:52 +00:00
Adam Wilson 3b204ecb60 Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 4 [skip ci] 2025-08-19 12:38:07 +00:00
Adam Wilson 44d61f2007 Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 4 [skip ci] 2025-08-19 12:36:40 +00:00
Adam Wilson 368c9e68fb fix path 2025-08-18 21:10:50 -06:00
Adam Wilson 28a962facd support casing 2025-08-18 20:48:43 -06:00
Adam Wilson a636b7fbf7 fix test number file path; support smaller runs 2025-08-18 20:05:24 -06:00
Adam Wilson 7b466d9bf2 try smaller batches 2025-08-18 19:46:11 -06:00
Adam Wilson 8c6230e0dc try smaller batches 2025-08-18 18:00:08 -06:00
Adam Wilson 09eac1f050 try smaller batches 2025-08-18 17:36:01 -06:00
Adam Wilson 0411049d6b matrix strategy for tests; remove dead code 2025-08-18 16:31:32 -06:00
Adam Wilson 010933aa59 matrix strategy for tests 2025-08-18 16:12:31 -06:00
Adam Wilson b1a2672d14 test result folders 2025-08-18 15:50:07 -06:00
Adam Wilson 9f3b8b6b07 reorganize tests 2025-08-18 13:28:01 -06:00
Adam Wilson 36c11703cb dynamic template and model selection 2025-08-18 11:22:50 -06:00
Adam Wilson a40c655334 old reference 2025-08-16 19:08:21 -06:00
Adam Wilson 1eadd81d77 new test for GH actions 2025-08-16 18:57:08 -06:00
Adam Wilson 82c987404b templates 2025-08-16 16:00:35 -06:00
Adam Wilson 11028c6b4e + model support (Apple OpenELM 270M Instruct, Meta TinyLlama 1.1B Chat) 2025-08-16 12:33:18 -06:00
Adam Wilson 935e5b9a5b updated test results table with metrics from Aug 5 re-run of test_4 2025-08-05 18:30:26 -06:00
Adam Wilson 757eb64c35 new test run results for test_04_malicious_prompts_rag_and_cot 2025-08-05 18:24:36 -06:00
Adam Wilson ab7cd56d7e test archival 2025-08-05 18:24:15 -06:00
Adam Wilson 1f0bd51ff3 fix template 2025-08-05 18:23:52 -06:00
Adam Wilson b7c22809a6 archiving tests 2025-08-05 18:23:06 -06:00
Adam Wilson 24832ef812 CoT + RAG template 2025-08-05 14:44:02 -06:00
Adam Wilson ae3dd68f12 violation rate threshold = 15% 2025-08-04 22:04:10 -06:00
Adam Wilson c94fbb3b9d <= 2025-08-04 21:53:02 -06:00
Adam Wilson a49fef62c5 use percentage not floating point 2025-08-04 21:51:24 -06:00
Adam Wilson 3b5c7b9f69 CI/CD test 2025-08-04 07:59:02 -06:00
Adam Wilson 5252342701 add violation rate column to results table, based on 100 - (< thresh %) 2025-08-02 10:18:13 -06:00
Adam Wilson b65e531049 results table 2025-08-01 20:00:14 -06:00
Adam Wilson 6d5d53bad5 summary of test results (tests 0-4) 2025-08-01 19:38:19 -06:00
Adam Wilson bef6ba9ef5 JSON results: test_00_benign_prompts_no_mitigation 2025-07-30 12:19:53 -06:00
Adam Wilson 0171af7c94 fix confusing log message 2025-07-30 11:16:24 -06:00
Adam Wilson 24c6eaae28 JSON schema script 2025-07-30 11:13:20 -06:00
Adam Wilson 378aea7a66 100 math prompts, not 150 2025-07-30 11:13:09 -06:00
Adam Wilson 1624019272 JSON results: test_01_malicious_prompts_no_mitigation 2025-07-30 11:08:46 -06:00
Adam Wilson 28518e6c17 fixes for basic prompt template 2025-07-30 07:17:48 -06:00
Adam Wilson 0aaa4036df JSON results: test_02_malicious_prompts_cot 2025-07-30 05:53:33 -06:00
Adam Wilson c7deca79da JSON results: test_03_malicious_prompts_rag 2025-07-29 22:13:56 -06:00
Adam Wilson 4f26df0755 JSON results: test_04_malicious_prompts_rag_and_cot 2025-07-29 15:27:39 -06:00
Adam Wilson cf4e2d48fa JSON results: test_05_malicious_prompts_cot_with_reflexion 2025-07-29 11:54:00 -06:00
Adam Wilson bf8396bb03 JSON results: test_06_malicious_prompts_rag_with_reflexion 2025-07-29 06:09:29 -06:00