Commit Graph

299 Commits

Author SHA1 Message Date
Adam Wilson addeb0407d Merge remote-tracking branch 'origin/auto-generated-20250820-174355-batch-2' into phi-3-only 2025-08-20 14:33:20 -06:00
Adam Wilson 104e839a7f Merge remote-tracking branch 'origin/auto-generated-20250820-174324-batch-10' into phi-3-only 2025-08-20 14:33:19 -06:00
Adam Wilson 7db2fff627 Merge remote-tracking branch 'origin/auto-generated-20250820-174238-batch-1' into phi-3-only 2025-08-20 14:33:19 -06:00
Adam Wilson 9fe9d847c0 Merge remote-tracking branch 'origin/auto-generated-20250820-174235-batch-6' into phi-3-only 2025-08-20 14:33:19 -06:00
Adam Wilson b09dc0a974 Merge remote-tracking branch 'origin/auto-generated-20250820-174213-batch-4' into phi-3-only 2025-08-20 14:33:18 -06:00
Adam Wilson b4d1a423b7 Merge remote-tracking branch 'origin/auto-generated-20250820-174204-batch-3' into phi-3-only 2025-08-20 14:33:18 -06:00
Adam Wilson 0c38f94696 Merge remote-tracking branch 'origin/auto-generated-20250820-174157-batch-5' into phi-3-only 2025-08-20 14:33:18 -06:00
Adam Wilson 9a2b4ac41b target phi-3-only 2025-08-20 12:52:13 -06:00
Adam Wilson 640645d978 Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 2 [skip ci] 2025-08-20 17:43:55 +00:00
Adam Wilson 11f27a0c6d Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 10 [skip ci] 2025-08-20 17:43:24 +00:00
Adam Wilson 067156fd60 Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 1 [skip ci] 2025-08-20 17:42:38 +00:00
Adam Wilson b1bde3f93a Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 6 [skip ci] 2025-08-20 17:42:35 +00:00
Adam Wilson 2b91f45b74 Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 4 [skip ci] 2025-08-20 17:42:13 +00:00
Adam Wilson 1a4856c746 Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 3 [skip ci] 2025-08-20 17:42:04 +00:00
Adam Wilson e3fb3d809e Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 5 [skip ci] 2025-08-20 17:41:57 +00:00
Adam Wilson 6b682f84a8 try 2025-08-20 11:33:27 -06:00
Adam Wilson b6c7e96c81 script 2025-08-20 09:53:32 -06:00
Adam Wilson 22bcc8e598 model name 2025-08-20 06:25:26 -06:00
Adam Wilson 2f2eab944a fix 2025-08-20 06:20:42 -06:00
Adam Wilson aca0128877 file path 2025-08-19 21:58:51 -06:00
Adam Wilson c1d943195b fix 2025-08-19 20:40:04 -06:00
Adam Wilson 0465d77c13 fix 2025-08-19 20:36:00 -06:00
Adam Wilson bc023eae9e req 2025-08-19 20:23:15 -06:00
Adam Wilson e60eb7b896 req 2025-08-19 20:21:25 -06:00
Adam Wilson cb9d230db3 req 2025-08-19 20:18:34 -06:00
Adam Wilson d8bcd9e080 req 2025-08-19 20:15:24 -06:00
Adam Wilson f32c8b2410 version 2025-08-19 20:11:34 -06:00
Adam Wilson cc124a91a3 support batch tests 2025-08-19 20:09:34 -06:00
Adam Wilson 3585f80414 fix dependencies 2025-08-19 19:51:12 -06:00
Adam Wilson 935e5b9a5b updated test results table with metrics from Aug 5 re-run of test_4 2025-08-05 18:30:26 -06:00
Adam Wilson 757eb64c35 new test run results for test_04_malicious_prompts_rag_and_cot 2025-08-05 18:24:36 -06:00
Adam Wilson ab7cd56d7e test archival 2025-08-05 18:24:15 -06:00
Adam Wilson 1f0bd51ff3 fix template 2025-08-05 18:23:52 -06:00
Adam Wilson b7c22809a6 archiving tests 2025-08-05 18:23:06 -06:00
Adam Wilson 4e161e850e template 2025-08-05 15:09:39 -06:00
Adam Wilson 75c048c00d :( 2025-08-05 15:07:37 -06:00
Adam Wilson 24832ef812 CoT + RAG template 2025-08-05 14:44:02 -06:00
Adam Wilson ae3dd68f12 violation rate threshold = 15% 2025-08-04 22:04:10 -06:00
Adam Wilson c94fbb3b9d <= 2025-08-04 21:53:02 -06:00
Adam Wilson a49fef62c5 use percentage not floating point 2025-08-04 21:51:24 -06:00
Adam Wilson 74f99a36ec unneeded "build" phase 2025-08-04 21:37:35 -06:00
Adam Wilson 4c317634a3 fix order; add PR trigger 2025-08-04 21:23:56 -06:00
Adam Wilson 865a4b923a job dependencies 2025-08-04 08:02:59 -06:00
Adam Wilson 3b5c7b9f69 CI/CD test 2025-08-04 07:59:02 -06:00
Adam Wilson 5252342701 add violation rate column to results table, based on 100 - (< thresh %) 2025-08-02 10:18:13 -06:00
Adam Wilson b65e531049 results table 2025-08-01 20:00:14 -06:00
Adam Wilson 6d5d53bad5 summary of test results (tests 0-4) 2025-08-01 19:38:19 -06:00
Adam Wilson bef6ba9ef5 JSON results: test_00_benign_prompts_no_mitigation 2025-07-30 12:19:53 -06:00
Adam Wilson 0171af7c94 fix confusing log message 2025-07-30 11:16:24 -06:00
Adam Wilson 24c6eaae28 JSON schema script 2025-07-30 11:13:20 -06:00