CalvinBackup/llmsecops-research
1
0
Fork 0
mirror of https://github.com/lightbroker/llmsecops-research.git synced 2026-05-26 18:07:48 +02:00
Code Issues Packages Projects Releases Wiki Activity
293 Commits 42 Branches 0 Tags
35e2680aee4057f7f3296509fdb6e34865df4293
Commit Graph

293 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Adam Wilson 35e2680aee Merge pull request #58 from lightbroker/lightbroker-patch-2 
Update test_04_malicious_prompts_rag_and_cot_microsoft_phi_3_mini4k_i…
 2025-08-20 14:01:41 -06:00
Adam Wilson 1a55a020bb Update test_04_malicious_prompts_rag_and_cot_microsoft_phi_3_mini4k_instruct.61-80.yml 2025-08-20 14:01:32 -06:00
Adam Wilson 7f3f154f4c Merge pull request #57 from lightbroker/lightbroker-patch-2 
Update test_04_malicious_prompts_rag_and_cot_microsoft_phi_3_mini4k_i…
 2025-08-20 13:42:27 -06:00
Adam Wilson d0f5baf635 Merge pull request #56 from lightbroker/lightbroker-patch-3 
Update test_04_malicious_prompts_rag_and_cot_microsoft_phi_3_mini4k_i…
 2025-08-20 13:41:48 -06:00
Adam Wilson cc90afb6b6 Update test_04_malicious_prompts_rag_and_cot_microsoft_phi_3_mini4k_instruct.41-60.yml 2025-08-20 13:41:39 -06:00
Adam Wilson 424a52df43 Update test_04_malicious_prompts_rag_and_cot_microsoft_phi_3_mini4k_instruct.21-40.yml 2025-08-20 13:41:17 -06:00
Adam Wilson 96d15c640a Merge pull request #55 from lightbroker/lightbroker-patch-2 
Update test_04_malicious_prompts_rag_and_cot_microsoft_phi_3_mini4k_i…
 2025-08-20 13:40:29 -06:00
Adam Wilson 290bc573c2 Update test_04_malicious_prompts_rag_and_cot_microsoft_phi_3_mini4k_instruct.01-20.yml 2025-08-20 13:40:20 -06:00
Adam Wilson 331aa142bd Merge pull request #54 from lightbroker/lightbroker-patch-1 
Update test_04.abstract_base.yml
 2025-08-20 13:39:17 -06:00
Adam Wilson 3283e7e68c Update test_04.abstract_base.yml 2025-08-20 13:39:01 -06:00
Adam Wilson b6c7e96c81 script 2025-08-20 09:53:32 -06:00
Adam Wilson 22bcc8e598 model name 2025-08-20 06:25:26 -06:00
Adam Wilson 2f2eab944a fix 2025-08-20 06:20:42 -06:00
Adam Wilson aca0128877 file path 2025-08-19 21:58:51 -06:00
Adam Wilson c1d943195b fix 2025-08-19 20:40:04 -06:00
Adam Wilson 0465d77c13 fix 2025-08-19 20:36:00 -06:00
Adam Wilson bc023eae9e req 2025-08-19 20:23:15 -06:00
Adam Wilson e60eb7b896 req 2025-08-19 20:21:25 -06:00
Adam Wilson cb9d230db3 req 2025-08-19 20:18:34 -06:00
Adam Wilson d8bcd9e080 req 2025-08-19 20:15:24 -06:00
Adam Wilson f32c8b2410 version 2025-08-19 20:11:34 -06:00
Adam Wilson cc124a91a3 support batch tests 2025-08-19 20:09:34 -06:00
Adam Wilson 3585f80414 fix dependencies 2025-08-19 19:51:12 -06:00
Adam Wilson 935e5b9a5b updated test results table with metrics from Aug 5 re-run of test_4 2025-08-05 18:30:26 -06:00
Adam Wilson 757eb64c35 new test run results for test_04_malicious_prompts_rag_and_cot 2025-08-05 18:24:36 -06:00
Adam Wilson ab7cd56d7e test archival 2025-08-05 18:24:15 -06:00
Adam Wilson 1f0bd51ff3 fix template 2025-08-05 18:23:52 -06:00
Adam Wilson b7c22809a6 archiving tests 2025-08-05 18:23:06 -06:00
Adam Wilson 4e161e850e template 2025-08-05 15:09:39 -06:00
Adam Wilson 75c048c00d :( 2025-08-05 15:07:37 -06:00
Adam Wilson 24832ef812 CoT + RAG template 2025-08-05 14:44:02 -06:00
Adam Wilson ae3dd68f12 violation rate threshold = 15% 2025-08-04 22:04:10 -06:00
Adam Wilson c94fbb3b9d <= 2025-08-04 21:53:02 -06:00
Adam Wilson a49fef62c5 use percentage not floating point 2025-08-04 21:51:24 -06:00
Adam Wilson 74f99a36ec unneeded "build" phase 2025-08-04 21:37:35 -06:00
Adam Wilson 4c317634a3 fix order; add PR trigger 2025-08-04 21:23:56 -06:00
Adam Wilson 865a4b923a job dependencies 2025-08-04 08:02:59 -06:00
Adam Wilson 3b5c7b9f69 CI/CD test 2025-08-04 07:59:02 -06:00
Adam Wilson 5252342701 add violation rate column to results table, based on 100 - (< thresh %) 2025-08-02 10:18:13 -06:00
Adam Wilson b65e531049 results table 2025-08-01 20:00:14 -06:00
Adam Wilson 6d5d53bad5 summary of test results (tests 0-4) 2025-08-01 19:38:19 -06:00
Adam Wilson bef6ba9ef5 JSON results: test_00_benign_prompts_no_mitigation 2025-07-30 12:19:53 -06:00
Adam Wilson 0171af7c94 fix confusing log message 2025-07-30 11:16:24 -06:00
Adam Wilson 24c6eaae28 JSON schema script 2025-07-30 11:13:20 -06:00
Adam Wilson 378aea7a66 100 math prompts, not 150 2025-07-30 11:13:09 -06:00
Adam Wilson 1624019272 JSON results: test_01_malicious_prompts_no_mitigation 2025-07-30 11:08:46 -06:00
Adam Wilson 28518e6c17 fixes for basic prompt template 2025-07-30 07:17:48 -06:00
Adam Wilson 0aaa4036df JSON results: test_02_malicious_prompts_cot 2025-07-30 05:53:33 -06:00
Adam Wilson c7deca79da JSON results: test_03_malicious_prompts_rag 2025-07-29 22:13:56 -06:00
Adam Wilson 4f26df0755 JSON results: test_04_malicious_prompts_rag_and_cot 2025-07-29 15:27:39 -06:00