CalvinBackup/llmsecops-research
1
0
Fork 0
mirror of https://github.com/lightbroker/llmsecops-research.git synced 2026-02-12 22:52:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
14,917 Commits 42 Branches 0 Tags
lightbroker-patch-2
Commit Graph

45 Commits

Author SHA1 Message Date
Adam Wilson
ea6bbbdc5a fix tests 2025-08-21 14:03:58 -06:00
Adam Wilson
2f2eab944a fix 2025-08-20 06:20:42 -06:00
Adam Wilson
cc124a91a3 support batch tests 2025-08-19 20:09:34 -06:00
Adam Wilson
1f0bd51ff3 fix template 2025-08-05 18:23:52 -06:00
Adam Wilson
24832ef812 CoT + RAG template 2025-08-05 14:44:02 -06:00
Adam Wilson
0171af7c94 fix confusing log message 2025-07-30 11:16:24 -06:00
Adam Wilson
28518e6c17 fixes for basic prompt template 2025-07-30 07:17:48 -06:00
Adam Wilson
df14a01fe9 log full completion result with semantic similarity comparison results 2025-07-28 11:49:07 -06:00
Adam Wilson
2659e6e43c more updates for reflexion 2025-07-28 10:31:55 -06:00
Adam Wilson
5bc9f480f9 all domain unit tests pass 2025-07-27 18:53:30 -06:00
Adam Wilson
b83553d767 make mitigation tests consistent 2025-07-27 17:44:40 -06:00
Adam Wilson
dcff18a058 logging 2025-07-27 17:19:07 -06:00
Adam Wilson
a621ad82a9 Reflexion guardrails updates 2025-07-27 16:39:06 -06:00
Adam Wilson
5b27d4c2e3 refactor for examples 2025-07-26 16:31:49 -06:00
Adam Wilson
16ba9c15ee test output for test_02_malicious_prompts 2025-07-26 08:22:35 -06:00
Adam Wilson
741629908c updates for RAG + CoT tests 2025-07-25 18:11:49 -06:00
Adam Wilson
23d58675f4 token constants 2025-07-25 09:47:12 -06:00
Adam Wilson
d15e9d6794 more test and template setup 2025-07-25 09:45:03 -06:00
Adam Wilson
3a62ecfae8 add test 0 results 2025-07-25 08:47:56 -06:00
Adam Wilson
ae279a512d log LLM config 2025-07-23 20:21:42 -06:00
Adam Wilson
cb92890bb9 break tests into separate files; test 0 results 2025-07-23 19:06:27 -06:00
Adam Wilson
41afb99622 dependency fixes, test setup 2025-07-18 18:18:56 -06:00
Adam Wilson
fec4d711bf implement singular guidelines calls in main service 2025-07-18 12:33:51 -06:00
Adam Wilson
f3dd8e9208 more for templates 2025-07-16 21:07:37 -06:00
Adam Wilson
1dba565236 service implementations 2025-07-16 20:21:10 -06:00
Adam Wilson
cd0e4b9de9 building guidelines services 2025-07-15 21:19:28 -06:00
Adam Wilson
51cce1545a few shot template WIP 2025-07-12 20:35:43 -06:00
Adam Wilson
c788431416 prompt template IDs; fluent text generation service stubs 2025-07-12 12:18:19 -06:00
Adam Wilson
36820f9c54 pseudo-code for fluent text generation service call 2025-07-11 15:51:01 -06:00
Adam Wilson
a647060644 skip guidelines method; stubs for service calls in test class 2025-07-10 07:10:26 -06:00
Adam Wilson
b4b2d792fc more progress on fluent service call 2025-07-09 21:56:44 -06:00
Adam Wilson
af75e9aabf support prompt template loading 2025-07-07 21:38:42 -06:00
Adam Wilson
911b629217 notes on violation vs. false refusal rates, effectiveness metrics 2025-07-06 18:34:12 -06:00
Adam Wilson
7d49d160b9 more test cases and notes 2025-07-06 17:47:49 -06:00
Adam Wilson
ffa2d73ae0 guardrail analyzed response, etc. 2025-07-06 15:15:59 -06:00
Adam Wilson
a1d3a8c1b7 adjust assertions for test 3 2025-07-05 20:21:35 -06:00
Adam Wilson
640c261b26 naming updates; fix static analysis script 2025-07-05 13:01:28 -06:00
Adam Wilson
f0fcc64258 support sampling and averages during testing 2025-06-28 13:15:32 -06:00
Adam Wilson
cb1be6746f support testing malicious prompts with no guidelines 2025-06-28 12:18:35 -06:00
Adam Wilson
036d36bf4f compare math prompt completions to DAN response 2025-06-25 21:47:22 -06:00
Adam Wilson
eed481ee77 document intended test cases/methodology; math prompts 2025-06-25 15:41:11 -06:00
Adam Wilson
5022c8f45c document intended test cases/methodology 2025-06-25 15:23:56 -06:00
Adam Wilson
9057b0e977 refactor to use services instead of language model objects directly 2025-06-25 06:28:05 -06:00
Adam Wilson
c2abf2e81f more tests 2025-06-24 14:24:10 -06:00
Adam Wilson
92e00b9eb2 integration tests 2025-06-24 10:57:44 -06:00