Adam Wilson
|
6e60ff38da
|
Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 8 [skip ci]
|
2025-08-20 17:44:08 +00:00 |
|
Adam Wilson
|
f53d2b52b0
|
Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 7 [skip ci]
|
2025-08-20 17:43:57 +00:00 |
|
Adam Wilson
|
640645d978
|
Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 2 [skip ci]
|
2025-08-20 17:43:55 +00:00 |
|
Adam Wilson
|
11f27a0c6d
|
Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 10 [skip ci]
|
2025-08-20 17:43:24 +00:00 |
|
Adam Wilson
|
067156fd60
|
Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 1 [skip ci]
|
2025-08-20 17:42:38 +00:00 |
|
Adam Wilson
|
b1bde3f93a
|
Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 6 [skip ci]
|
2025-08-20 17:42:35 +00:00 |
|
Adam Wilson
|
2b91f45b74
|
Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 4 [skip ci]
|
2025-08-20 17:42:13 +00:00 |
|
Adam Wilson
|
1a4856c746
|
Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 3 [skip ci]
|
2025-08-20 17:42:04 +00:00 |
|
Adam Wilson
|
e3fb3d809e
|
Auto-generated files from microsoft/Phi-3-mini-4k-instruct range 1-20 batch 5 [skip ci]
|
2025-08-20 17:41:57 +00:00 |
|
Adam Wilson
|
2f2eab944a
|
fix
|
2025-08-20 06:20:42 -06:00 |
|
Adam Wilson
|
c1d943195b
|
fix
|
2025-08-19 20:40:04 -06:00 |
|
Adam Wilson
|
0465d77c13
|
fix
|
2025-08-19 20:36:00 -06:00 |
|
Adam Wilson
|
cc124a91a3
|
support batch tests
|
2025-08-19 20:09:34 -06:00 |
|
Adam Wilson
|
935e5b9a5b
|
updated test results table with metrics from Aug 5 re-run of test_4
|
2025-08-05 18:30:26 -06:00 |
|
Adam Wilson
|
757eb64c35
|
new test run results for test_04_malicious_prompts_rag_and_cot
|
2025-08-05 18:24:36 -06:00 |
|
Adam Wilson
|
ab7cd56d7e
|
test archival
|
2025-08-05 18:24:15 -06:00 |
|
Adam Wilson
|
1f0bd51ff3
|
fix template
|
2025-08-05 18:23:52 -06:00 |
|
Adam Wilson
|
b7c22809a6
|
archiving tests
|
2025-08-05 18:23:06 -06:00 |
|
Adam Wilson
|
24832ef812
|
CoT + RAG template
|
2025-08-05 14:44:02 -06:00 |
|
Adam Wilson
|
ae3dd68f12
|
violation rate threshold = 15%
|
2025-08-04 22:04:10 -06:00 |
|
Adam Wilson
|
c94fbb3b9d
|
<=
|
2025-08-04 21:53:02 -06:00 |
|
Adam Wilson
|
a49fef62c5
|
use percentage not floating point
|
2025-08-04 21:51:24 -06:00 |
|
Adam Wilson
|
3b5c7b9f69
|
CI/CD test
|
2025-08-04 07:59:02 -06:00 |
|
Adam Wilson
|
5252342701
|
add violation rate column to results table, based on 100 - (< thresh %)
|
2025-08-02 10:18:13 -06:00 |
|
Adam Wilson
|
b65e531049
|
results table
|
2025-08-01 20:00:14 -06:00 |
|
Adam Wilson
|
6d5d53bad5
|
summary of test results (tests 0-4)
|
2025-08-01 19:38:19 -06:00 |
|
Adam Wilson
|
bef6ba9ef5
|
JSON results: test_00_benign_prompts_no_mitigation
|
2025-07-30 12:19:53 -06:00 |
|
Adam Wilson
|
0171af7c94
|
fix confusing log message
|
2025-07-30 11:16:24 -06:00 |
|
Adam Wilson
|
24c6eaae28
|
JSON schema script
|
2025-07-30 11:13:20 -06:00 |
|
Adam Wilson
|
378aea7a66
|
100 math prompts, not 150
|
2025-07-30 11:13:09 -06:00 |
|
Adam Wilson
|
1624019272
|
JSON results: test_01_malicious_prompts_no_mitigation
|
2025-07-30 11:08:46 -06:00 |
|
Adam Wilson
|
28518e6c17
|
fixes for basic prompt template
|
2025-07-30 07:17:48 -06:00 |
|
Adam Wilson
|
0aaa4036df
|
JSON results: test_02_malicious_prompts_cot
|
2025-07-30 05:53:33 -06:00 |
|
Adam Wilson
|
c7deca79da
|
JSON results: test_03_malicious_prompts_rag
|
2025-07-29 22:13:56 -06:00 |
|
Adam Wilson
|
4f26df0755
|
JSON results: test_04_malicious_prompts_rag_and_cot
|
2025-07-29 15:27:39 -06:00 |
|
Adam Wilson
|
cf4e2d48fa
|
JSON results: test_05_malicious_prompts_cot_with_reflexion
|
2025-07-29 11:54:00 -06:00 |
|
Adam Wilson
|
bf8396bb03
|
JSON results: test_06_malicious_prompts_rag_with_reflexion
|
2025-07-29 06:09:29 -06:00 |
|
Adam Wilson
|
df6d5e644b
|
JSON results: test_07_malicious_prompts_rag_and_cot_reflexion
|
2025-07-28 20:51:31 -06:00 |
|
Adam Wilson
|
780a4e529f
|
archive tests
|
2025-07-28 15:27:04 -06:00 |
|
Adam Wilson
|
51e966e1ec
|
escape braces
|
2025-07-28 14:55:32 -06:00 |
|
Adam Wilson
|
047c161006
|
archive test results
|
2025-07-28 13:43:28 -06:00 |
|
Adam Wilson
|
df14a01fe9
|
log full completion result with semantic similarity comparison results
|
2025-07-28 11:49:07 -06:00 |
|
Adam Wilson
|
2659e6e43c
|
more updates for reflexion
|
2025-07-28 10:31:55 -06:00 |
|
Adam Wilson
|
5bc9f480f9
|
all domain unit tests pass
|
2025-07-27 18:53:30 -06:00 |
|
Adam Wilson
|
b83553d767
|
make mitigation tests consistent
|
2025-07-27 17:44:40 -06:00 |
|
Adam Wilson
|
dcff18a058
|
logging
|
2025-07-27 17:19:07 -06:00 |
|
Adam Wilson
|
a621ad82a9
|
Reflexion guardrails updates
|
2025-07-27 16:39:06 -06:00 |
|
Adam Wilson
|
eddacd87fa
|
LLM config output
|
2025-07-27 11:21:12 -06:00 |
|
Adam Wilson
|
a7a6873e73
|
update prompt templates; support LLM config logging
|
2025-07-26 22:10:04 -06:00 |
|
Adam Wilson
|
5b27d4c2e3
|
refactor for examples
|
2025-07-26 16:31:49 -06:00 |
|