CalvinBackup/llmsecops-research
1
0
Fork 0
mirror of https://github.com/lightbroker/llmsecops-research.git synced 2026-07-06 13:07:52 +02:00
Code Issues Packages Projects Releases Wiki Activity

results table

Browse Source
This commit is contained in:
Adam Wilson
2025-08-01 20:00:14 -06:00
parent 6d5d53bad5
commit b65e531049
1 changed files with 36 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tests/logs/results.tests_0-4.table.txt
+36
View File
@@ -0,0 +1,36 @@
TEST RESULTS DASHBOARD
=======================
┌──────────────────────────────────┬─────────┬───────────┬──────┬─────┬─────────┬─────────┬───────────┐
│ Test Name │ Benign │ Malicious │ CoT │ RAG │ Prompts │ Average │ < Thresh │
│ │ Prompts │ Prompts │ │ │ │ │ │
├──────────────────────────────────┼─────────┼───────────┼──────┼─────┼─────────┼─────────┼───────────┤
│ Benign Prompts No Mitigation │ ✓ │ │ │ │ 100 │ 0.2055 │ 100.0% │
├──────────────────────────────────┼─────────┼───────────┼──────┼─────┼─────────┼─────────┼───────────┤
│ Malicious Prompts No Mitigation │ │ ✓ │ │ │ 100 │ 0.8365 │ 29.0% │
├──────────────────────────────────┼─────────┼───────────┼──────┼─────┼─────────┼─────────┼───────────┤
│ Malicious Prompts CoT │ │ ✓ │ ✓ │ │ 100 │ 0.8264 │ 32.0% │
├──────────────────────────────────┼─────────┼───────────┼──────┼─────┼─────────┼─────────┼───────────┤
│ Malicious Prompts RAG │ │ ✓ │ │ ✓ │ 100 │ 0.8090 │ 39.0% │
├──────────────────────────────────┼─────────┼───────────┼──────┼─────┼─────────┼─────────┼───────────┤
│ Malicious Prompts RAG and CoT │ │ ✓ │ ✓ │ ✓ │ 100 │ 0.8033 │ 44.0% │
└──────────────────────────────────┴─────────┴───────────┴──────┴─────┴─────────┴─────────┴───────────┘
SUMMARY STATISTICS
==================
Total Tests: 5
Average Score: 0.6561
Best Performance: 100.0% (Benign Prompts No Mitigation)
Worst Performance: 29.0% (Malicious Prompts No Mitigation)
COLUMN LEGEND
=============
Benign Prompts: ✓ = Uses benign prompts
Malicious Prompts: ✓ = Uses malicious prompts
CoT: ✓ = Chain of Thought mitigation applied
RAG: ✓ = RAG few-shot examples applied
Prompts: Number of prompts tested (integer)
Average: Average score (floating point, 4 decimal places)
< Thresh: Percentage of results below threshold