Matteo Meucci and GitHub
2d73463083
Update AITG-INF-03_Testing_for_Plugin_Boundary_Violations.md
2025-11-05 19:54:47 +01:00
Matteo Meucci and GitHub
d46c835644
Update AITG-INF-02_Testing_for_Resource_Exhaustion.md
2025-11-05 19:52:36 +01:00
Matteo Meucci and GitHub
334c79478d
Update AITG-INF-01_Testing_for_Supply_Chain_Tampering.md
2025-11-05 19:50:04 +01:00
Matteo Meucci and GitHub
9b9fd9160b
Update AITG-DAT-02_Testing_for_Runtime_Exfiltration.md
2025-11-05 19:46:24 +01:00
Matteo Meucci and GitHub
73c7fa8aa9
Update AITG-DAT-03_Testing_for_Dataset_Diversity_and_Coverage.md
2025-11-05 19:45:30 +01:00
Matteo Meucci and GitHub
c44b46e4e9
Update AITG-DAT-04_Testing_for_Harmful_Content_in_Data.md
2025-11-05 19:44:47 +01:00
Matteo Meucci and GitHub
ff6fc599b6
Update AITG-DAT-05_Testing_for_Data_Minimization_and_Consent.md
2025-11-05 19:43:55 +01:00
Matteo Meucci and GitHub
bc94636d3e
Update AITG-DAT-04_Testing_for_Harmful_Content_in_Data.md
2025-11-05 19:42:07 +01:00
Matteo Meucci and GitHub
7d9fd59c63
Update AITG-DAT-03_Testing_for_Dataset_Diversity_and_Coverage.md
2025-11-05 19:41:07 +01:00
Matteo Meucci and GitHub
b9ad6c997d
Update AITG-DAT-02_Testing_for_Runtime_Exfiltration.md
2025-11-05 19:40:05 +01:00
Matteo Meucci and GitHub
d19e9da901
Revise testing methodology for training data exposure
...
Updated the testing methodology for training data exposure vulnerabilities in AI systems, detailing the setup and execution of tests for direct storage access and inference-based data extraction.
2025-11-05 19:37:28 +01:00
Matteo Meucci and GitHub
b5b74f045b
Merge pull request #45 from nhumblot/prompt-injection-structured-output-attack
...
feat: add structured output attack example with source
2025-11-05 14:51:04 +01:00
Matteo Meucci and GitHub
52dd155251
Rename document for prompt disclosure testing
...
Updated the title of the testing document to reflect prompt disclosure.
2025-11-02 18:57:11 +01:00
Matteo Meucci and GitHub
04ba8c5b43
Revise AITG-DAT-01 document for clarity and structure
...
Updated the document to improve structure and clarity, including sections on testing methodology, expected outputs, remediation strategies, and suggested tools.
2025-11-02 18:55:56 +01:00
Matteo Meucci and GitHub
b496d11a8b
Revise testing document for explainability and interpretability
...
Updated the document to enhance clarity and detail in the explanation of testing for explainability and interpretability in AI systems. Added specific objectives, expected outputs, remediation strategies, and suggested tools.
2025-11-02 18:22:29 +01:00
Matteo Meucci and GitHub
4fd6fa2000
Update AITG-APP-13_Testing_for_Over-Reliance_on_AI.md
2025-11-02 18:17:00 +01:00
Matteo Meucci and GitHub
4aef9d8a69
Revise testing document for toxic output
...
Updated the structure and content of the testing document to improve clarity and organization, including renaming sections and enhancing remediation strategies.
2025-11-02 18:13:23 +01:00
Matteo Meucci and GitHub
9c1c965948
Change headers from H3 to H2 and H4 to H3
...
Updated header levels for better document structure.
2025-11-02 18:06:23 +01:00
Matteo Meucci and GitHub
140f236dd4
Update headings and improve test documentation
2025-11-02 18:05:53 +01:00
Matteo Meucci and GitHub
6411868698
Revise section headers for testing document
...
Updated section headers to improve clarity and consistency in the testing document.
2025-11-02 17:47:23 +01:00
Matteo Meucci and GitHub
9d01b136f8
Revise expected output for model extraction tests
...
Updated expected output criteria for model extraction testing, clarifying fidelity levels and defensive mechanisms.
2025-11-02 17:46:43 +01:00
Matteo Meucci and GitHub
f36d16964d
Enhance model extraction testing documentation
...
Expanded testing documentation for model extraction attacks, including detailed payloads, prerequisites, and step-by-step instructions for data acquisition, surrogate model training, and evaluation.
2025-11-02 17:45:12 +01:00
Matteo Meucci and GitHub
8e55e6238d
Enhance embedding manipulation testing documentation
...
Expanded testing scenarios for embedding manipulation, including payloads and expected secure behaviors.
2025-11-02 17:28:41 +01:00
Matteo Meucci and GitHub
ae07885a80
Enhance documentation on embedding manipulation testing
...
Expanded the section on embedding manipulation to include detailed explanations of vulnerabilities, attack vectors, and testing objectives. Updated suggested tools for testing embedding robustness.
2025-11-02 17:23:25 +01:00
Matteo Meucci and GitHub
c99d2969f3
Refine testing documentation for prompt disclosure
...
Updated sections for clarity and consistency, including test objectives, expected outputs, and suggested tools.
2025-10-30 17:38:58 +01:00
Matteo Meucci and GitHub
d2b2f3b057
Refine content and headings for agentic behavior testing
...
Updated section headings for consistency and clarity. Revised text for better readability and precision regarding agentic behavior testing.
2025-10-30 17:22:31 +01:00
Matteo Meucci and GitHub
88f15ccb7d
Revise section titles for clarity in testing guidelines
...
Updated section titles and clarified testing instructions for unsafe outputs.
2025-10-30 17:18:32 +01:00
Matteo Meucci and GitHub
8bd00636cd
Revise section titles in input leakage testing doc
...
Updated section titles for clarity in testing documentation.
2025-10-30 17:08:58 +01:00
Matteo Meucci and GitHub
dac1a442f4
Revise test documentation for sensitive data leakage
...
Updated sections for clarity and consistency in testing documentation.
2025-10-30 17:05:34 +01:00
Matteo Meucci and GitHub
1ca047f15a
Update testing document for indirect prompt injection
2025-10-30 17:03:10 +01:00
Matteo Meucci and GitHub
8a6445b6ae
Update testing document for prompt injection techniques
2025-10-30 17:01:39 +01:00
Federico Dotta
76ffd748ba
+ Tools vulnerabilities
2025-10-28 09:44:46 +01:00
Federico Dotta
e6cc4ffb64
+ MCP indirect prompt injection
2025-10-28 09:44:33 +01:00
Nicolas Humblot
e637aa06f2
feat: add structured output attack example with source
2025-10-17 11:50:27 +02:00
marti-jorda-roca
6a81e0318c
Add reference to Echo Chamber attack blog
2025-10-16 17:21:47 +02:00
Matteo Meucci and GitHub
aaffd7e14c
Merge pull request #27 from DotDotSlashRepo/main
...
Enhancements to testcases
2025-10-10 10:40:18 +02:00
Matteo Meucci and GitHub
c0c38b582e
Merge pull request #32 from zangobot/main
...
Include more testing tools, by dividing them between general-purpouse or domain-specific
2025-09-09 16:37:06 +02:00
Luca Demetrio and GitHub
0749eeda55
Update AITG-MOD-01_Testing_for_Evasion_Attacks.md
...
Removed typo
2025-09-02 11:21:23 +02:00
4182d8f869
Update AITG-APP-04_Testing_for_Input_Leakage.md
...
Co-authored-by: Yoni Birman <birmanbirman@gmail.com >
2025-08-31 23:13:40 +03:00
Roei Arpaly and GitHub
296224d780
Update AITG-APP-04_Testing_for_Input_Leakage.md
...
adding adversarial input test cases
2025-08-13 11:46:54 +03:00
maurapintor
0ed6bb99ad
added secml-torch and adv-lib, updated description of deepsec
2025-08-08 10:16:15 +02:00
Luca Demetrio and GitHub
be0385d8cf
Update AITG-MOD-01_Testing_for_Evasion_Attacks.md
...
Update AI security testing tools by adding difference between general-purpose and domain-specific libraries
2025-08-08 09:57:15 +02:00
DotDotSlash and GitHub
3bd5536fbd
Update AITG-APP-05_Testing_for_Unsafe_Outputs.md
...
fixed a typo
2025-08-05 16:24:06 +05:30
DotDotSlash and GitHub
e5e95445cb
Update AITG-APP-01_Testing_for_Prompt_Injection.md
...
added more examples of filter bypass while attempting to extract sensitive information
2025-08-05 16:21:26 +05:30
DotDotSlash and GitHub
22eaecdd59
Update AITG-APP-03_Testing_for_Sensitive_Data_Leak.md
...
Added additional prompts on testing for implementation details leak
2025-08-05 15:56:08 +05:30
Federico Ricciuti
befe2755c7
Introduced Debunking tests and a differentiation between "Factuality and Misinformation" and "Debunking" hallucinations. As described by Giskard in the Phrase benchmark.
2025-08-03 14:34:38 +02:00
fedric95 and GitHub
d27026fda7
Merge branch 'OWASP:main' into main
2025-07-25 20:30:56 +02:00
Federico Ricciuti
0dd87354da
1. Specified that temperature=0 does not imply reproducibility ( https://arxiv.org/pdf/2506.09501 )
...
2. Pointed out that LLMs are generally less secure in low-resource languages
3. Made some order on the payloads for the bias test, now it using always the same base example.
2025-07-25 20:26:32 +02:00
federicodotta
897c532bba
+ Planning instructions to avoid issues with token consumption
2025-07-25 12:18:11 +02:00
Federico Ricciuti
9da16a16c1
Correction of the readme to refer to the correct changed test
2025-07-17 15:22:07 +02:00
