cf7df4e35c
Update AITG-MOD-01_Testing_for_Evasion_Attacks.md
2025-11-06 09:46:41 +01:00
5524bdbf6d
Update AITG-INF-06_Testing_for_Dev-Time_Model_Theft.md
2025-11-06 09:44:53 +01:00
c1895bef4a
Update AITG-INF-05_Testing_for_Fine-tuning_Poisoning.md
2025-11-06 09:43:07 +01:00
eb8f10ae03
Update AITG-INF-04_Testing_for_Capability_Misuse.md
2025-11-06 09:39:51 +01:00
2d73463083
Update AITG-INF-03_Testing_for_Plugin_Boundary_Violations.md
2025-11-05 19:54:47 +01:00
d46c835644
Update AITG-INF-02_Testing_for_Resource_Exhaustion.md
2025-11-05 19:52:36 +01:00
334c79478d
Update AITG-INF-01_Testing_for_Supply_Chain_Tampering.md
2025-11-05 19:50:04 +01:00
9b9fd9160b
Update AITG-DAT-02_Testing_for_Runtime_Exfiltration.md
2025-11-05 19:46:24 +01:00
73c7fa8aa9
Update AITG-DAT-03_Testing_for_Dataset_Diversity_and_Coverage.md
2025-11-05 19:45:30 +01:00
c44b46e4e9
Update AITG-DAT-04_Testing_for_Harmful_Content_in_Data.md
2025-11-05 19:44:47 +01:00
ff6fc599b6
Update AITG-DAT-05_Testing_for_Data_Minimization_and_Consent.md
2025-11-05 19:43:55 +01:00
bc94636d3e
Update AITG-DAT-04_Testing_for_Harmful_Content_in_Data.md
2025-11-05 19:42:07 +01:00
7d9fd59c63
Update AITG-DAT-03_Testing_for_Dataset_Diversity_and_Coverage.md
2025-11-05 19:41:07 +01:00
b9ad6c997d
Update AITG-DAT-02_Testing_for_Runtime_Exfiltration.md
2025-11-05 19:40:05 +01:00
d19e9da901
Revise testing methodology for training data exposure
...
Updated the testing methodology for training data exposure vulnerabilities in AI systems, detailing the setup and execution of tests for direct storage access and inference-based data extraction.
2025-11-05 19:37:28 +01:00
b5b74f045b
Merge pull request #45 from nhumblot/prompt-injection-structured-output-attack
...
feat: add structured output attack example with source
2025-11-05 14:51:04 +01:00
52dd155251
Rename document for prompt disclosure testing
...
Updated the title of the testing document to reflect prompt disclosure.
2025-11-02 18:57:11 +01:00
04ba8c5b43
Revise AITG-DAT-01 document for clarity and structure
...
Updated the document to improve structure and clarity, including sections on testing methodology, expected outputs, remediation strategies, and suggested tools.
2025-11-02 18:55:56 +01:00
b496d11a8b
Revise testing document for explainability and interpretability
...
Updated the document to enhance clarity and detail in the explanation of testing for explainability and interpretability in AI systems. Added specific objectives, expected outputs, remediation strategies, and suggested tools.
2025-11-02 18:22:29 +01:00
4fd6fa2000
Update AITG-APP-13_Testing_for_Over-Reliance_on_AI.md
2025-11-02 18:17:00 +01:00
4aef9d8a69
Revise testing document for toxic output
...
Updated the structure and content of the testing document to improve clarity and organization, including renaming sections and enhancing remediation strategies.
2025-11-02 18:13:23 +01:00
9c1c965948
Change headers from H3 to H2 and H4 to H3
...
Updated header levels for better document structure.
2025-11-02 18:06:23 +01:00
140f236dd4
Update headings and improve test documentation
2025-11-02 18:05:53 +01:00
6411868698
Revise section headers for testing document
...
Updated section headers to improve clarity and consistency in the testing document.
2025-11-02 17:47:23 +01:00
9d01b136f8
Revise expected output for model extraction tests
...
Updated expected output criteria for model extraction testing, clarifying fidelity levels and defensive mechanisms.
2025-11-02 17:46:43 +01:00
f36d16964d
Enhance model extraction testing documentation
...
Expanded testing documentation for model extraction attacks, including detailed payloads, prerequisites, and step-by-step instructions for data acquisition, surrogate model training, and evaluation.
2025-11-02 17:45:12 +01:00
8e55e6238d
Enhance embedding manipulation testing documentation
...
Expanded testing scenarios for embedding manipulation, including payloads and expected secure behaviors.
2025-11-02 17:28:41 +01:00
ae07885a80
Enhance documentation on embedding manipulation testing
...
Expanded the section on embedding manipulation to include detailed explanations of vulnerabilities, attack vectors, and testing objectives. Updated suggested tools for testing embedding robustness.
2025-11-02 17:23:25 +01:00
c99d2969f3
Refine testing documentation for prompt disclosure
...
Updated sections for clarity and consistency, including test objectives, expected outputs, and suggested tools.
2025-10-30 17:38:58 +01:00
d2b2f3b057
Refine content and headings for agentic behavior testing
...
Updated section headings for consistency and clarity. Revised text for better readability and precision regarding agentic behavior testing.
2025-10-30 17:22:31 +01:00
88f15ccb7d
Revise section titles for clarity in testing guidelines
...
Updated section titles and clarified testing instructions for unsafe outputs.
2025-10-30 17:18:32 +01:00
8bd00636cd
Revise section titles in input leakage testing doc
...
Updated section titles for clarity in testing documentation.
2025-10-30 17:08:58 +01:00
dac1a442f4
Revise test documentation for sensitive data leakage
...
Updated sections for clarity and consistency in testing documentation.
2025-10-30 17:05:34 +01:00
1ca047f15a
Update testing document for indirect prompt injection
2025-10-30 17:03:10 +01:00
8a6445b6ae
Update testing document for prompt injection techniques
2025-10-30 17:01:39 +01:00
76ffd748ba
+ Tools vulnerabilities
2025-10-28 09:44:46 +01:00
e6cc4ffb64
+ MCP indirect prompt injection
2025-10-28 09:44:33 +01:00
e637aa06f2
feat: add structured output attack example with source
2025-10-17 11:50:27 +02:00
6a81e0318c
Add reference to Echo Chamber attack blog
2025-10-16 17:21:47 +02:00
aaffd7e14c
Merge pull request #27 from DotDotSlashRepo/main
...
Enhancements to testcases
2025-10-10 10:40:18 +02:00
c0c38b582e
Merge pull request #32 from zangobot/main
...
Include more testing tools, by dividing them between general-purpouse or domain-specific
2025-09-09 16:37:06 +02:00
0749eeda55
Update AITG-MOD-01_Testing_for_Evasion_Attacks.md
...
Removed typo
2025-09-02 11:21:23 +02:00
4182d8f869
Update AITG-APP-04_Testing_for_Input_Leakage.md
...
Co-authored-by: Yoni Birman <birmanbirman@gmail.com >
2025-08-31 23:13:40 +03:00
296224d780
Update AITG-APP-04_Testing_for_Input_Leakage.md
...
adding adversarial input test cases
2025-08-13 11:46:54 +03:00
0ed6bb99ad
added secml-torch and adv-lib, updated description of deepsec
2025-08-08 10:16:15 +02:00
be0385d8cf
Update AITG-MOD-01_Testing_for_Evasion_Attacks.md
...
Update AI security testing tools by adding difference between general-purpose and domain-specific libraries
2025-08-08 09:57:15 +02:00
3bd5536fbd
Update AITG-APP-05_Testing_for_Unsafe_Outputs.md
...
fixed a typo
2025-08-05 16:24:06 +05:30
e5e95445cb
Update AITG-APP-01_Testing_for_Prompt_Injection.md
...
added more examples of filter bypass while attempting to extract sensitive information
2025-08-05 16:21:26 +05:30
22eaecdd59
Update AITG-APP-03_Testing_for_Sensitive_Data_Leak.md
...
Added additional prompts on testing for implementation details leak
2025-08-05 15:56:08 +05:30
befe2755c7
Introduced Debunking tests and a differentiation between "Factuality and Misinformation" and "Debunking" hallucinations. As described by Giskard in the Phrase benchmark.
2025-08-03 14:34:38 +02:00
Matteo Meucci