c99d2969f3
Refine testing documentation for prompt disclosure
...
Updated sections for clarity and consistency, including test objectives, expected outputs, and suggested tools.
2025-10-30 17:38:58 +01:00
d2b2f3b057
Refine content and headings for agentic behavior testing
...
Updated section headings for consistency and clarity. Revised text for better readability and precision regarding agentic behavior testing.
2025-10-30 17:22:31 +01:00
88f15ccb7d
Revise section titles for clarity in testing guidelines
...
Updated section titles and clarified testing instructions for unsafe outputs.
2025-10-30 17:18:32 +01:00
8bd00636cd
Revise section titles in input leakage testing doc
...
Updated section titles for clarity in testing documentation.
2025-10-30 17:08:58 +01:00
dac1a442f4
Revise test documentation for sensitive data leakage
...
Updated sections for clarity and consistency in testing documentation.
2025-10-30 17:05:34 +01:00
1ca047f15a
Update testing document for indirect prompt injection
2025-10-30 17:03:10 +01:00
8a6445b6ae
Update testing document for prompt injection techniques
2025-10-30 17:01:39 +01:00
76ffd748ba
+ Tools vulnerabilities
2025-10-28 09:44:46 +01:00
e6cc4ffb64
+ MCP indirect prompt injection
2025-10-28 09:44:33 +01:00
6a81e0318c
Add reference to Echo Chamber attack blog
2025-10-16 17:21:47 +02:00
aaffd7e14c
Merge pull request #27 from DotDotSlashRepo/main
...
Enhancements to testcases
2025-10-10 10:40:18 +02:00
c0c38b582e
Merge pull request #32 from zangobot/main
...
Include more testing tools, by dividing them between general-purpouse or domain-specific
2025-09-09 16:37:06 +02:00
0749eeda55
Update AITG-MOD-01_Testing_for_Evasion_Attacks.md
...
Removed typo
2025-09-02 11:21:23 +02:00
4182d8f869
Update AITG-APP-04_Testing_for_Input_Leakage.md
...
Co-authored-by: Yoni Birman <birmanbirman@gmail.com >
2025-08-31 23:13:40 +03:00
296224d780
Update AITG-APP-04_Testing_for_Input_Leakage.md
...
adding adversarial input test cases
2025-08-13 11:46:54 +03:00
0ed6bb99ad
added secml-torch and adv-lib, updated description of deepsec
2025-08-08 10:16:15 +02:00
be0385d8cf
Update AITG-MOD-01_Testing_for_Evasion_Attacks.md
...
Update AI security testing tools by adding difference between general-purpose and domain-specific libraries
2025-08-08 09:57:15 +02:00
3bd5536fbd
Update AITG-APP-05_Testing_for_Unsafe_Outputs.md
...
fixed a typo
2025-08-05 16:24:06 +05:30
e5e95445cb
Update AITG-APP-01_Testing_for_Prompt_Injection.md
...
added more examples of filter bypass while attempting to extract sensitive information
2025-08-05 16:21:26 +05:30
22eaecdd59
Update AITG-APP-03_Testing_for_Sensitive_Data_Leak.md
...
Added additional prompts on testing for implementation details leak
2025-08-05 15:56:08 +05:30
befe2755c7
Introduced Debunking tests and a differentiation between "Factuality and Misinformation" and "Debunking" hallucinations. As described by Giskard in the Phrase benchmark.
2025-08-03 14:34:38 +02:00
d27026fda7
Merge branch 'OWASP:main' into main
2025-07-25 20:30:56 +02:00
0dd87354da
1. Specified that temperature=0 does not imply reproducibility ( https://arxiv.org/pdf/2506.09501 )
...
2. Pointed out that LLMs are generally less secure in low-resource languages
3. Made some order on the payloads for the bias test, now it using always the same base example.
2025-07-25 20:26:32 +02:00
897c532bba
+ Planning instructions to avoid issues with token consumption
2025-07-25 12:18:11 +02:00
9da16a16c1
Correction of the readme to refer to the correct changed test
2025-07-17 15:22:07 +02:00
977235af4d
Introduction of the AITG-APP-10_Testing_for_Content_Bias.md, with tests to detect biased decisions made by the AI System.
2025-07-17 15:16:22 +02:00
49ee4b9d6c
The unsafe output test now includes hate releated unsafe content as part of the tests.
...
AITG-APP-10_Testing_for_Harmful_Content_Bias.md replaced with AITG-APP-10_Testing_for_Content_Bias.md, and now it focuses on the detection of biases contened in the generated outputs.
2025-07-17 15:14:33 +02:00
71b4f26900
Merge pull request #20 from fedric95/main
2025-07-12 21:30:58 +04:00
198167aebe
- Introduced the necessity of defining a safety taxonomy before conducting the tests: the definition of what is safe and what is unsafe depends on the application.
...
- Linked an existing safety taxonomy
- Added examples of moderation models
- Removed most of the references to the concept of bias. They should be addressed in another test.
TO-DO
- Include tests that consider the potential multimodal nature of the application (right now it is more text-only)
- Make a specific test to evaluate the biases of the AI application under test and remove all the references to biases in this test
2025-07-12 19:12:00 +02:00
5dbedf3dc3
Prompt Injection Techniques section addeded
2025-07-12 13:51:10 +02:00
5a434e776b
Update in typo tricks
2025-07-12 12:35:05 +02:00
a56ba3f4e6
+ Echo Chamber Attack
2025-07-12 12:24:58 +02:00
b483d240cf
+ AntiGPT reference
2025-07-12 11:53:03 +02:00
abfcbde568
+ AntiGPT Prompt Injection
2025-07-12 11:49:27 +02:00
e754867dd5
fixing typos in multiple texts.
2025-06-29 13:48:42 +02:00
a50c0ceb65
Fix copy/paste error in AITG-INF-02
2025-06-26 18:36:36 +02:00
d390fa1605
Add some attack vectors and some additional notes to AITG-INF-02
2025-06-26 18:29:32 +02:00
77ebe9e3b5
Add prompt disclosure techniques
2025-06-26 16:42:50 +02:00
15218fd5cb
Add direct tool invocation sections
2025-06-26 16:42:37 +02:00
29c2bcfeca
Add XSS attack vectors
2025-06-26 16:42:21 +02:00
249ab5fb84
Add some data leaks related to tool list and reasoning
2025-06-26 16:42:11 +02:00
25fc713549
Added some prompt injection techniques
2025-06-26 16:41:44 +02:00
0a93f78ebd
Add EchoLeak technique to indirect prompt injection testing
...
- Added Reference-Style Markdown Injection (EchoLeak Technique) section
- Included real-world example with CVE-2025-32711 from Aim Security Labs
- Enhanced testing methodology for markdown-based data exfiltration attacks
2025-06-25 23:39:39 -05:00
392f1a10e8
docs: fix README spacing, prompt-injection typos, and meta tag property
2025-06-25 16:22:14 -04:00
743966aa74
Merge pull request #3 from SitaRamSai/fix/spelling-corrections-test-files
...
fix: correct spelling errors in test documentation files
2025-06-25 19:11:01 +02:00
a1f115010a
fix: correct spelling errors in test documentation files
...
- Fix 'system prompots' to 'system prompts' in AITG-APP-01
- Fix 'confidetial' to 'confidential' in AITG-APP-04
- Fix 'input.s.' to 'input.' in AITG-APP-04
- Fix 'esearch efforts' to 'Research efforts' in AITG-APP-07
- Fix 'How to test for Al' to 'How to test for AI' in AITG-APP-11
- Fix 'GaraK . PAckage Hallucionantion' to 'Garak - Package Hallucination' in AITG-INF-01
These corrections improve documentation quality and readability across the AI Testing Guide test specifications.
2025-06-25 11:59:29 -05:00
8e104d7419
Add more testing cases, replace links, mentiones to app security
2025-06-24 17:30:43 +02:00
36649a80ca
Delete Document/content/tests/a.md
2025-06-18 11:53:41 +02:00
fd9cca0afa
Delete Document/content/tests/AI_MODEL_TESTING.md
2025-06-18 11:41:34 +02:00
c32e0ea25c
Delete Document/content/tests/AI_INFRASTRUCTURE_TESTING.md
2025-06-18 11:41:16 +02:00
Matteo Meucci