CalvinBackup/www-project-ai-testing-guide
1
0
Fork 0
mirror of https://github.com/OWASP/www-project-ai-testing-guide.git synced 2026-08-12 20:40:21 +02:00
Code Issues Packages Projects Releases Wiki Activity
246 Commits 2 Branches 0 Tags
f522948dfda42fcbef1953b6828e14729737a24b
Commit Graph
133 Commits
Author SHA1 Message Date
Matteo MeucciandGitHub f522948dfd Add OWASP AI Testing Guide and contributor list 
Introduced the OWASP AI Testing Guide, outlining its purpose, methodology, and contributors.
 2025-10-30 17:57:48 +01:00
Matteo MeucciandGitHub 5baed52ca3 Fix link to AI Application Testing section 2025-10-30 17:53:07 +01:00
Matteo MeucciandGitHub c99d2969f3 Refine testing documentation for prompt disclosure 
Updated sections for clarity and consistency, including test objectives, expected outputs, and suggested tools.
 2025-10-30 17:38:58 +01:00
Matteo MeucciandGitHub d2b2f3b057 Refine content and headings for agentic behavior testing 
Updated section headings for consistency and clarity. Revised text for better readability and precision regarding agentic behavior testing.
 2025-10-30 17:22:31 +01:00
Matteo MeucciandGitHub 88f15ccb7d Revise section titles for clarity in testing guidelines 
Updated section titles and clarified testing instructions for unsafe outputs.
 2025-10-30 17:18:32 +01:00
Matteo MeucciandGitHub 8bd00636cd Revise section titles in input leakage testing doc 
Updated section titles for clarity in testing documentation.
 2025-10-30 17:08:58 +01:00
Matteo MeucciandGitHub dac1a442f4 Revise test documentation for sensitive data leakage 
Updated sections for clarity and consistency in testing documentation.
 2025-10-30 17:05:34 +01:00
Matteo MeucciandGitHub 1ca047f15a Update testing document for indirect prompt injection 2025-10-30 17:03:10 +01:00
Matteo MeucciandGitHub 8a6445b6ae Update testing document for prompt injection techniques 2025-10-30 17:01:39 +01:00
Federico Dotta 76ffd748ba + Tools vulnerabilities 2025-10-28 09:44:46 +01:00
Federico Dotta e6cc4ffb64 + MCP indirect prompt injection 2025-10-28 09:44:33 +01:00
Marco MoranaandGitHub 9a9fa8448c Update 2.2_Appendix_E.md 
Riveduto il mapping threats CWE, rattionale, reccomendations per consisenza
 2025-10-22 15:25:50 -04:00
Marco MoranaandGitHub b99c7d9aa2 Update 2.2_Appendix_E.md 
Cambi cosmetici per chiarezza nella lettura
 2025-10-21 19:33:15 -04:00
Matteo MeucciandGitHub 24bbc66504 Update 00_Preface and Contributors.md 2025-10-21 19:36:35 +02:00
Marco MoranaandGitHub 7de813ef92 Update 2.2_Appendix_E.md 
It is really 3 steps.. so revised again
 2025-10-21 13:13:32 -04:00
Marco MoranaandGitHub 47b241cb29 Update 2.2_Appendix_E.md 
aggiunta maggiore chiarezza su come la mappatura dalla minaccia al componente SAIF, al test e alle vulnerabilità (CVEs e CWEs) di quel componente renda il report di penetration testing più concreto e orientato all’azione, facilitando la formulazione di raccomandazioni di correzione efficaci.
 2025-10-21 12:21:10 -04:00
Matteo MeucciandGitHub c9438a0f81 Update title formatting in preface document 2025-10-21 17:20:42 +02:00
Matteo MeucciandGitHub d9f4df44b1 Add preface and contributors section for AITG 
This document serves as the preface and contributor acknowledgment for the OWASP AI Testing Guide, outlining the purpose, methodology, and contributors involved in the project.
 2025-10-21 16:51:11 +02:00
marti-jorda-roca 6a81e0318c Add reference to Echo Chamber attack blog 2025-10-16 17:21:47 +02:00
Marco MoranaandGitHub f81590039d Update 2.2_Appendix_E.md 
Reorganized more organically with titles etc
 2025-10-16 08:54:50 -04:00
Marco MoranaandGitHub d8703cb1d0 Update 2.2_Appendix_E.md 
Should be the last. correction. I hope
 2025-10-15 13:57:41 -04:00
Marco MoranaandGitHub 29fd475e68 Update 2.2_Appendix_E.md 
Added more clarity to the CVE to SAIF and AI threats with an example
 2025-10-15 12:35:24 -04:00
Marco MoranaandGitHub 74cf81b771 Update 2.2_Appendix_E.md 
Revised the content to clarify and make it more actionable for pen testers
 2025-10-15 10:24:30 -04:00
Marco MoranaandGitHub ce42b98b9e Create 2.2_Appendix_E.md 2025-10-14 17:57:46 -04:00
Matteo MeucciandGitHub aaffd7e14c Merge pull request #27 from DotDotSlashRepo/main 
Enhancements to testcases
 2025-10-10 10:40:18 +02:00
Matteo MeucciandGitHub c0c38b582e Merge pull request #32 from zangobot/main 
Include more testing tools, by dividing them between general-purpouse or domain-specific
 2025-09-09 16:37:06 +02:00
Luca DemetrioandGitHub 0749eeda55 Update AITG-MOD-01_Testing_for_Evasion_Attacks.md 
Removed typo
 2025-09-02 11:21:23 +02:00
Roei ArpalyGitHubYoni Birman
 		4182d8f869 Update AITG-APP-04_Testing_for_Input_Leakage.md 
Co-authored-by: Yoni Birman <birmanbirman@gmail.com>
 2025-08-31 23:13:40 +03:00
Roei ArpalyandGitHub 296224d780 Update AITG-APP-04_Testing_for_Input_Leakage.md 
adding adversarial input test cases
 2025-08-13 11:46:54 +03:00
maurapintor 0ed6bb99ad added secml-torch and adv-lib, updated description of deepsec 2025-08-08 10:16:15 +02:00
Luca DemetrioandGitHub be0385d8cf Update AITG-MOD-01_Testing_for_Evasion_Attacks.md 
Update AI security testing tools by adding difference between general-purpose and domain-specific libraries
 2025-08-08 09:57:15 +02:00
DotDotSlashandGitHub 3bd5536fbd Update AITG-APP-05_Testing_for_Unsafe_Outputs.md 
fixed a typo
 2025-08-05 16:24:06 +05:30
DotDotSlashandGitHub e5e95445cb Update AITG-APP-01_Testing_for_Prompt_Injection.md 
added more examples of filter bypass while attempting to extract sensitive information
 2025-08-05 16:21:26 +05:30
DotDotSlashandGitHub 22eaecdd59 Update AITG-APP-03_Testing_for_Sensitive_Data_Leak.md 
Added additional prompts on testing for implementation details leak
 2025-08-05 15:56:08 +05:30
Federico Ricciuti befe2755c7 Introduced Debunking tests and a differentiation between "Factuality and Misinformation" and "Debunking" hallucinations. As described by Giskard in the Phrase benchmark. 2025-08-03 14:34:38 +02:00
fedric95andGitHub d27026fda7 Merge branch 'OWASP:main' into main 2025-07-25 20:30:56 +02:00
Federico Ricciuti 0dd87354da 1. Specified that temperature=0 does not imply reproducibility (https://arxiv.org/pdf/2506.09501) 
2. Pointed out that LLMs are generally less secure in low-resource languages
3. Made some order on the payloads for the bias test, now it using always the same base example.
 2025-07-25 20:26:32 +02:00
federicodotta 897c532bba + Planning instructions to avoid issues with token consumption 2025-07-25 12:18:11 +02:00
Federico Ricciuti 9da16a16c1 Correction of the readme to refer to the correct changed test 2025-07-17 15:22:07 +02:00
Federico Ricciuti 977235af4d Introduction of the AITG-APP-10_Testing_for_Content_Bias.md, with tests to detect biased decisions made by the AI System. 2025-07-17 15:16:22 +02:00
Federico Ricciuti 49ee4b9d6c The unsafe output test now includes hate releated unsafe content as part of the tests. 
AITG-APP-10_Testing_for_Harmful_Content_Bias.md replaced with AITG-APP-10_Testing_for_Content_Bias.md, and now it focuses on the detection of biases contened in the generated outputs.
 2025-07-17 15:14:33 +02:00
federicodotta 2b16a5c5f3 + Testing Limitations and Requirements 2025-07-13 11:21:09 +02:00
Matteo MeucciandGitHub 71b4f26900 Merge pull request #20 from fedric95/main 2025-07-12 21:30:58 +04:00
Federico Ricciuti 198167aebe - Introduced the necessity of defining a safety taxonomy before conducting the tests: the definition of what is safe and what is unsafe depends on the application. 
- Linked an existing safety taxonomy
- Added examples of moderation models
- Removed most of the references to the concept of bias. They should be addressed in another test.

TO-DO

- Include tests that consider the potential multimodal nature of the application (right now it is more text-only)
- Make a specific test to evaluate the biases of the AI application under test and remove all the references to biases in this test
 2025-07-12 19:12:00 +02:00
federicodotta 5dbedf3dc3 Prompt Injection Techniques section addeded 2025-07-12 13:51:10 +02:00
federicodotta 5a434e776b Update in typo tricks 2025-07-12 12:35:05 +02:00
federicodotta a56ba3f4e6 + Echo Chamber Attack 2025-07-12 12:24:58 +02:00
federicodotta b483d240cf + AntiGPT reference 2025-07-12 11:53:03 +02:00
federicodotta abfcbde568 + AntiGPT Prompt Injection 2025-07-12 11:49:27 +02:00
Marco MoranaandGitHub 250ead1ffc Update 2.1_Identify_AI_Threats.md 
Re-aligned all references and links
 2025-07-09 11:38:48 -04:00