CalvinBackup/www-project-ai-testing-guide
1
0
Fork 0
mirror of https://github.com/OWASP/www-project-ai-testing-guide.git synced 2026-06-01 03:51:42 +02:00
Code Issues Packages Projects Releases Wiki Activity

Update AITG-APP-13_Testing_for_Over-Reliance_on_AI.md

Browse Source
This commit is contained in:
Matteo Meucci
2025-11-13 20:45:10 +01:00
committed by GitHub
parent aab169b2fa
commit ff2f879937
1 changed files with 4 additions and 7 deletions
Download Patch File Download Diff File Expand all files Collapse all files
Document/content/tests/AITG-APP-13_Testing_for_Over-Reliance_on_AI.md
+4 -7
View File
@@ -1,4 +1,4 @@
## AITG-APP-13 - Testing for Over-Reliance on AI
# AITG-APP-13 - Testing for Over-Reliance on AI
### Summary
This test focuses on identifying vulnerabilities associated with over-reliance on AI-generated outputs without sufficient human oversight, validation, or critical analysis. Over-reliance on AI can lead to poor decision-making, propagation of errors, and unintended harmful consequences, especially in high-stakes domains such as medicine, finance, and law.
@@ -31,13 +31,10 @@ AI-generated outputs in high-stakes domains must:
- **Conduct Regular Audits**: Continuously test the model against a growing list of high-stakes prompts to ensure that safeguards remain effective after model updates.
### Suggested Tools
- **Human-AI Collaboration Auditing Tools**
- Specialized tools and frameworks for auditing and enhancing effective human-AI collaboration and oversight mechanisms.
- Example Tool Link: [Human-AI Oversight Framework](https://hai.stanford.edu/policy/human-centered-ai)
- **LangChain / LlamaIndex**
- These frameworks can be used to build evaluation pipelines that programmatically check for the presence of disclaimers in model outputs.
- **Human-AI Collaboration Auditing Tools** - Specialized tools and frameworks for auditing and enhancing effective human-AI collaboration and oversight mechanisms- [Human-AI Oversight Framework](https://hai.stanford.edu/policy/human-centered-ai)
- **LangChain / LlamaIndex** - These frameworks can be used to build evaluation pipelines that programmatically check for the presence of disclaimers in model outputs.
### References
- Stanford HAI. "Human-Centered AI Framework." Stanford University. [Link](https://hai.stanford.edu/policy/human-centered-ai)
- "Human-Centered AI Framework." Stanford University. [Link](https://hai.stanford.edu/policy/human-centered-ai)
- Harvard Business Review. "Avoiding Overreliance on AI in Business Decisions." Harvard Business Review, 2021. [Link](https://hbr.org/2021/04/avoiding-overreliance-on-ai-in-business-decisions)
- Brookings Institution. "Mitigating the Risks of Overreliance on AI." Brookings, 2022. [Link](https://www.brookings.edu/research/mitigating-the-risks-of-overreliance-on-ai/)