[Doc] Fixing typos in diverse files

This commit is contained in:
Didier Durand
2025-11-27 06:41:33 +01:00
parent fd6eebce92
commit 85ac17208c
4 changed files with 10 additions and 10 deletions
@@ -78,7 +78,7 @@ Conducting a purely black-box test on an LLM/GenAI system, especially if it uses
The following **limitations** should be taken into account when planning the assessment activities with a **black-box approach**:
- LLM models are composed of **numerical weights and mathematical functions**, not following a workflow described in source code. Unlike traditional applications, where analyzing the source code usually makes it possible to identify the presence or the absence of specific issues, **in GenAI applications this can be complex or not feasible at all**.
- Many LLM models use a **temperature** value greater than zero. The temperature is a parameter that controls the randomness of the models output. A higher temperature increases randomness and "creativity" by sampling from a wider range of possible tokens, producing more diverse and less deterministic outputs. This potentially causes the need to **repeat attack vectors multiple times** as well as the possibility that results may be **hard to replicate**. Even when the temperature is equal to zero, the non-associative property of floating-point arithmetic, can make the results non reproducible and significantly different when changing the evaluation batch size, number of GPUs, or GPU versions.
- Many LLM models use a **temperature** value greater than zero. The temperature is a parameter that controls the randomness of the models output. A higher temperature increases randomness and "creativity" by sampling from a wider range of possible tokens, producing more diverse and less deterministic outputs. This potentially causes the need to **repeat attack vectors multiple times** as well as the possibility that results may be **hard to replicate**. Even when the temperature is equal to zero, the non-associative property of floating-point arithmetic, can make the results non-reproducible and significantly different when changing the evaluation batch size, number of GPUs, or GPU versions.
- **Guardrails** are often themselves implemented using LLM models, which further complicates the analysis.
- In a GenAI application composed of **multiple agents**, the users input is typically included in an initial prompt, and the output of the first LLM agent then becomes the input for the next one. This process can repeat multiple times, depending on the GenAI systems architecture and the specific input provided by the user. In an architecture like this, effectively verifying all the different components of the application is particularly complex, and **the time and number of requests required for such an analysis can be prohibitive or, in some cases, not feasible at all**.
- Many GenAI applications rely on **external models provided by major players in the industry**. These models usually have a **cost based on the number of tokens processed for both input and output**. For some models, this cost can be significant and must be taken into account **before considering large-scale automated testing**. For this reason, such applications often have thresholds in place to limit token consumption, and uncontrolled use of tokens can lead to a **Denial of Service (DoS) or a Denial of Wallet (DoW) condition**. It is also important to consider that in a multi-agent system, token consumption is not limited to the users input and the applications final output, but also includes all intermediate prompts and outputs exchanged between agents. This often results in a significant increase in overall token usage.