CalvinBackup/ai-llm-red-team-handbook
1
0
Fork 0
mirror of https://github.com/Shiva108/ai-llm-red-team-handbook.git synced 2026-08-27 21:30:27 +02:00
Code Issues Packages Projects Releases Wiki Activity

fix: Standardize punctuation by replacing em dashes with hyphens and update chapter numbering across handbook chapters.

Browse Source
This commit is contained in:
shiva108
2025-12-06 10:48:10 +01:00
parent ec3f0c7aab
commit c50979a222
21 changed files with 113 additions and 113 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/Chapter_09_LLM_Architectures_and_System_Components.md
+1 -1
View File
@@ -49,7 +49,7 @@ A token is not necessarily a word. It can be part of a word, a space, or a symbo
### Inspecting Tokenizers (How-To)
You can inspect how a model "sees" your prompt using the `transformers` library on your local machine (or Google Colab). This is crucial for **Token Smuggling** attacks—finding ways to encode "forbidden" words so filter keywords don't trigger.
You can inspect how a model "sees" your prompt using the `transformers` library on your local machine (or Google Colab). This is crucial for **Token Smuggling** attacks - finding ways to encode "forbidden" words so filter keywords don't trigger.
```python
from transformers import AutoTokenizer