From 747db98ee646bb2c7f2f31f13b75d9b2f47ab4f9 Mon Sep 17 00:00:00 2001 From: AndrewZhou924 Date: Sat, 8 Aug 2026 12:36:28 +0800 Subject: [PATCH] Classify Magic Words as a related embedding attack --- README.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/README.md b/README.md index 37ded35..b87f33e 100644 --- a/README.md +++ b/README.md @@ -491,6 +491,12 @@ This historical list includes embedding inversion, prompt inversion, memorizatio - [Blog 2020] Attacks against Machine Learning Privacy (Part 1): Model Inversion Attacks with the IBM-ART Framework [[blog]](https://franziska-boenisch.de/posts/2020/12/model-inversion/) - [Slides 2020] ML and DP [[slides]](https://www.cs.toronto.edu/~toni/Courses/Fairness/Lectures/ML-and-DP-v2.pdf) +### Related representation-space attacks (not model inversion) + +These papers affect interfaces also studied by model inversion research, but do not reconstruct private training information and are therefore listed separately. + +- [arXiv 2025] (black- and white-box) **Jailbreaking LLMs' Safeguard with Universal Magic Words for Text Embedding Models.** Exploits embedding-distribution bias to find universal suffixes that manipulate cosine similarity and bypass embedding-based safeguards. [[paper]](https://arxiv.org/abs/2501.18280) + ## Contributing Contributions are welcome through pull requests or issues. Please use official publisher, proceedings, OpenReview, ACL Anthology, PMLR, CVF/ECVA, USENIX, DOI, or arXiv links whenever possible.