Commit Graph
18 Commits
Author SHA1 Message Date
Alexander Myasoedov ead8f85836 feat(feat(refusal): detect Docker/K8s sandbox escape probes (#280)): 2026-06-04 18:28:12 +03:00
Edneam be7fb1f370 fix: keep PII detection separate from refusal metrics 2026-05-14 22:42:28 +05:30
Edneam d734067ef6 test: cover PII leak detector 2026-05-14 22:31:50 +05:30
Edneam 81d2ee76c7 feat: add PII leak detector 2026-05-14 22:18:22 +05:30
Alexander Myasoedov a0b2b9ec70 feat(py upgrade): 2026-05-14 18:56:24 +03:00
Alexander Myasoedov bc7fdd7cfa fix(pc): 2026-01-28 21:04:29 +02:00
Alexander Myasoedov b38a27d78c feat: US-005 - Enhanced Refusal Detection with Hybrid Approach
Implement hybrid refusal classifier combining multiple detection methods:
- Add confidence scoring to refusal detection (HybridResult)
- Implement weighted voting with configurable thresholds
- Support require_unanimous mode for strict classification
- Add factory function create_hybrid_classifier for common setup
- Include 32 unit tests with table-driven test patterns
2026-01-28 18:52:20 +02:00
Alexander Myasoedov 32f103acbc feat: US-001 - Dual-LLM Evaluation for Attack Success Detection
Add LLM-based refusal classifier inspired by Promptmap's dual-LLM
architecture. The controller LLM evaluates whether an attack succeeded
by analyzing the target's response against pass/fail conditions.

- Create LLMRefusalClassifier plugin integrating with existing system
- Support OpenAI and Anthropic providers with lazy initialization
- Add configurable system prompts and pass/fail conditions
- Include 20 unit tests for comprehensive coverage
2026-01-28 18:18:09 +02:00
Alexander Myasoedov f19664f95c fix(pc): 2025-11-30 18:32:58 +02:00
Alexander Myasoedov b3ae0026fb fix(warnings): 2025-11-30 18:30:55 +02:00
doa ebac62e21a fix: issue #156 - move test file to tests dir 2025-03-08 19:01:57 +03:00
Alexander Myasoedov dbec27d3aa feat(Update models): 2025-01-23 00:01:54 +02:00
Alexander Myasoedov d365113440 feat(add more tests): 2024-12-02 23:49:30 +02:00
Alexander Myasoedov 430aeb68f1 fix(InconsistentVersionWarning: Trying to unpickle estimator StandardScaler): 2024-11-30 12:54:23 +02:00
Alexander Myasoedov 1ba5650036 fix(numpy issue): 2024-10-19 16:35:24 +03:00
Alexander Myasoedov d7f6c7bd30 fix(pkg_resources.open_binary): 2024-10-19 16:31:08 +03:00
Alexander Myasoedov 0ab314c367 fix(module): 2024-10-19 16:17:39 +03:00
Alexander Myasoedov ecaea7997c feat(add refusal_classifier): 2024-10-19 16:15:18 +03:00