177 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Adam Wilson	fec4d711bf	implement singular guidelines calls in main service	2025-07-18 12:33:51 -06:00
Adam Wilson	c1b4a130f9	base service class	2025-07-17 20:32:13 -06:00
Adam Wilson	f3dd8e9208	more for templates	2025-07-16 21:07:37 -06:00
Adam Wilson	1dba565236	service implementations	2025-07-16 20:21:10 -06:00
Adam Wilson	cd0e4b9de9	building guidelines services	2025-07-15 21:19:28 -06:00
Adam Wilson	51cce1545a	few shot template WIP	2025-07-12 20:35:43 -06:00
Adam Wilson	c788431416	prompt template IDs; fluent text generation service stubs	2025-07-12 12:18:19 -06:00
Adam Wilson	36820f9c54	pseudo-code for fluent text generation service call	2025-07-11 15:51:01 -06:00
Adam Wilson	a647060644	skip guidelines method; stubs for service calls in test class	2025-07-10 07:10:26 -06:00
Adam Wilson	b4b2d792fc	more progress on fluent service call	2025-07-09 21:56:44 -06:00
Adam Wilson	5470554d28	stub for fluent guidelines service	2025-07-08 17:18:57 -06:00
Adam Wilson	fabf36675d	TODO notes	2025-07-08 15:54:19 -06:00
Adam Wilson	af75e9aabf	support prompt template loading	2025-07-07 21:38:42 -06:00
Adam Wilson	911b629217	notes on violation vs. false refusal rates, effectiveness metrics	2025-07-06 18:34:12 -06:00
Adam Wilson	7d49d160b9	more test cases and notes	2025-07-06 17:47:49 -06:00
Adam Wilson	ffa2d73ae0	guardrail analyzed response, etc.	2025-07-06 15:15:59 -06:00
Adam Wilson	a1d3a8c1b7	adjust assertions for test 3	2025-07-05 20:21:35 -06:00
Adam Wilson	640c261b26	naming updates; fix static analysis script	2025-07-05 13:01:28 -06:00
Adam Wilson	a9db321597	naming updates; fix static analysis script	2025-07-05 12:58:25 -06:00
Adam Wilson	a25e8f9545	updates	2025-07-02 11:34:47 -06:00
Adam Wilson	f0fcc64258	support sampling and averages during testing	2025-06-28 13:15:32 -06:00
Adam Wilson	cb1be6746f	support testing malicious prompts with no guidelines	2025-06-28 12:18:35 -06:00
Adam Wilson	036d36bf4f	compare math prompt completions to DAN response	2025-06-25 21:47:22 -06:00
Adam Wilson	eed481ee77	document intended test cases/methodology; math prompts	2025-06-25 15:41:11 -06:00
Adam Wilson	5022c8f45c	document intended test cases/methodology	2025-06-25 15:23:56 -06:00
Adam Wilson	a530e78399	refactoring	2025-06-25 14:54:12 -06:00
Adam Wilson	9b8b6b7105	add/update services, constants	2025-06-25 12:53:24 -06:00
Adam Wilson	9057b0e977	refactor to use services instead of language model objects directly	2025-06-25 06:28:05 -06:00
Adam Wilson	c2abf2e81f	more tests	2025-06-24 14:24:10 -06:00
Adam Wilson	fc4978f43c	add RAG-based LM in conftest	2025-06-24 14:23:53 -06:00
Adam Wilson	b1cd2a02b8	adjust model config args	2025-06-24 14:23:08 -06:00
Adam Wilson	f867a4fdc9	special tokens in prompt template	2025-06-24 14:22:35 -06:00
Adam Wilson	d4b3d39cf6	fix AttributeError: 'EmbeddingModel' object has no attribute 'embed_documents'	2025-06-24 14:17:55 -06:00
Adam Wilson	f74f8274af	update DI container	2025-06-24 14:16:57 -06:00
Adam Wilson	f71a094716	add TODO list	2025-06-24 14:16:24 -06:00
Adam Wilson	8340521170	update logging	2025-06-24 14:16:08 -06:00
Adam Wilson	92e00b9eb2	integration tests	2025-06-24 10:57:44 -06:00
Adam Wilson	34ab1858c5	dependency injection container	2025-06-16 21:46:56 -06:00
Adam Wilson	b20631b9e8	comment	2025-06-12 20:46:21 -06:00
Adam Wilson	434358e8fa	call services from API instead of adapters	2025-06-12 20:43:11 -06:00
Adam Wilson	3aca7df000	refactoring LLM adapters and service layer	2025-06-12 20:25:18 -06:00
Adam Wilson	0cdce03879	abstracts and fakes	2025-06-12 20:23:31 -06:00
Adam Wilson	0b6b7b79b9	service layer tests	2025-06-12 20:22:39 -06:00
Adam Wilson	bc1093988b	test config placeholders	2025-05-30 12:46:11 -06:00
Adam Wilson	8140fa654b	init tests	2025-05-30 12:26:55 -06:00
Adam Wilson	7a32008728	logging services	2025-05-30 12:09:48 -06:00
Adam Wilson	19910c4e53	logging services	2025-05-30 12:03:11 -06:00
Adam Wilson	e2f552a1c5	initial pass at logging service	2025-05-30 08:40:38 -06:00
Adam Wilson	70d7e62ca0	back to promptinject.HijackHateHumansMini instead of DAN probe	2025-05-29 17:45:08 -06:00
Adam Wilson	4ee1b366ac	Update garak.rest.llm-rag.json	2025-05-29 15:53:45 -06:00