Commit Graph

154 Commits

Author SHA1 Message Date
Adam Wilson
eed481ee77 document intended test cases/methodology; math prompts 2025-06-25 15:41:11 -06:00
Adam Wilson
5022c8f45c document intended test cases/methodology 2025-06-25 15:23:56 -06:00
Adam Wilson
a530e78399 refactoring 2025-06-25 14:54:12 -06:00
Adam Wilson
9b8b6b7105 add/update services, constants 2025-06-25 12:53:24 -06:00
Adam Wilson
9057b0e977 refactor to use services instead of language model objects directly 2025-06-25 06:28:05 -06:00
Adam Wilson
c2abf2e81f more tests 2025-06-24 14:24:10 -06:00
Adam Wilson
fc4978f43c add RAG-based LM in conftest 2025-06-24 14:23:53 -06:00
Adam Wilson
b1cd2a02b8 adjust model config args 2025-06-24 14:23:08 -06:00
Adam Wilson
f867a4fdc9 special tokens in prompt template 2025-06-24 14:22:35 -06:00
Adam Wilson
d4b3d39cf6 fix AttributeError: 'EmbeddingModel' object has no attribute 'embed_documents' 2025-06-24 14:17:55 -06:00
Adam Wilson
f74f8274af update DI container 2025-06-24 14:16:57 -06:00
Adam Wilson
f71a094716 add TODO list 2025-06-24 14:16:24 -06:00
Adam Wilson
8340521170 update logging 2025-06-24 14:16:08 -06:00
Adam Wilson
92e00b9eb2 integration tests 2025-06-24 10:57:44 -06:00
Adam Wilson
34ab1858c5 dependency injection container 2025-06-16 21:46:56 -06:00
Adam Wilson
b20631b9e8 comment 2025-06-12 20:46:21 -06:00
Adam Wilson
434358e8fa call services from API instead of adapters 2025-06-12 20:43:11 -06:00
Adam Wilson
3aca7df000 refactoring LLM adapters and service layer 2025-06-12 20:25:18 -06:00
Adam Wilson
0cdce03879 abstracts and fakes 2025-06-12 20:23:31 -06:00
Adam Wilson
0b6b7b79b9 service layer tests 2025-06-12 20:22:39 -06:00
Adam Wilson
bc1093988b test config placeholders 2025-05-30 12:46:11 -06:00
Adam Wilson
8140fa654b init tests 2025-05-30 12:26:55 -06:00
Adam Wilson
7a32008728 logging services 2025-05-30 12:09:48 -06:00
Adam Wilson
19910c4e53 logging services 2025-05-30 12:03:11 -06:00
Adam Wilson
e2f552a1c5 initial pass at logging service 2025-05-30 08:40:38 -06:00
Adam Wilson
70d7e62ca0 back to promptinject.HijackHateHumansMini instead of DAN probe 2025-05-29 17:45:08 -06:00
Adam Wilson
4ee1b366ac Update garak.rest.llm-rag.json 2025-05-29 15:53:45 -06:00
Adam Wilson
3647e188e9 use DAN against RAG 2025-05-29 15:39:48 -06:00
Adam Wilson
edbdcc15b6 Merge pull request #15 from lightbroker/main
sync
2025-05-28 16:54:32 -06:00
Adam Wilson
72111919e9 Merge pull request #14 from lightbroker/remove-workflows
mark workflows as deprecated
2025-05-28 16:53:23 -06:00
Adam Wilson
597f2d69b4 Merge pull request #13 from lightbroker/development
Merge pull request #12 from lightbroker/main
2025-05-28 16:53:08 -06:00
Adam Wilson
8b42671e4a mark workflows as deprecated 2025-05-28 16:52:32 -06:00
Adam Wilson
b1a9a2f683 Merge pull request #12 from lightbroker/main
sync development to main
2025-05-28 16:49:43 -06:00
Adam Wilson
284114fbe6 Merge pull request #11 from lightbroker/dependency-cleanup
working garak test workflow; adding no-RAG version
2025-05-28 08:48:59 -06:00
Adam Wilson
121b17633e duplicate working workflow; no RAG 2025-05-28 08:48:22 -06:00
Adam Wilson
2495d72c9a 200 max attempts 2025-05-28 06:09:59 -06:00
Adam Wilson
6d6082cf00 fix garak config paths 2025-05-28 05:57:23 -06:00
Adam Wilson
5bf67d7432 fix garak config paths 2025-05-28 05:25:16 -06:00
Adam Wilson
a4f834e033 comment out misconfigured HTTP test 2025-05-28 05:19:29 -06:00
Adam Wilson
4edaf6c34a update requirements.txt 2025-05-27 11:06:33 -06:00
Adam Wilson
bfa4c82f1e Use bash script to set up workflow 2025-05-27 07:48:29 -06:00
Adam Wilson
39c779058d start splitting into classes; use env vars for foundation model file dependencies 2025-05-26 18:27:23 -06:00
Adam Wilson
8bb4a473ca restructure as domain-driven design architecture 2025-05-23 13:48:29 -06:00
Adam Wilson
ff429365ac remove unused files, imports 2025-05-21 14:00:19 -06:00
Adam Wilson
7960d225c6 reduce max tokens; refresh requirements.txt 2025-05-21 10:25:11 -06:00
Adam Wilson
ffacc738b7 single instance of LLM service objects 2025-05-20 20:06:07 -06:00
Adam Wilson
d8a6609b8b increase parallel attempts 2025-05-20 17:04:30 -06:00
Adam Wilson
6b104bfcc3 debugging in workflow 2025-05-20 16:44:08 -06:00
Adam Wilson
8266342fda debugging in workflow 2025-05-20 16:40:08 -06:00
Adam Wilson
38a346d876 fix generator_option_file ref 2025-05-20 14:51:32 -06:00