Skip to content

Issues: leondz/garak

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

285 Open 202 Closed
285 Open 202 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

add attack vector & impact info to probes probes Content & activity of LLM probes
#727 opened Jun 6, 2024 by leondz
4 tasks
add "done" entry to report.jsonl reporting Reporting, analysis, and other per-run result functions
#726 opened Jun 6, 2024 by leondz
garak.analyze.report_digest html output skips mention of probes used if the module score is 100% bug Something isn't working reporting Reporting, analysis, and other per-run result functions
#725 opened Jun 6, 2024 by leondz
give more friendly message when openaicompatible/nim named model not found generators Interfaces with LLMs ux Interface & interaction improvements
#724 opened Jun 6, 2024 by leondz
don't do a tqdm when generating just one item cli Command-line interface functions generators Interfaces with LLMs
#723 opened Jun 5, 2024 by leondz
InferenceEndpoint Generator fails for AWS because of missing Authorization header generators Interfaces with LLMs
#722 opened Jun 4, 2024 by erikinfo
@jmartin-tech
4
Contributing to examples or tutorials
#721 opened Jun 4, 2024 by cyberholics
2
add hooks in base.Detector detectors work on code that inherits from or manages Detector enhancement Architectural upgrades quality-speed This affects the speed of program use
#720 opened Jun 4, 2024 by leondz
4 tasks
stop instantiating detectors in analyze.report_digest detectors work on code that inherits from or manages Detector enhancement Architectural upgrades
#719 opened Jun 3, 2024 by leondz
octo generator loads slow generators Interfaces with LLMs quality-speed This affects the speed of program use
#716 opened Jun 3, 2024 by leondz
generators: move read timeout up to global/base.Generator config item generators Interfaces with LLMs
#715 opened May 31, 2024 by leondz
refactor detectors.dan detectors work on code that inherits from or manages Detector enhancement Architectural upgrades
#714 opened May 31, 2024 by leondz
@erickgalinkin
tests: check plugin modules for classes that aren't picked up by plugin enumeration tests Testing-related
#713 opened May 31, 2024 by leondz
probe or buff: non-standard unicode buffs Functions related to buffs (fuzzing/augmentation) new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#704 opened May 28, 2024 by leondz
probe: polyglo toxicity prompts enhancement Architectural upgrades new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#700 opened May 25, 2024 by leondz
reporting: update quality taxonomy & probes reporting Reporting, analysis, and other per-run result functions
#699 opened May 24, 2024 by leondz release 0.9.1
reporting: separate data and presentation reporting Reporting, analysis, and other per-run result functions
#698 opened May 24, 2024 by leondz
test: generator methods should return objects of correct type generators Interfaces with LLMs tests Testing-related
#695 opened May 23, 2024 by leondz
1
generators: openrouter generators Interfaces with LLMs new plugin Describes an entirely new probe, detector, generator or harness
#692 opened May 22, 2024 by leondz
generator: phi-3 multimodal nim generators Interfaces with LLMs new plugin Describes an entirely new probe, detector, generator or harness
#691 opened May 22, 2024 by leondz
probe: persuasive jailbreak new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#683 opened May 14, 2024 by leondz
inaccurate detection results for FalseAssertion50 bug Something isn't working detectors work on code that inherits from or manages Detector
#681 opened May 13, 2024 by JKL98ISR
1
documentation: make contributing doc really clear documentation Improvements or additions to documentation
#680 opened May 13, 2024 by leondz
17 tasks
release 0.9.1
re-organise donotanswer prompts probes Content & activity of LLM probes
#676 opened May 10, 2024 by leondz
3 tasks
release 0.9.1
Deprecate print() in logic areas; enable output separation enhancement Architectural upgrades
#675 opened May 10, 2024 by leondz
8 tasks
ProTip! Type g i on any issue or pull request to go back to the issue listing page.