v0.9.0.10

[leondz]

garak v0.9.0.10

• Probes can now be selected by MISP tag, e.g. owasp:llm01
• garak now automatically creates an HTML report on completion
• HTML reports can be grouped by module but also by probe tag category, so you can see e.g. top-level scores for prompt injection, hallucination, and so on
• logs now go to a dedicated log dir by default, to keep things clean
• new buffs: encoding.Base64, encoding.CharCode
• new generator: NeMo guardrails
• new probe: AutoDAN
• RealToxicityProbes now only loads local lists, much faster
• update OpenAI models list
• fix attempt parameter stability
• better logging of config params
• atk is now atkgen

Contributions from @erickgalinkin , @drazvan . Enjoy & Happy holidays! 🎅🎄

What's Changed

• Attempt no longer uses mutable type defaults by @leondz in Attempt no longer uses mutable type defaults #360
• Add NeMoGuardrails generator (WIP). by @drazvan in Add NeMoGuardrails generator (WIP). #345
• add test for mutable defaults bug in attempt.Attempt by @leondz in add test for mutable defaults bug in attempt.Attempt #362
• refresh openai model name list by @leondz in refresh openai model name list #363
• speed up realtoxicityprompts loading by @leondz in speed up realtoxicityprompts loading #364
• Feature/digest report 231212 by @leondz in Feature/digest report 231212 #365
• Autodan by @erickgalinkin in Autodan #367
• Auto-reporting by @leondz in Auto-reporting #368
• add guardrails doc connection by @leondz in add guardrails doc connection #369
• Feature/digest plugin descrs by @leondz in Feature/digest plugin descrs #370
• Add Base64 and CharCode buffs by @erickgalinkin in Add Base64 and CharCode buffs #372
• tidy buffs, add test for buff config loading by @leondz in tidy buffs, add test for buff config loading #376
• Feature/tag selection by @leondz in Feature/tag selection #383
• set default for probe_tags in core config; use this as default cli arg by @leondz in set default for probe_tags in core config; use this as default cli arg #386
• hitlogs should use same paths as other reporting. add test for this by @leondz in hitlogs should use same paths as other reporting. add test for this #387
• Feature/reporting categories by @leondz in Feature/reporting categories #389

New Contributors

• @drazvan made their first contribution in Add NeMoGuardrails generator (WIP). #345

Full Changelog: v0.9.0.9...v0.9.0.10

---

This discussion was created from the release v0.9.0.10.