Garak
Visit Toolgarak is an open-source LLM vulnerability scanner that identifies weaknesses like hallucination, data leakage, and prompt injection. It helps assess the safety and security of AI models.
At a glance
Trending
garak is an open-source LLM vulnerability scanner that identifies weaknesses like hallucination, data leakage, and prompt injection. It helps assess the safety and security of AI models.
Trending
About
garak is an open-source LLM vulnerability scanner designed to identify and assess weaknesses in large language models. It probes for a wide range of issues including hallucination, data leakage, prompt injection, misinformation, toxicity generation, and jailbreaks. Inspired by tools like nmap and Metasploit Framework, garak focuses on making LLMs or dialog systems fail through static, dynamic, and adaptive probes. It supports various LLM platforms such as Hugging Face, OpenAI, AWS Bedrock, Replicate, Cohere, and Groq, and can be installed via pip or cloned from source. The tool provides detailed logging and reporting in JSONL format, helping developers and researchers understand and mitigate risks in their AI models.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending