Langtest
Visit ToolLangTest is a Testing & QA tool that delivers safe and effective language models. It allows users to generate and execute over 60 distinct types of tests with a single line of code.
At a glance
Trending
LangTest is a Testing & QA tool that delivers safe and effective language models. It allows users to generate and execute over 60 distinct types of tests with a single line of code.
Trending
About
LangTest is an open-source library designed to deliver safe and effective language models by providing comprehensive testing and evaluation capabilities. It enables users to generate and execute more than 60 distinct types of tests with just one line of code, covering robustness, bias, representation, fairness, and accuracy. The tool supports popular NLP frameworks like Spark NLP, Hugging Face, and Transformers, and is capable of testing Large Language Models (LLMs) from OpenAI, Cohere, AI21, and Azure-OpenAI for various tasks including question answering, toxicity, and summarization. LangTest also facilitates automatic augmentation of training data based on test results for select models and provides a range of benchmark datasets to challenge and enhance language models.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending