Shypd.aiThe largest open index of AI toolsGuidance is an open-source programming paradigm for steering large language models. It allows users to control output structure, constrain generation with regex or CFGs, and interleave control with generation seamlessly.
Trending
About
Guidance is an efficient programming paradigm designed for steering large language models, offering precise control over their output. It enables users to structure LLM outputs, constrain generation using regular expressions or context-free grammars (CFGs), and seamlessly interleave control flow (conditionals, loops, tool use) with generation. This approach helps achieve high-quality results while potentially reducing latency and cost compared to conventional prompting or fine-tuning. Guidance provides a Pythonic interface, supporting various backends like Transformers, llama.cpp, and OpenAI. It also allows for offline grammar debugging and the creation of custom Guidance functions for complex tasks like generating JSON based on schemas.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
