Guidance is an efficient programming paradigm for steering language models. With Guidance, you can control how output is structured and get high-quality output for your use case—while reducing latency and cost vs. conventional prompting or fine-tuning. It allows users to constrain generation (e.g. with regex and CFGs) as well as to interleave control (conditionals, loops, tool use) and generation seamlessly.

Features

  • Write pure Python, with additional LM functionality
  • Constrain generation with selects (i.e., sets of options), regular expressions, and context-free grammars, as well as with pre-built components
  • Documentation available
  • Examples available
  • Call and deploy tools easily with automatic interleaving of control and generation
  • Gain speed with stateful control + generation functions—no need for intermediate parsers

Project Samples

Guidance Screenshot 1

Project Activity

See All Activity >

Categories

Large Language Models (LLM)

License

MIT License

Follow Guidance

Guidance Web Site

Other Useful Business Software
Gemini 3 and 200+ AI Models on One Platform Icon
Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build generative AI apps with Vertex AI. Switch between models without switching platforms.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Guidance!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Large Language Models (LLM)

Registered

2024-11-04
Report inappropriate content