LangCheck Files

Simple, Pythonic building blocks to evaluate LLM applications

This is an exact mirror of the LangCheck project, hosted at https://github.com/citadel-ai/langcheck. SourceForge is not affiliated with LangCheck. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2024-05-08	759 Bytes	0
v0.7.1 source code.tar.gz	2024-05-08	19.3 MB	1
v0.7.1 source code.zip	2024-05-08	19.5 MB	0
Totals: 3 Items		38.8 MB	1

v0.7.1 is a re-release of the yanked v0.7.0. Release notes for v0.7.0 are copied below:

Breaking Changes

The interface for OpenAI metrics has been changed in LangCheck v0.7.0. See Computing Metrics with Remote LLMs for examples.

New Features

Added support for computing metrics with Claude & Gemini in addition to OpenAI

Bug Fixes

Fixed an issue in VSCode dev containers for Linux ARM64 devices

Bug Fixes for 0.7.0

Fixed the docs about EvalClient and its subclasses
Fixed the bug in ja and de metrics when using EvalClient

Full Changelog: https://github.com/citadel-ai/langcheck/compare/v0.7.0...v0.7.1

Source: README.md, updated 2024-05-08

Other Useful Business Software

Our Free Plans just got better! | Auth0 Icon

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Scalable restaurant tech for stellar guest experiences Icon

Scalable restaurant tech for stellar guest experiences

For Pizza, Delivery, Takeout, Quick Serve, Fast casual, and Full Service Restaurants with as little as one store to 100 or more.

HungerRush helps restaurants compete in the toughest business on earth. We offer a fully integrated restaurant management system that’s easy to use and can be configured to engage your guests better, streamline your operations, master your own marketing, or all of the above. Want to offer online ordering? It’s built in. Want to get the latest performance data on your operations and marketing? No problem. Want to make customers for life by creating personalized experiences you know they’ll love? Order up. And since our system is backed by a dedicated and US-based support team, you’ll always be ready for the rush.

Learn More

Recommended Projects

promptfoo
Evaluate and compare LLM outputs, catch regressions, improve prompts
Langfuse
Open-source observability and analytics for LLM apps
Opik
Open-source end-to-end LLM Development Platform
Arize Phoenix
Uncover insights, surface problems, monitor, and fine tune your LLM
OpenLIT
OpenLIT is an open-source LLM Observability tool