PromptHub
                
                Test, collaborate, version, and deploy prompts, from a single place, with PromptHub. Put an end to continuous copy and pasting and utilize variables to simplify prompt creation. Say goodbye to spreadsheets, and easily compare outputs side-by-side when tweaking prompts. Bring your datasets and test prompts at scale with batch testing. Make sure your prompts are consistent by testing with different models, variables, and parameters. Stream two conversations and test different models, system messages, or chat templates. Commit prompts, create branches, and collaborate seamlessly. We detect prompt changes, so you can focus on outputs. Review changes as a team, approve new versions, and keep everyone on the same page. Easily monitor requests, costs, and latencies. PromptHub makes it easy to test, version, and collaborate on prompts with your team. Our GitHub-style versioning and collaboration makes it easy to iterate your prompts with your team, and store them in one place. 
                Learn more
             
        
            
            
            
            
            
                
                HoneyHive
                
                AI engineering doesn't have to be a black box. Get full visibility with tools for tracing, evaluation, prompt management, and more. HoneyHive is an AI observability and evaluation platform designed to assist teams in building reliable generative AI applications. It offers tools for evaluating, testing, and monitoring AI models, enabling engineers, product managers, and domain experts to collaborate effectively. Measure quality over large test suites to identify improvements and regressions with each iteration. Track usage, feedback, and quality at scale, facilitating the identification of issues and driving continuous improvements. HoneyHive supports integration with various model providers and frameworks, offering flexibility and scalability to meet diverse organizational needs. It is suitable for teams aiming to ensure the quality and performance of their AI agents, providing a unified platform for evaluation, monitoring, and prompt management. 
                Learn more
             
        
            
            
            
            
            
                
                Braintrust
                
                Braintrust is the enterprise-grade stack for building AI products. From evaluations, to prompt playground, to data management, we take uncertainty and tedium out of incorporating AI into your business. Compare multiple prompts, benchmarks, and respective input/output pairs between runs. Tinker ephemerally, or turn your draft into an experiment to evaluate over a large dataset. Leverage Braintrust in your continuous integration workflow so you can track progress on your main branch, and automatically compare new experiments to what’s live before you ship. Easily capture rated examples from staging & production, evaluate them, and incorporate them into “golden” datasets. Datasets reside in your cloud and are automatically versioned, so you can evolve them without the risk of breaking evaluations that depend on them.
                Learn more
             
        
            
            
            
            
            
                
                Agenta
                
                Collaborate on prompts, evaluate, and monitor LLM apps with confidence. Agenta is a comprehensive platform that enables teams to quickly build robust LLM apps. Create a playground connected to your code where the whole team can experiment and collaborate. Systematically compare different prompts, models, and embeddings before going to production. Share a link to gather human feedback from the rest of the team. Agenta works out of the box with all frameworks (Langchain, Lama Index, etc.) and model providers (OpenAI, Cohere, Huggingface, self-hosted models, etc.). Gain visibility into your LLM app's costs, latency, and chain of calls. You have the option to create simple LLM apps directly from the UI. However, if you would like to write customized applications, you need to write code with Python. Agenta is model agnostic and works with all model providers and frameworks. The only limitation at present is that our SDK is available only in Python.
                Learn more