garak
garak checks if an LLM can be made to fail in a way we don't want. garak probes for hallucination, data leakage, prompt injection, misinformation, toxicity generation, jailbreaks, and many other weaknesses. garak's a free tool, we love developing it and are always interested in adding functionality to support applications. garak is a command-line tool, it's developed in Linux and OSX. Just grab it from PyPI and you should be good to go. The standard pip version of garak is updated periodically. garak has its own dependencies, you can to install garak in its own Conda environment. garak needs to know what model to scan, and by default, it'll try all the probes it knows on that model, using the vulnerability detectors recommended by each probe. For each probe loaded, garak will print a progress bar as it generates. Once the generation is complete, a row evaluating that probe's results on each detector is given.
Learn more
pywinauto
pywinauto is a set of python modules to automate the Microsoft Windows GUI. At its simplest it allows you to send mouse and keyboard actions to Windows dialogs and controls. pywinauto can be installed with pip and conda. Python is a great programming language, but there are no automation tools that were Pythonic (very few libraries were implemented in Python). The very first necessary thing is to determine which accessibility technology (pywinauto’s backend) could be used for your application. First, you should start your application or connect to an existing app instance. It can be done with an application object. It’s a core concept for the high-level pywinauto API. You are able to describe any window or control approximately or in more detail even if it doesn’t exist yet or is already closed. Window specification also keeps the information about the matching/search algorithms that will be used to get a real window or control.
Learn more
PyPI
PyPI is the official repository for Python software packages, hosting hundreds of thousands of projects that developers can publish and users can discover and install. It supports both source distributions (“sdists”) and pre-built binary “wheels”, allowing packages to include native extensions for different platforms. Projects on PyPI consist of multiple releases, each of which can include various files for different operating systems or Python versions. Metadata for each package includes things like version number, dependencies, licensing, classifiers, description (including rendering Markdown or reStructuredText), and other information that tools like pip use to resolve, download, and install the correct package. PyPI provides search and filtering based on package metadata, letting users find what they need via keywords, compatibility, or other package attributes.
Learn more
Posit
Posit builds tools that help data scientists work more efficiently, collaborate seamlessly, and share insights securely across their organizations. Its Positron code editor provides the speed of an interactive console combined with the power to build, debug, and deploy data-science workflows in Python and R. Posit’s platform enables teams to scale open-source data science, offering enterprise-ready capabilities for publishing, sharing, and operationalizing applications. Companies rely on Posit’s secure infrastructure to host Shiny apps, dashboards, APIs, and analytical reports with confidence. Whether using open-source packages or cloud-based solutions, Posit supports reproducible, high-quality work at every stage of the data lifecycle. Trusted by millions of users—and more than half of the Fortune 100—Posit empowers professionals across industries to innovate with data.
Learn more