Open Source Benchmark Software

wrk is a modern, command-line HTTP benchmarking tool engineered for high performance, capable of generating substantial load using a single multi-core CPU by leveraging multithreading and scalable event notification systems. An optional LuaJIT script can perform HTTP request generation, response processing, and custom reporting. Details are available in SCRIPTING and several examples are located in scripts. The machine running wrk must have a sufficient number of ephemeral ports available and closed sockets should be recycled quickly. To handle the initial connection burst the server's listen(2) backlog should be greater than the number of concurrent connections being tested.

glean is a set of tools to test and compare performance, features, and image quality of OpenGL implementations on one or more graphics cards.

These tools, written in J2ME MIDP, run on phones and other small-scale Java devices, to allow software developers understand the particulars of new devices. They quickly uncover aspects such as full class hierarchy, keypad constraints, and general specs.

The Synthetic Data Gym (SDGym) is a benchmarking framework for modeling and generating synthetic data. Measure performance and memory usage across different synthetic data modeling techniques – classical statistics, deep learning and more! The SDGym library integrates with the Synthetic Data Vault ecosystem. You can use any of its synthesizers, datasets or metrics for benchmarking. You also customize the process to include your own work. Select any of the publicly available datasets from the SDV project, or input your own data. Choose from any of the SDV synthesizers and baselines. Or write your own custom machine learning model. In addition to performance and memory usage, you can also measure synthetic data quality and privacy through a variety of metrics. Install SDGym using pip or conda. We recommend using a virtual environment to avoid conflicts with other software on your device.

ViennaCLBench provides a graphical user interface for collecting benchmark data for common OpenCL-accelerated linear algebra operations as implemented in the linear algebra library ViennaCL.

ViewPerf is an industry standard OpenGL graphics benchmark application. It reads in a data set and displays the result. The data object is manipulated (rotated, translated, etc...) and the output (frames/sec) is recorded.