Command Palette
Search for a command to run...
Test Suite Pass Rate
Date
The Test Suite Pass Rate is a core metric in software engineering and Code LLM evaluation, commonly used to measure performance on tasks such as code generation and automatic program repair (APR). It measures the proportion of test cases that pass successfully when the code is run against a predefined test suite (in some benchmarks, it is also used to measure the proportion of tasks that pass all tests completely), thereby comprehensively evaluating the functional completeness and correctness of generated or repaired solutions. This metric is typically reported as a percentage or a value in 0–1, where a higher value indicates stronger code usability, making it easier for developers and researchers to compare the actual performance of different model versions.
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.