Command Palette
Search for a command to run...
Issue Resolved Rate
Date
Issue Resolved Rate is an important evaluation metric in natural language processing for automated code repair / bug-fixing tasks. It measures the proportion of patches generated by a model that successfully resolve GitHub issues (through relevant tests or manual confirmation), reflecting the core end-to-end issue-fixing capability. It is typically reported as a percentage or a score between 0 and 1. This metric is widely used in related benchmarks and papers, and it effectively reflects model performance on this dimension. Higher values are better.
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.