Code Generation On Turbulence

Metrics

CorrSc

Results

Performance results of various models on this benchmark

		Paper Title
GPT-4	0.848	Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code
GPT-3.5-Turbo	0.617	Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code
CodeLlama:13B-4bit-quantised	0.327	Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code
CodeLlama:7B-4bit-quantised	0.289	Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code
Command	0.063	Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code

0 of 5 row(s) selected.

Code Generation On Turbulence

Metrics

CorrSc

Results

Performance results of various models on this benchmark

		Paper Title
GPT-4	0.848	Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code
GPT-3.5-Turbo	0.617	Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code
CodeLlama:13B-4bit-quantised	0.327	Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code
CodeLlama:7B-4bit-quantised	0.289	Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code
Command	0.063	Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code

0 of 5 row(s) selected.