Zero Shot Learning On Medconceptsqa

Metrics

Accuracy

Results

Performance results of various models on this benchmark

		Paper Title
gpt-4-0125-preview	52.489	GPT-4 Technical Report
gpt-3.5-turbo	37.058	Language Models are Few-Shot Learners
dmis-lab/biobert-v1.1	26.151	BioBERT: a pre-trained biomedical language representation model for biomedical text mining
meta-llama/Meta-Llama-3-8B-Instruct	25.840	LLaMA: Open and Efficient Foundation Language Models
epfl-llm/meditron-7b	25.751	MEDITRON-70B: Scaling Medical Pretraining for Large Language Models
dmis-lab/meerkat-7b-v1.0	25.680	Small Language Models Learn Enhanced Reasoning Skills from Medical Textbooks
HuggingFaceH4/zephyr-7b-beta	25.538	Zephyr: Direct Distillation of LM Alignment
epfl-llm/meditron-70b	25.360	MEDITRON-70B: Scaling Medical Pretraining for Large Language Models
yikuan8/Clinical-Longformer	25.040	Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences
UFNLP/gatortron-medium	24.862	GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Records
PharMolix/BioMedGPT-LM-7B	24.747	BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine
BioMistral/BioMistral-7B-DARE	24.569	BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains
johnsnowlabs/JSL-MedMNX-7B	24.427	-

0 of 13 row(s) selected.

Zero Shot Learning On Medconceptsqa

Metrics

Accuracy

Results

Performance results of various models on this benchmark

		Paper Title
gpt-4-0125-preview	52.489	GPT-4 Technical Report
gpt-3.5-turbo	37.058	Language Models are Few-Shot Learners
dmis-lab/biobert-v1.1	26.151	BioBERT: a pre-trained biomedical language representation model for biomedical text mining
meta-llama/Meta-Llama-3-8B-Instruct	25.840	LLaMA: Open and Efficient Foundation Language Models
epfl-llm/meditron-7b	25.751	MEDITRON-70B: Scaling Medical Pretraining for Large Language Models
dmis-lab/meerkat-7b-v1.0	25.680	Small Language Models Learn Enhanced Reasoning Skills from Medical Textbooks
HuggingFaceH4/zephyr-7b-beta	25.538	Zephyr: Direct Distillation of LM Alignment
epfl-llm/meditron-70b	25.360	MEDITRON-70B: Scaling Medical Pretraining for Large Language Models
yikuan8/Clinical-Longformer	25.040	Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences
UFNLP/gatortron-medium	24.862	GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Records
PharMolix/BioMedGPT-LM-7B	24.747	BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine
BioMistral/BioMistral-7B-DARE	24.569	BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains
johnsnowlabs/JSL-MedMNX-7B	24.427	-

0 of 13 row(s) selected.