Multimodal Sentiment Analysis On Cmu Mosi

Metrics

Acc-2

Acc-7

Corr

F1

MAE

Results

Performance results of various models on this benchmark

						Paper Title
MMML	90.35	52.72	0.8824	90.35	0.5573	Multimodal Multi-loss Fusion Network for Sentiment Analysis
TEASEL	87.5	47.52	0.836	85	0.64	TEASEL: A Transformer-Based Speech-Prefixed Language Model
SPECTRA	87.5	-	-	-	-	Speech-Text Dialog Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment
MCEN	87.35	50.58	0.813	87.48	0.678	10,000+ Times Accelerated Robust Subset Selection (ARSS)
UniMSE	86.9	48.68	0.809	86.42	0.691	UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition
UniVL + MELTR	85.3	-	0.789	85.4	0.759	MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models
VAE-AMDT	84.3	-	-	84.2	0.716	Adversarial Multimodal Domain Transfer for Video-Level Sentiment Analysis
MMIM	84.14	46.65	0.8	84	0.7	Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis
self-M	82.54	45.79	0.795	82.68	0.712	Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis
MAG-BERT*	82.37	43.62	0.781	82.5	0.727	Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis
Tri-TransModality	-	-	-	-	-	TransModality: An End2End Fusion Method with Transformer for Multimodal Sentiment Analysis
ALMT	-	49.42	0.805	-	0.683	Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis

0 of 12 row(s) selected.

Multimodal Sentiment Analysis On Cmu Mosi

Metrics

Acc-2

Acc-7

Corr

F1

MAE

Results

Performance results of various models on this benchmark

						Paper Title
MMML	90.35	52.72	0.8824	90.35	0.5573	Multimodal Multi-loss Fusion Network for Sentiment Analysis
TEASEL	87.5	47.52	0.836	85	0.64	TEASEL: A Transformer-Based Speech-Prefixed Language Model
SPECTRA	87.5	-	-	-	-	Speech-Text Dialog Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment
MCEN	87.35	50.58	0.813	87.48	0.678	10,000+ Times Accelerated Robust Subset Selection (ARSS)
UniMSE	86.9	48.68	0.809	86.42	0.691	UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition
UniVL + MELTR	85.3	-	0.789	85.4	0.759	MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models
VAE-AMDT	84.3	-	-	84.2	0.716	Adversarial Multimodal Domain Transfer for Video-Level Sentiment Analysis
MMIM	84.14	46.65	0.8	84	0.7	Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis
self-M	82.54	45.79	0.795	82.68	0.712	Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis
MAG-BERT*	82.37	43.62	0.781	82.5	0.727	Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis
Tri-TransModality	-	-	-	-	-	TransModality: An End2End Fusion Method with Transformer for Multimodal Sentiment Analysis
ALMT	-	49.42	0.805	-	0.683	Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis

0 of 12 row(s) selected.

Multimodal Sentiment Analysis On Cmu Mosi | SOTA | HyperAI