HyperAI超神经

Conversational Response Selection On Douban 1

评估指标

MAP

MRR

P@1

R10@1

R10@2

R10@5

评测结果

各个模型在此基准测试上的表现结果

							Paper Title
SEMSOL(W/o utterances)	0.651	0.687	0.510	0.328	0.552	0.877	Knowledge-aware response selection with semantics underlying multi-turn open-domain conversations
Uni-Enc+BERT-FP	0.648	0.688	0.518	0.327	0.557	0.865	Uni-Encoder: A Fast and Accurate Response Selection Paradigm for Generation-Based Dialogue Systems
BERT-FP	0.644	0.680	0.512	0.324	0.542	0.870	Fine-grained Post-training for Improving Retrieval-based Dialogue Systems
SEMSOL	0.640	0.678	0.511	0.330	0.520	0.870	Knowledge-aware response selection with semantics underlying multi-turn open-domain conversations
SA-BERT+HCL	0.639	0.681	0.514	0.330	0.531	0.858	Dialogue Response Selection with Hierarchical Curriculum Learning
UMS_BERT+	0.625	0.664	0.499	0.318	0.482	0.858	Do Response Selection Models Really Know What's Next? Utterance Manipulation Strategies for Multi-turn Response Selection
Uni-Encoder	0.622	0.662	0.481	0.303	0.514	0.852	Uni-Encoder: A Fast and Accurate Response Selection Paradigm for Generation-Based Dialogue Systems
SA-BERT	0.619	0.659	0.496	0.313	0.481	0.847	Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
Poly-encoder	0.608	0.650	0.475	0.299	0.494	0.822	Poly-encoders: Transformer Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoring
BERT	0.591	0.633	0.454	0.280	0.470	0.828	An Effective Domain Adaptive Post-Training Method for BERT in Response Selection
MSN	0.587	0.632	0.470	0.295	0.452	0.788	Multi-hop Selector Network for Multi-turn Response Selection in Retrieval-based Chatbots
IoI	0.573	0.621	0.444	0.269	0.451	0.786	One Time of Interaction May Not Be Enough: Go Deep with an Interaction-over-Interaction Network for Response Selection in Dialogues
IMN	0.570	0.615	0.433	0.262	0.452	0.789	Interactive Matching Network for Multi-Turn Response Selection in Retrieval-Based Chatbots
DUA	0.551	0.599	0.421	0.243	0.421	0.780	Modeling Multi-turn Conversation with Deep Utterance Aggregation
DAM	0.550	0.601	0.427	0.254	0.410	0.757	Multi-Turn Response Selection for Chatbots with Deep Attention Matching Network
SMN	0.529	0.569	0.397	0.233	0.396	0.724	Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots

0 of 16 row(s) selected.

HyperAI超神经

Conversational Response Selection On Douban 1

评估指标

MAP

MRR

P@1

R10@1

R10@2

R10@5

评测结果

各个模型在此基准测试上的表现结果

							Paper Title
SEMSOL(W/o utterances)	0.651	0.687	0.510	0.328	0.552	0.877	Knowledge-aware response selection with semantics underlying multi-turn open-domain conversations
Uni-Enc+BERT-FP	0.648	0.688	0.518	0.327	0.557	0.865	Uni-Encoder: A Fast and Accurate Response Selection Paradigm for Generation-Based Dialogue Systems
BERT-FP	0.644	0.680	0.512	0.324	0.542	0.870	Fine-grained Post-training for Improving Retrieval-based Dialogue Systems
SEMSOL	0.640	0.678	0.511	0.330	0.520	0.870	Knowledge-aware response selection with semantics underlying multi-turn open-domain conversations
SA-BERT+HCL	0.639	0.681	0.514	0.330	0.531	0.858	Dialogue Response Selection with Hierarchical Curriculum Learning
UMS_BERT+	0.625	0.664	0.499	0.318	0.482	0.858	Do Response Selection Models Really Know What's Next? Utterance Manipulation Strategies for Multi-turn Response Selection
Uni-Encoder	0.622	0.662	0.481	0.303	0.514	0.852	Uni-Encoder: A Fast and Accurate Response Selection Paradigm for Generation-Based Dialogue Systems
SA-BERT	0.619	0.659	0.496	0.313	0.481	0.847	Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
Poly-encoder	0.608	0.650	0.475	0.299	0.494	0.822	Poly-encoders: Transformer Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoring
BERT	0.591	0.633	0.454	0.280	0.470	0.828	An Effective Domain Adaptive Post-Training Method for BERT in Response Selection
MSN	0.587	0.632	0.470	0.295	0.452	0.788	Multi-hop Selector Network for Multi-turn Response Selection in Retrieval-based Chatbots
IoI	0.573	0.621	0.444	0.269	0.451	0.786	One Time of Interaction May Not Be Enough: Go Deep with an Interaction-over-Interaction Network for Response Selection in Dialogues
IMN	0.570	0.615	0.433	0.262	0.452	0.789	Interactive Matching Network for Multi-Turn Response Selection in Retrieval-Based Chatbots
DUA	0.551	0.599	0.421	0.243	0.421	0.780	Modeling Multi-turn Conversation with Deep Utterance Aggregation
DAM	0.550	0.601	0.427	0.254	0.410	0.757	Multi-Turn Response Selection for Chatbots with Deep Attention Matching Network
SMN	0.529	0.569	0.397	0.233	0.396	0.724	Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots

0 of 16 row(s) selected.

Conversational Response Selection On Douban 1 | SOTA | HyperAI超神经