Hateful Memes is a multimodal dataset (images + text) for hate speech detection. The dataset contains more than 10,000 new multimodal instances created by Facebook AI. Image licensed from Getty Images.

The addition of difficult-to-recognize examples to the dataset makes it difficult to rely on unimodal signals, meaning that only multimodal models can succeed.