The start and end dates and times for each Phase are set forth on the Competition Website (collectively, the “Competition Period”). The Competition consists of a phase I (“Phase I”) and a phase II (“Phase II”) (where distinction is not necessary, each may be referred to as a “Phase” or together as “Phases”). For more information see the links below. These scores also corresponded to accuracies of 70–75%, compared to accuracy under 65% for the top benchmark from the paper.Īll prize-winning solutions and accompanying academic write-ups from this competition are openly available for anyone to use and learn from. Over the course of the competition, we saw over 3,000 participants enter the challenge, visiting the site from more than 150 countries around the world! The top five submissions in Phase 2 achieved AUC ROC scores of 0.79–0.84 on the unseen test set, all significantly above the baselines reported in the paper accompanying the dataset release. Participants were given a limited number of submissions to achieve the highest AUC ROC score when classifying an unseen test set of memes. The team at Facebook AI created the Hateful Memes dataset to engage a broader community in the development of better multimodal models for problems like this. The goal of this challenge was to develop multimodal machine learning models-which combine text and image feature information-to automatically classify memes as hateful or not. By using certain types of images, text, or combinations, a meme can become a multimodal type of hate speech. Relying on just text or just images to determine whether a meme is hateful is insufficient. Douwe Kiela, Facebook AI Research Scientist and author of Hateful Memes dataset WhyĪt the massive scale of the internet, the task of detecting multimodal hate is both extremely important and particularly difficult. We hope others across the AI research community will continue to build on their work and be able to improve their own systems. The top submissions substantially exceed the performance of the baseline models we provided as part of the challenge.
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |