The MSC Data Set

Use email button above to contact.

From this page you can download resources we created for modal sense classification as reported in Zhou et al. (2015), Marasović et al. (2016) and Marasović and Frank (2015) (see "Related Publication" below):

• Heuristically sense-annotated training data acquired from EUROPARL and OpenSubtitles (EPOS_E, English). The dataset was used for:
  • the EMNLP 2015 Workshop submission "Semantically enriched models for modal sense classification" by Mengfei Zhou, Anette Frank,Annemarie Friedrich, and Alexis Palmer
  • the LiLT submission "Modal Sense Classification At Large: Paraphrase-Driven Sense Projection, Semantically Enriched Classification Models and Cross-Genre Evaluations" by Ana Marasović, Mengfei Zou, Alexis Palmer, Anette Frank
  • the RepL4NLP submission "Multilingual Modal Sense Classification using a Convolutional Neural Network" by Ana Marasović and Anette Frank.
• Composition of training and testing used for the classification experiments. The dataset was used for:
  • the EMNLP 2015 Workshop submission "Semantically enriched models for modal sense classification" by submission Mengfei Zhou, Anette Frank,Annemarie Friedrich, and Alexis Palmer
  • the RepL4NLP submission "Multilingual Modal Sense Classification using a Convolutional Neural Network" by Ana Marasović and Anette Frank.
• Manually annotated subsection of MASC (English). The dataset was used for the LiLT submission "Modal Sense Classification At Large: Paraphrase-Driven Sense Projection, Semantically Enriched Classification Models and Cross-Genre Evaluations" by Ana Marasović, Mengfei Zou, Alexis Palmer, Anette Frank.
• Heuristically modal sense annotated training data and manually annotated test data from EUROPARL and OpenSubtitles (EPOS_G, German). The dataset was used for the RepL4NLP submission "Multilingual Modal Sense Classification using a Convolutional Neural Network" by Ana Marasović and Anette Frank.

Zhou, M., Frank, A., Friedrich, A., and Palmer, A. (2015). Semantically enriched models for modal sense classification. In Proceedings of the EMNLP 2015 Workshop on Linking Models of Lexical, Sentential and Discourse-level Semantics, pages 44–53, 18 September 2015, Lisboa, Portugal.

Marasović, A., Zhou, M., Palmer, A., and Frank, A. (2016). Modal sense classification at large: Paraphrasedriven sense projection, semantically enriched classification models and cross-genre evaluations. In Linguistic Issues in Language Technology, Special issue on Modality in Natural Language Understanding, volume 14 (2), Stanford, CA. CSLI Publications.

Marasović, A. and Frank, A. (2016). Multilingual modal sense classification using a convolutional neural network. In Proceedings of the 1st Workshop on Representation Learning for NLP, pages 111–120, August 11, 2016, Berlin, Germany. Association for Computational Linguistics.

Europarl Parallel Corpus

Link to the corpus: https://www.statmt.org/europarl/

OpenSubtitles corpus

Link to the corpus: http://opus.nlpl.eu/

Manually Annotated Sub-Corpus (MASC)

Link to the corpus: https://www.anc.org/data/masc/