MACE-AL (doi:10.11588/data/C2OQN4)

View:

Part 1: Document Description
Part 2: Study Description
Part 5: Other Study-Related Materials
Entire Codebook

(external link)

Document Description

Citation

Title:

MACE-AL

Identification Number:

doi:10.11588/data/C2OQN4

Distributor:

heiDATA

Date of Distribution:

2020-03-26

Version:

1

Bibliographic Citation:

Rehbein, Ines; Ruppenhofer, Josef; Steen, Julius, 2020, "MACE-AL", https://doi.org/10.11588/data/C2OQN4, heiDATA, V1

Study Description

Citation

Title:

MACE-AL

Subtitle:

A method for detecting errors in automatic annotations (POS, NER etc.)

Identification Number:

doi:10.11588/data/C2OQN4

Authoring Entity:

Rehbein, Ines (Leibniz Institute for the German Language)

Ruppenhofer, Josef (Leibniz Institute for the German Language)

Steen, Julius (Department of Computational Linguistics, Heidelberg University, Germany)

Date of Production:

2017

Distributor:

heiDATA

Access Authority:

Rehbein, Ines

Date of Deposit:

2019-07-31

Holdings Information:

https://doi.org/10.11588/data/C2OQN4

Study Scope

Keywords:

Arts and Humanities, Computer and Information Science, Annotation tool, Annotation noise, Error detection, Automatically annotated text

Topic Classification:

Annotation noise, Error detection in automatic annotations, Error detection for POS, NER etc.

Abstract:

A method for detecting noise in automatically annotated sequence-labelled data, combining MACE (Hovy et al. 2013) with Active Learning.

Kind of Data:

python code

Methodology and Processing

Sources Statement

Data Access

Other Study Description Materials

Related Materials

<p><strong>MACE (Multi-Annotator Competence Estimation)</strong>: A generative modelfor Multi-Annotator Competence Estimation</p> <p><strong>Link to resource:</strong> <a href="https://github.com/dirkhovy/MACE">https://github.com/dirkhovy/MACE</a></p> <p><strong>Reference:</strong></p> <p>Hovy, D., Berg-Kirkpatrick, T., Vaswani, A., and Eduard Hovy (2013). Learning whom to trust with MACE. In <em>Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies</em>, pp. 1120&ndash;1130, June 9&ndash;14, 2013, Atlanta, Georgia. <a href="https://www.aclweb.org/anthology/N13-1132.pdf">https://www.aclweb.org/anthology/N13-1132.pdf</a></p> <p>&nbsp;</p>

Related Publications

Citation

Title:

</p>Rehbein, I. and Ruppenhofer, J. (2017). Detecting annotation noise in automatically labelled data. In <em>Proceedings of the 55th annual meeting of the Association for Computational Linguistics (ACL'17)</em>, pages 1160&ndash;1170, July 30-August 4, 2017, Vancouver, Canada.

Bibliographic Citation:

</p>Rehbein, I. and Ruppenhofer, J. (2017). Detecting annotation noise in automatically labelled data. In <em>Proceedings of the 55th annual meeting of the Association for Computational Linguistics (ACL'17)</em>, pages 1160&ndash;1170, July 30-August 4, 2017, Vancouver, Canada.

Other Study-Related Materials

Label:

MACE-AL.zip

Notes:

application/zip