Sie können Bookmarks mittels Listen verwalten, loggen Sie sich dafür bitte in Ihr SLUB Benutzerkonto ein.
Medientyp:
E-Artikel
Titel:
Truth Is a Lie: Crowd Truth and the Seven Myths of Human Annotation
Beteiligte:
Aroyo, Lora;
Welty, Chris
Erschienen:
Wiley, 2015
Erschienen in:AI Magazine
Sprache:
Englisch
DOI:
10.1609/aimag.v36i1.2564
ISSN:
0738-4602;
2371-9621
Entstehung:
Anmerkungen:
Beschreibung:
<jats:p>Big data is having a disruptive impact across the sciences. Human annotation of semantic interpretation tasks is a critical part of big data semantics, but it is based on an antiquated ideal of a single correct truth that needs to be similarly disrupted. We expose seven myths about human annotation, most of which derive from that antiquated ideal of truth, and dispel these myths with examples from our research. We propose a new theory of truth, crowd truth, that is based on the intuition that human interpretation is subjective, and that measuring annotations on the same objects of interpretation (in our examples, sentences) across a crowd will provide a useful representation of their subjectivity and the range of reasonable interpretations.</jats:p>