TU Darmstadt / ULB / TUbiblio

Towards a Better Understanding of Applied Textual Entailment: Annotation and Evaluation of the RTE-2 Dataset

Garoufi, Konstantina (2007)
Towards a Better Understanding of Applied Textual Entailment: Annotation and Evaluation of the RTE-2 Dataset.
Saarland University
Masterarbeit, Bibliographie

Kurzbeschreibung (Abstract)

Applied textual entailment is a newly introduced generic empirical task that captures major semantic inferences across a wide spectrum of Natural Language Processing applications. In the present thesis we quest for a better understanding of the task by means of investigating a benchmark dataset for textual entailment, the dataset of the Second PASCAL Recognising Textual Entailment (RTE-2) Challenge.

We propose a scheme for annotation of textual entailment, the Annotating RTE (ARTE) scheme, which models a range of diverse entailment mechanisms. The annotation of a considerable portion of the RTE-2 dataset following this scheme enables us an evaluation of the textual entailment data by gaining insights into the semantic-linguistic properties of the textual entailment phenomenon.

Based on this evaluation, the thesis finally examines from various aspects the performance of the textual entailment systems participating in the RTE-2 Challenge, relative to different types of entailment. The methodology followed and the resulting observations make first steps towards a thorough analysis of systems’ performance, which is a key issue for the advancement of textual entailment technology.

Typ des Eintrags: Masterarbeit
Erschienen: 2007
Autor(en): Garoufi, Konstantina
Art des Eintrags: Bibliographie
Titel: Towards a Better Understanding of Applied Textual Entailment: Annotation and Evaluation of the RTE-2 Dataset
Sprache: Englisch
Publikationsjahr: September 2007
URL / URN: https://download.hrz.tu-darmstadt.de/media/FB20/Dekanat/Publ...
Kurzbeschreibung (Abstract):

Applied textual entailment is a newly introduced generic empirical task that captures major semantic inferences across a wide spectrum of Natural Language Processing applications. In the present thesis we quest for a better understanding of the task by means of investigating a benchmark dataset for textual entailment, the dataset of the Second PASCAL Recognising Textual Entailment (RTE-2) Challenge.

We propose a scheme for annotation of textual entailment, the Annotating RTE (ARTE) scheme, which models a range of diverse entailment mechanisms. The annotation of a considerable portion of the RTE-2 dataset following this scheme enables us an evaluation of the textual entailment data by gaining insights into the semantic-linguistic properties of the textual entailment phenomenon.

Based on this evaluation, the thesis finally examines from various aspects the performance of the textual entailment systems participating in the RTE-2 Challenge, relative to different types of entailment. The methodology followed and the resulting observations make first steps towards a thorough analysis of systems’ performance, which is a key issue for the advancement of textual entailment technology.

Freie Schlagworte: UKP_a_SIM
ID-Nummer: TUD-CS-2008-105
Fachbereich(e)/-gebiet(e): 20 Fachbereich Informatik
20 Fachbereich Informatik > Ubiquitäre Wissensverarbeitung
Hinterlegungsdatum: 31 Dez 2016 14:29
Letzte Änderung: 27 Sep 2018 13:55
PPN:
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen