TU Darmstadt / ULB / TUbiblio

Towards a Better Understanding of Applied Textual Entailment: Annotation and Evaluation of the RTE-2 Dataset

Garoufi, Konstantina (2007):
Towards a Better Understanding of Applied Textual Entailment: Annotation and Evaluation of the RTE-2 Dataset.
Saarland University, [Online-Edition: https://download.hrz.tu-darmstadt.de/media/FB20/Dekanat/Publ...],
[Master Thesis]

Abstract

Applied textual entailment is a newly introduced generic empirical task that captures major semantic inferences across a wide spectrum of Natural Language Processing applications. In the present thesis we quest for a better understanding of the task by means of investigating a benchmark dataset for textual entailment, the dataset of the Second PASCAL Recognising Textual Entailment (RTE-2) Challenge.

We propose a scheme for annotation of textual entailment, the Annotating RTE (ARTE) scheme, which models a range of diverse entailment mechanisms. The annotation of a considerable portion of the RTE-2 dataset following this scheme enables us an evaluation of the textual entailment data by gaining insights into the semantic-linguistic properties of the textual entailment phenomenon.

Based on this evaluation, the thesis finally examines from various aspects the performance of the textual entailment systems participating in the RTE-2 Challenge, relative to different types of entailment. The methodology followed and the resulting observations make first steps towards a thorough analysis of systems’ performance, which is a key issue for the advancement of textual entailment technology.

Item Type: Master Thesis
Erschienen: 2007
Creators: Garoufi, Konstantina
Title: Towards a Better Understanding of Applied Textual Entailment: Annotation and Evaluation of the RTE-2 Dataset
Language: English
Abstract:

Applied textual entailment is a newly introduced generic empirical task that captures major semantic inferences across a wide spectrum of Natural Language Processing applications. In the present thesis we quest for a better understanding of the task by means of investigating a benchmark dataset for textual entailment, the dataset of the Second PASCAL Recognising Textual Entailment (RTE-2) Challenge.

We propose a scheme for annotation of textual entailment, the Annotating RTE (ARTE) scheme, which models a range of diverse entailment mechanisms. The annotation of a considerable portion of the RTE-2 dataset following this scheme enables us an evaluation of the textual entailment data by gaining insights into the semantic-linguistic properties of the textual entailment phenomenon.

Based on this evaluation, the thesis finally examines from various aspects the performance of the textual entailment systems participating in the RTE-2 Challenge, relative to different types of entailment. The methodology followed and the resulting observations make first steps towards a thorough analysis of systems’ performance, which is a key issue for the advancement of textual entailment technology.

Uncontrolled Keywords: UKP_a_SIM
Divisions: 20 Department of Computer Science
20 Department of Computer Science > Ubiquitous Knowledge Processing
Date Deposited: 31 Dec 2016 14:29
Official URL: https://download.hrz.tu-darmstadt.de/media/FB20/Dekanat/Publ...
Identification Number: TUD-CS-2008-105
Export:
Suche nach Titel in: TUfind oder in Google

Optionen (nur für Redakteure)

View Item View Item