TU Darmstadt / ULB / TUbiblio

Language Agnostic Automatic Summarization Evaluation

Tauchmann, Christopher and Mieskes, Margot (2020):
Language Agnostic Automatic Summarization Evaluation.
pp. 6658-6664, Proceedings of the 12th International Conference on Language Resources and Evaluation (LREC), [Conference or Workshop Item]

Abstract

So far work on automatic summarization has dealt primarily with English data. Accordingly, evaluation methods were primarily developed with this language in mind. In our work, we present experiments of adapting available evaluation methods such as ROUGE and PYRAMID to non-English data. We base our experiments on various English and non-English homogeneous benchmark data sets as well as a non-English heterogeneous data set. Our results indicate that ROUGE can indeed be adapted to non-English data – both homogeneous and heterogeneous. Using a recent implementation of performing an automatic PYRAMID evaluation, we also show its adaptablilty to non-English data.

Item Type: Conference or Workshop Item
Erschienen: 2020
Creators: Tauchmann, Christopher and Mieskes, Margot
Title: Language Agnostic Automatic Summarization Evaluation
Language: English
Abstract:

So far work on automatic summarization has dealt primarily with English data. Accordingly, evaluation methods were primarily developed with this language in mind. In our work, we present experiments of adapting available evaluation methods such as ROUGE and PYRAMID to non-English data. We base our experiments on various English and non-English homogeneous benchmark data sets as well as a non-English heterogeneous data set. Our results indicate that ROUGE can indeed be adapted to non-English data – both homogeneous and heterogeneous. Using a recent implementation of performing an automatic PYRAMID evaluation, we also show its adaptablilty to non-English data.

Divisions: 20 Department of Computer Science
20 Department of Computer Science > Artificial Intelligence and Machine Learning
Event Title: Proceedings of the 12th International Conference on Language Resources and Evaluation (LREC)
Date Deposited: 18 May 2020 07:58
Official URL: http://www.lrec-conf.org/proceedings/lrec2020/pdf/2020.lrec-...
Export:
Suche nach Titel in: TUfind oder in Google
Send an inquiry Send an inquiry

Options (only for editors)
Show editorial Details Show editorial Details