Tauchmann, Christopher ; Mieskes, Margot (2020)
Language Agnostic Automatic Summarization Evaluation.
Proceedings of the 12th International Conference on Language Resources and Evaluation (LREC).
Konferenzveröffentlichung, Bibliographie
Kurzbeschreibung (Abstract)
So far work on automatic summarization has dealt primarily with English data. Accordingly, evaluation methods were primarily developed with this language in mind. In our work, we present experiments of adapting available evaluation methods such as ROUGE and PYRAMID to non-English data. We base our experiments on various English and non-English homogeneous benchmark data sets as well as a non-English heterogeneous data set. Our results indicate that ROUGE can indeed be adapted to non-English data – both homogeneous and heterogeneous. Using a recent implementation of performing an automatic PYRAMID evaluation, we also show its adaptablilty to non-English data.
| Typ des Eintrags: | Konferenzveröffentlichung |
|---|---|
| Erschienen: | 2020 |
| Autor(en): | Tauchmann, Christopher ; Mieskes, Margot |
| Art des Eintrags: | Bibliographie |
| Titel: | Language Agnostic Automatic Summarization Evaluation |
| Sprache: | Englisch |
| Publikationsjahr: | 27 April 2020 |
| Veranstaltungstitel: | Proceedings of the 12th International Conference on Language Resources and Evaluation (LREC) |
| URL / URN: | http://www.lrec-conf.org/proceedings/lrec2020/pdf/2020.lrec-... |
| Kurzbeschreibung (Abstract): | So far work on automatic summarization has dealt primarily with English data. Accordingly, evaluation methods were primarily developed with this language in mind. In our work, we present experiments of adapting available evaluation methods such as ROUGE and PYRAMID to non-English data. We base our experiments on various English and non-English homogeneous benchmark data sets as well as a non-English heterogeneous data set. Our results indicate that ROUGE can indeed be adapted to non-English data – both homogeneous and heterogeneous. Using a recent implementation of performing an automatic PYRAMID evaluation, we also show its adaptablilty to non-English data. |
| Fachbereich(e)/-gebiet(e): | 20 Fachbereich Informatik 20 Fachbereich Informatik > Künstliche Intelligenz und Maschinelles Lernen |
| Hinterlegungsdatum: | 18 Mai 2020 07:58 |
| Letzte Änderung: | 18 Mai 2020 07:58 |
| PPN: | |
| Export: | |
| Suche nach Titel in: | TUfind oder in Google |
 |
Frage zum Eintrag |
Optionen (nur für Redakteure)
 |
Redaktionelle Details anzeigen |
Drucken
Impressum