TU Darmstadt / ULB / TUbiblio

Efficient Pairwise Multilabel Classification for Large-Scale Problems in the Legal Domain

Loza Mencía, Eneldo and Fürnkranz, Johannes
Daelemans, Walter and Goethals, Bart and Morik, Katharina (eds.) (2008):
Efficient Pairwise Multilabel Classification for Large-Scale Problems in the Legal Domain.
In: Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Disocvery in Databases (ECML-PKDD-2008), Part II, Springer, ISBN 978-3-540-87480-5,
[Online-Edition: http://www.ke.tu-darmstadt.de/publications/papers/ECML08.pdf],
[Conference or Workshop Item]

Abstract

In this paper we applied multilabel classification algorithms to the EUR-Lex database of legal documents of the European Union. On this document collection, we studied three different multilabel classification problems, the largest being the categorization into the EUROVOC concept hierarchy with almost 4000 classes. We evaluated three algorithms: (i) the binary relevance approach which independently trains one classifier per label; (ii) the multiclass multilabel perceptron algorithm, which respects dependencies between the base classifiers; and (iii) the multilabel pairwise perceptron algorithm, which trains one classifier for each pair of labels. All algorithms use the simple but very efficient perceptron algorithm as the underlying classifier, which makes them very suitable for large-scale multilabel classification problems. The main challenge we had to face was that the almost 8,000,000 perceptrons that had to be trained in the pairwise setting could no longer be stored in memory. We solve this problem by resorting to the dual representation of the perceptron, which makes the pairwise approach feasible for problems of this size. The results on the EUR-Lex database confirm the good predictive performance of the pairwise approach and demonstrates the feasibility of this approach for large-scale tasks.

Item Type: Conference or Workshop Item
Erschienen: 2008
Editors: Daelemans, Walter and Goethals, Bart and Morik, Katharina
Creators: Loza Mencía, Eneldo and Fürnkranz, Johannes
Title: Efficient Pairwise Multilabel Classification for Large-Scale Problems in the Legal Domain
Language: English
Abstract:

In this paper we applied multilabel classification algorithms to the EUR-Lex database of legal documents of the European Union. On this document collection, we studied three different multilabel classification problems, the largest being the categorization into the EUROVOC concept hierarchy with almost 4000 classes. We evaluated three algorithms: (i) the binary relevance approach which independently trains one classifier per label; (ii) the multiclass multilabel perceptron algorithm, which respects dependencies between the base classifiers; and (iii) the multilabel pairwise perceptron algorithm, which trains one classifier for each pair of labels. All algorithms use the simple but very efficient perceptron algorithm as the underlying classifier, which makes them very suitable for large-scale multilabel classification problems. The main challenge we had to face was that the almost 8,000,000 perceptrons that had to be trained in the pairwise setting could no longer be stored in memory. We solve this problem by resorting to the dual representation of the perceptron, which makes the pairwise approach feasible for problems of this size. The results on the EUR-Lex database confirm the good predictive performance of the pairwise approach and demonstrates the feasibility of this approach for large-scale tasks.

Title of Book: Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Disocvery in Databases (ECML-PKDD-2008), Part II
Volume: 5212
Publisher: Springer
ISBN: 978-3-540-87480-5
Divisions: 20 Department of Computer Science
20 Department of Computer Science > Knowl­edge En­gi­neer­ing
Date Deposited: 24 Jun 2011 15:09
Official URL: http://www.ke.tu-darmstadt.de/publications/papers/ECML08.pdf
Identification Number: doi:10.1007/978-3-540-87481-2_4
Export:

Optionen (nur für Redakteure)

View Item View Item