###
**Park, Sang-Hyeun and Weizsäcker, Lorenz and Fürnkranz, Johannes**

**Pfahringer, Bernhard and Holmes, Geoff and Hoffmann, Achim (eds.)** (2010):

*Exploiting Code Redundancies in ECOC.*

In: Discovery Science, Springer Berlin / Heidelberg, [Conference or Workshop Item]

## Abstract

We study an approach for speeding up the training of error-correcting output codes (ECOC) classifiers. The key idea is to avoid unnecessary computations by exploiting the overlap of the different training sets in the ECOC ensemble. Instead of re-training each classifier from scratch, classifiers that have been trained for one task can be adapted to related tasks in the ensemble. The crucial issue is the identification of a schedule for training the classifiers which maximizes the exploitation of the overlap. For solving this problem, we construct a classifier graph in which the nodes correspond to the classifiers, and the edges represent the training complexity for moving from one classifier to the next in terms of the number of added training examples. The solution of the Steiner Tree problem is an arborescence in this graph which describes the learning scheme with the minimal total training complexity. We experimentally evaluate the algorithm with Hoeffding trees, as an example for incremental learners where the classifier adaptation is trivial, and with SVMs, where we employ an adaptation strategy based on adapted caching and weight reuse, which guarantees that the learned model is the same as per batch learning.

Item Type: | Conference or Workshop Item |
---|---|

Erschienen: | 2010 |

Editors: | Pfahringer, Bernhard and Holmes, Geoff and Hoffmann, Achim |

Creators: | Park, Sang-Hyeun and Weizsäcker, Lorenz and Fürnkranz, Johannes |

Title: | Exploiting Code Redundancies in ECOC |

Language: | English |

Abstract: | We study an approach for speeding up the training of error-correcting output codes (ECOC) classifiers. The key idea is to avoid unnecessary computations by exploiting the overlap of the different training sets in the ECOC ensemble. Instead of re-training each classifier from scratch, classifiers that have been trained for one task can be adapted to related tasks in the ensemble. The crucial issue is the identification of a schedule for training the classifiers which maximizes the exploitation of the overlap. For solving this problem, we construct a classifier graph in which the nodes correspond to the classifiers, and the edges represent the training complexity for moving from one classifier to the next in terms of the number of added training examples. The solution of the Steiner Tree problem is an arborescence in this graph which describes the learning scheme with the minimal total training complexity. We experimentally evaluate the algorithm with Hoeffding trees, as an example for incremental learners where the classifier adaptation is trivial, and with SVMs, where we employ an adaptation strategy based on adapted caching and weight reuse, which guarantees that the learned model is the same as per batch learning. |

Title of Book: | Discovery Science |

Volume: | 6332 |

Publisher: | Springer Berlin / Heidelberg |

Divisions: | 20 Department of Computer Science > Knowledge Engineering 20 Department of Computer Science |

Date Deposited: | 24 Jun 2011 14:20 |

Identification Number: | doi:10.1007/978-3-642-16184-1_19 |

Export: |

#### Optionen (nur für Redakteure)

View Item |