Vol. 12, No. 6, 2019

Download this article
Download this article For screen
For printing
Recent Issues

Volume 12
Issue 6, 901–1080
Issue 5, 721–899
Issue 4, 541–720
Issue 3, 361–539
Issue 2, 181–360
Issue 1, 1–180

Volume 11, 5 issues

Volume 10, 5 issues

Volume 9, 5 issues

Volume 8, 5 issues

Volume 7, 6 issues

Volume 6, 4 issues

Volume 5, 4 issues

Volume 4, 4 issues

Volume 3, 4 issues

Volume 2, 5 issues

Volume 1, 2 issues

The Journal
About the Journal
Subscriptions
Editorial Board
Editors’ Interests
Scientific Advantages
Submission Guidelines
Submission Form
Ethics Statement
Editorial Login
Author Index
Coming Soon
Contacts
ISSN: 1944-4184 (e-only)
ISSN: 1944-4176 (print)
Other MSP Journals
Improving multilabel classification via heterogeneous ensemble methods

Yujue Wu and Qing Wang

Vol. 12 (2019), No. 6, 1035–1050
Abstract

We consider the task of multilabel classification, where each instance may belong to multiple labels simultaneously. We propose a new method, called multilabel super learner (MLSL), that is built upon the problem transformation approach using the one-vs-all binary relevance method. MLSL is an ensemble model that predicts multilabel responses by integrating the strength of multiple base classifiers, and therefore it is likely to outperform each base learner. The weights in the ensemble classifier are determined by optimization of a loss function via V -fold cross-validation. Several loss functions are considered and evaluated numerically. The performance of various realizations of MLSL is compared to existing problem transformation algorithms using three real data sets, spanning applications in biology, music, and image labeling. The numerical results suggest that MLSL outperforms existing methods most of the time evaluated by the commonly used performance metrics in multilabel classification.

Keywords
binary relevance, heterogeneous ensemble, multilabel classification, stacking, super learner
Mathematical Subject Classification 2010
Primary: 62-07
Milestones
Received: 25 October 2018
Revised: 18 March 2019
Accepted: 30 March 2019
Published: 3 August 2019

Communicated by Sat N. Gupta
Authors
Yujue Wu
Department of Mathematics
Wellesley College
Wellesley, MA
United States
Qing Wang
Department of Mathematics
Wellesley College
Wellesley, MA
United States