MRPR: a MapReduce solution for prototype reduction in big data classification

Triguero, Isaac and Peralta, Daniel and Bacardit, Jaume and García, Salvador and Herrera, Francisco (2015) MRPR: a MapReduce solution for prototype reduction in big data classification. Neurocomputing, 150 (A). pp. 331-345. ISSN 0925-2312

[img]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Available under Licence Creative Commons Attribution Non-commercial No Derivatives.
Download (443kB) | Preview

Abstract

In the era of big data, analyzing and extracting knowledge from large-scale data sets is a very interesting and challenging task. The application of standard data mining tools in such data sets is not straightforward. Hence, a new class of scalable mining method that embraces the huge storage and processing capacity of cloud platforms is required. In this work, we propose a novel distributed partitioning methodology for prototype reduction techniques in nearest neighbor classification. These methods aim at representing original training data sets as a reduced number of instances. Their main purposes are to speed up the classification process and reduce the storage requirements and sensitivity to noise of the nearest neighbor rule. However, the standard prototype reduction methods cannot cope with very large data sets. To overcome this limitation, we develop a MapReduce-based framework to distribute the functioning of these algorithms through a cluster of computing elements, proposing several algorithmic strategies to integrate multiple partial solutions (reduced sets of prototypes) into a single one. The proposed model enables prototype reduction algorithms to be applied over big data classification problems without significant accuracy loss. We test the speeding up capabilities of our model with data sets up to 5.7 millions of instances. The results show that this model is a suitable tool to enhance the performance of the nearest neighbor classifier with big data.

Item Type: Article
Keywords: Big data, Mahout, Hadoop, Prototype reduction, Prototype generation, Nearest neighbor classification
Schools/Departments: University of Nottingham, UK > Faculty of Science > School of Computer Science
Identification Number: 10.1016/j.neucom.2014.04.078
Depositing User: Eprints, Support
Date Deposited: 04 Sep 2017 13:09
Last Modified: 04 Sep 2017 13:10
URI: http://eprints.nottingham.ac.uk/id/eprint/45415

Actions (Archive Staff Only)

Edit View Edit View