An exploration of improvements to semi-supervised fuzzy c-means clustering for real-world biomedical data

Lai, Daphne Teck Ching (2014) An exploration of improvements to semi-supervised fuzzy c-means clustering for real-world biomedical data. PhD thesis, University of Nottingham.

[thumbnail of DTC Lai 2014 Thesis]
Preview
PDF (DTC Lai 2014 Thesis) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (3MB) | Preview

Abstract

This thesis explores various detailed improvements to semi-supervised learning (using labelled data to guide clustering or classification of unlabelled data) with fuzzy c-means clustering (a ‘soft’ clustering technique which allows data patterns to be assigned to multiple clusters using membership values), with the primary aim of creating a semi-supervised fuzzy clustering algorithm that shows good performance on real-world data. Hence, there are two main objectives in this work. The first objective is to explore novel technical improvements to semi-supervised Fuzzy c-means (ssFCM) that can address the problem of initialisation sensitivity and can improve results. The second objective is to apply the developed algorithm on real biomedical data, such as the Nottingham Tenovus Breast Cancer (NTBC) dataset, to create an automatic methodology for identifying stable subgroups which have been previously elicited semi-manually.

Investigations were conducted into detailed improvements to the ss-FCM algorithm framework, including a range of distance metrics, initialisation and feature selection techniques and scaling parameter values. These methodologies were tested on different data sources to demonstrate their generalisation properties. Evaluation results between methodologies were compared to determine suitable techniques on various University of California, Irvine (UCI) benchmark datasets. Results were promising, suggesting that initialisation techniques, feature selection and scaling parameter adjustment can increase ssFCM performance.

Based on these investigations, a novel ssFCM framework was developed, applied to the NTBC dataset, and various statistical and biological evaluations were conducted. This demonstrated highly significant improvement in agreement with previous classifications, with solutions that are biologically useful and clinically relevant in comparison with Sorias study [141]. On comparison with the latest NTBC study by Green et al. [63], similar clinical results have been observed, confirming stability of the subgroups.

Two main contributions to knowledge have been made in this work. Firstly, the ssFCM framework has been improved through various technical refinements, which may be used together or separately. Secondly, the NTBC dataset has been successfully automatically clustered (in a single algorithm) into clinical sub-groups which had previously been elucidated semi-manually. While results are very promising, it is important to note that fully, detailed validation of the framework has only been carried out on the NTBC dataset, and so there is limit on the general conclusions that may be drawn. Future studies include applying the framework on other biomedical datasets and applying distance metric learning into ssFCM.

In conclusion, an enhanced ssFCM framework has been proposed, and has been demonstrated to have highly significant improved accuracy on the NTBC dataset.

Item Type: Thesis (University of Nottingham only) (PhD)
Supervisors: Garibaldi, J.M.
Qiu, D.
Soria, D.
Keywords: clustering, semi-supervised learning, breast cancer, biomedical data
Subjects: Q Science > QA Mathematics > QA 75 Electronic computers. Computer science
R Medicine > R Medicine (General) > R855 Medical technology. Biomedical engineering. Electronics
R Medicine > RC Internal medicine > RC 254 Neoplasms. Tumors. Oncology (including Cancer)
Faculties/Schools: UK Campuses > Faculty of Science > School of Computer Science
Item ID: 14232
Depositing User: EP, Services
Date Deposited: 16 Dec 2014 12:55
Last Modified: 15 Dec 2017 05:59
URI: https://eprints.nottingham.ac.uk/id/eprint/14232

Actions (Archive Staff Only)

Edit View Edit View