A regularized attribute weighting framework for naive bayes

Wang, Shihe, Ren, Jianfeng and Bai, Ruibin (2020) A regularized attribute weighting framework for naive bayes. IEEE Access . p. 1. ISSN 2169-3536

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Available under Licence Creative Commons Attribution.
Download (7MB) | Preview


The Bayesian classification framework has been widely used in many fields, but the covariance matrix is usually difficult to estimate reliably. To alleviate the problem, many naive Bayes (NB) approaches with good performance have been developed. However, the assumption of conditional independence between attributes in NB rarely holds in reality. Various attribute-weighting schemes have been developed to address this problem. Among them, class-specific attribute weighted naive Bayes (CAWNB) has recently achieved good performance by using classification feedback to optimize the attribute weights of each class. However, the derived model may be over-fitted to the training dataset, especially when the dataset is insufficient to train a model with good generalization performance. This paper proposes a regularization technique to improve the generalization capability of CAWNB, which could well balance the trade-off between discrimination power and generalization capability. More specifically, by introducing the regularization term, the proposed method, namely regularized naive Bayes (RNB), could well capture the data characteristics when the dataset is large, and exhibit good generalization performance when the dataset is small. RNB is compared with the state-of-the-art naive Bayes methods. Experiments on 33 machine-learning benchmark datasets demonstrate that RNB outperforms the compared methods significantly.

Item Type: Article
Keywords: Attribute weighting;classification;naive Bayes; regularization
Schools/Departments: University of Nottingham Ningbo China > Faculty of Science and Engineering > School of Computer Science
Identification Number: https://doi.org/10.1109/ACCESS.2020.3044946
Depositing User: Yu, Tiffany
Date Deposited: 15 Jan 2021 00:58
Last Modified: 15 Jan 2021 00:58
URI: https://eprints.nottingham.ac.uk/id/eprint/64311

Actions (Archive Staff Only)

Edit View Edit View