Rescale-invariant SVM for binary classification

Montazery, Mojtaba; Wilson, Nic

Rescale-invariant SVM for binary classification

Files

Rescale-Invariant_SVM_for_Binary_Classification-IJCAI17.pdf(256.9 KB)

Accepted version

Date

2017-08

Authors

Montazery, Mojtaba

Wilson, Nic

Publisher

International Joint Conferences on Artificial Intelligence

Published Version

10.24963/ijcai.2017/348

Abstract

Support Vector Machines (SVM) are among the best-known machine learning methods, with broad use in different scientific areas. However, one necessary pre-processing phase for SVM is normalization (scaling) of features, since SVM is not invariant to the scales of the features' spaces, i.e., different ways of scaling may lead to different results. We define a more robust decision-making approach for binary classification, in which one sample strongly belongs to a class if it belongs to that class for all possible rescalings of features. We derive a way of characterising the approach for binary SVM that allows determining when an instance strongly belongs to a class and when the classification is invariant to rescaling. The characterisation leads to a computational method to determine whether one sample is strongly positive, strongly negative or neither. Our experimental results back up the intuition that being strongly positive suggests stronger confidence that an instance really is positive.

Keywords

Support Vector Machines (SVM) , Machine learning , AI technology , Artificial intelligence (AI) , Machine learning: classification , Machine learning , Uncertainty in AI: Uncertainty representations , Uncertainty in AI

Citation

Montazery, M. and Wilson, N. (2017) 'Rescale-Invariant SVM for Binary Classification', IJCAI'17: Proceedings of the 26th International Joint Conference on Artificial Intelligence, Melbourne, Australia 19-25 August, pp. 2501-2507. doi: 10.24963/ijcai.2017/348