Home // DATA ANALYTICS 2014, The Third International Conference on Data Analytics // View article

Comparison of Linear Discriminant Functions by K-fold Cross Validation

Authors:
Shuichi Shinmura

Keywords: Fisher’s linear discriminant function; logistic regreesion; soft margin SVM;Revised IP-OLDF; minimum number of misclassifications; k-fold cross validation.

Abstract:
To discriminate two classes is essential in the science, technology, and industry. Fisher defined the linear discriminant function (Fisher’s LDF) based on the variance-covariance matrices. It was applied for many applications. After Fisher’s LDF, several LDFs such as logistic regression and a soft margin support vector machine (S-SVM) are proposed. But, there are serious two problems of the discriminant analysis. First, the numbers of misclassifications (NMs) or error rates by these LDFs may not be correct because these LDFs cannot discriminate cases on the discriminant hyper-plane correctly. Second, these LDFs cannot recognize the linear separable data properly. Only revised optimal LDF by integer programming (Revised IP-OLDF) resolves these problems. In this paper, we compare seven LDFs by 100-fold cross validation using 104 different discriminant models. It is shown that the mean error rates of Revised IP-OLDF are better than other LDFs in the training and validation samples.

Pages: 1 to 6

Copyright: Copyright (c) IARIA, 2014

Publication date: August 24, 2014

Published in: conference

ISSN: 2308-4464

ISBN: 978-1-61208-358-2

Location: Rome, Italy

Dates: from August 24, 2014 to August 28, 2013