Fast Variable Selection by Block Addition and Block Deletion

Nagatani, Takashi and Ozawa, Seiichi and Abe, Shigeo (2010) Fast Variable Selection by Block Addition and Block Deletion. Journal of Intelligent Learning Systems and Applications, 02 (04). pp. 200-211. ISSN 2150-8402

[thumbnail of JILSA20100400004_40969803.pdf] Text
JILSA20100400004_40969803.pdf - Published Version

Download (415kB)

Abstract

We propose the threshold updating method for terminating variable selection and two variable selection methods. In the threshold updating method, we update the threshold value when the approximation error smaller than the current threshold value is obtained. The first variable selection method is the combination of forward selection by block addi-tion and backward selection by block deletion. In this method, starting from the empty set of the input variables, we add several input variables at a time until the approximation error is below the threshold value. Then we search deletable variables by block deletion. The second method is the combination of the first method and variable selection by Linear Programming Support Vector Regressors (LPSVRs). By training an LPSVR with linear kernels, we evaluate the weights of the decision function and delete the input variables whose associated absolute weights are zero. Then we carry out block addition and block deletion. By computer experiments using benchmark data sets, we show that the proposed methods can perform faster variable selection than the method only using block deletion, and that by the threshold updating method, the approximation error is lower than that by the fixed threshold method. We also compare our method with an imbedded method, which determines the optimal variables during training, and show that our method gives comparable or better variable selection performance.

Item Type: Article
Subjects: Pustakas > Engineering
Depositing User: Unnamed user with email support@pustakas.com
Date Deposited: 30 Jan 2023 11:13
Last Modified: 03 Jan 2024 07:03
URI: http://archive.pcbmb.org/id/eprint/118

Actions (login required)

View Item
View Item