On Some Aspects of Variable Selection for Partial Least Squares Regression Models

作者：Partha Pratim Roy, Kunal Roy · 发表于：QSAR & Combinatorial Science · 年份：2007 · DOI：10.1002/qsar.200710043 · 被引用次数：804 · 研究领域：Spectroscopy and Chemometric Analyses、Computational Drug Discovery Methods、Metabolomics and Mass Spectrometry Studies

Abstract This paper tries to explore the optimum variable selection strategy for Partial Least Squares (PLS) regression using a model dataset of cytoprotection data. The compounds of the dataset were classified using K‐means clustering technique applied on standardized descriptor matrix and ten combinations of training and test sets were generated based on the obtained clusters. For a particular training set, PLS models were developed with a number of components optimized by leave‐one‐out Q2 and then the developed models were validated (externally) using the test set compounds. For each set, PLS model was initially constructed using all descriptors (variables). The variables having least standardized values of regression coefficients were deleted and the next model was developed with a reduced set of variables. These steps were performed several times until further reduction in number of variables did not improve Q2 value. In each case, statistical parameters like predictive R2 (R2pred), squared correlation coefficient between observed and predicted values with (r2) and without ($\rm{ r_0^{\rm{2}} }$ ) intercept and Root Mean Square Error of Prediction (RMSEP) were calculated from the test set compounds. In case of all ten sets, Q2 values steadily increase on deletion of variables while R2pred values do not show any specific trend. In no case, the highest Q2 and highest R2pred appear in the same trial, i.e., with the same combinations of variables. This suggests that from the...