New Multicollinearity Indicators in Linear Regression Models

International Statistical Review (Impact Factor: 0.72). 01/2007; 75(1):114-121. DOI: 10.1111/j.1751-5823.2007.00007.x
Source: RePEc

ABSTRACT Correlation is an important statistical issue for the Ordinary Least Squares estimates and for data-reduction techniques, such as the Factor and the Principal Components analyses. In this paper we propose new indicators for the multicollinearity problem in the multiple linear regression model. Copyright 2007 The Authors. Journal compilation (c) 2007 International Statistical Institute.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: In modeling approaches, artificial neural networks (ANNs) have a special place to address the nonlinear phenomena or curved manifold. Often one or other feature selection approach is used prior to ANN to feed the input variables for its models. The function of ‘selected’ versus ‘arbitrary’ features on the outcome of ANN models is investigated with a variety of objectively selected and arbitrarily chosen variables from chemical databases namely thiazolidinones, anilinoquinolines and piperazinoquinolines. For each database, its biological activity is considered as the dependent variable and the molecular descriptors from DRAGON software are used as explanatory variables. The selection sets are obtained from feature selection approaches namely, combinatorial protocol in multiple linear regression, stepwise regression and genetic algorithm. Apart from these, a large number of arbitrary sets have been created by randomly picking the descriptors from corresponding databases. The features of all sets have shown a variety of inter- and intra- set diversities. A three-layer back propagation ANN with Levenberg-Marquardt optimization algorithm has been used for modeling the phenomena. Regardless of the origin of the feature sets, the ANN models from a very large number of sets have well explained the activity and qualified themselves to be predictive models. Also, no specific pattern is apparent between the quality of ANN model and the origin of its input feature set. Since these results are unusual, the study is extended to a few more databases. All the results emphasized the innate ability of ANN in developing complex network of relations among features to estimate the target variable. This has prompted us to suggest that prior feature selection is not essential for ANN and it is a desirable option for meaningful outputs in terms of the rationale behind the inputs.
    QSAR & Combinatorial Science 11/2009; 28(11‐12):1487 - 1499. · 1.55 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: In this paper, we propose a new corrected variance inflation factor (VIF) measure to evaluate the impact of the correlation among the explanatory variables in the variance of the ordinary least squares estimators. We show that the real impact on variance can be overestimated by the traditional VIF when the explanatory variables contain no redundant information about the dependent variable and a corrected version of this multicollinearity indicator becomes necessary.
    Journal of Applied Statistics 01/2011; 38(7):1499-1507. · 0.45 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: A single Reed-Solomon (RS) codeword is transmitted in a channel where each transmitted symbol may experience a different interference level. Each received symbol is decoded using a hard decision mechanism, and the entire codeword is decoded using a bounded-distance (BD) decoder. Due to complexity and speed concerns, it is common practice to assume the probability of incorrect codeword decoding is negligible, and assume the decoder either correctly decodes the received codeword or fails the decoding process. However, we develop an efficient, recursive, mechanism for generating the approximation probabilities of correct decode, incorrect decode, and decoder failure. In the case where each symbol experiences the same fading level our approximation is a tight, and in the case where each symbol is faded differently we show a fast mechanism which gives a lower bound and upper bound
    01/1998; 2.