New Multicollinearity Indicators in Linear Regression Models

International Statistical Review (Impact Factor: 1.2). 04/2007; 75(1):114-121. DOI: 10.1111/j.1751-5823.2007.00007.x
Source: RePEc


Correlation is an important statistical issue for the Ordinary Least Squares estimates and for data-reduction techniques, such as the Factor and the Principal Components analyses. In this paper we propose new indicators for the multicollinearity problem in the multiple linear regression model.
La corrélation c'est une issue statistique importante pour les évaluations des moindres carrés ordinaires et pour les techniques de réduction de données, telles que l' analyse factorielle et l'analyse des composants principaux. Dans l'étude on peut trouver des nouvelles cotes pour évaluer le problème de multicollinearité dans le modèle de régression linéaire.

31 Reads
  • Source
    • "Some recent works have analyzed and proposed some improvements and alternatives for the VIF as a measure of the existence of collinearity. For example, Dias and Castro [4] propose new indicators to this problem in the multiple linear regression model. Dias and Castro [5] show that the real impact on variance can be overestimated by the traditional VIF when the explanatory variables contain no redundant information about the dependent variable and propose corrected version of this collinearity indicator. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Ridge regression has been widely applied to estimate under collinearity by defining a class of estimators that are dependent on the parameter k. The variance inflation factor (VIF) is applied to detect the presence of collinearity and also as an objective method to obtain the value of k in ridge regression. Contrarily to the definition of the VIF, the expressions traditionally applied in ridge regression do not necessarily lead to values of VIFs equal to or greater than 1. This work presents an alternative expression to calculate the VIF in ridge regression that satisfies the aforementioned condition and also presents other interesting properties.
    Journal of Applied Statistics 03/2015; 42(3). DOI:10.1080/02664763.2014.980789 · 0.42 Impact Factor
  • Source
    • "They ascertain the degree of diversity within and in between feature sets. In addition to this, the descriptors of each set were analyzed for the multicollinearity using Variance Inflation Factor (VIF) (equation 3) [34] [35]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: In modeling approaches, artificial neural networks (ANNs) have a special place to address the nonlinear phenomena or curved manifold. Often one or other feature selection approach is used prior to ANN to feed the input variables for its models. The function of ‘selected’ versus ‘arbitrary’ features on the outcome of ANN models is investigated with a variety of objectively selected and arbitrarily chosen variables from chemical databases namely thiazolidinones, anilinoquinolines and piperazinoquinolines. For each database, its biological activity is considered as the dependent variable and the molecular descriptors from DRAGON software are used as explanatory variables. The selection sets are obtained from feature selection approaches namely, combinatorial protocol in multiple linear regression, stepwise regression and genetic algorithm. Apart from these, a large number of arbitrary sets have been created by randomly picking the descriptors from corresponding databases. The features of all sets have shown a variety of inter- and intra- set diversities. A three-layer back propagation ANN with Levenberg-Marquardt optimization algorithm has been used for modeling the phenomena. Regardless of the origin of the feature sets, the ANN models from a very large number of sets have well explained the activity and qualified themselves to be predictive models. Also, no specific pattern is apparent between the quality of ANN model and the origin of its input feature set. Since these results are unusual, the study is extended to a few more databases. All the results emphasized the innate ability of ANN in developing complex network of relations among features to estimate the target variable. This has prompted us to suggest that prior feature selection is not essential for ANN and it is a desirable option for meaningful outputs in terms of the rationale behind the inputs.
    QSAR & Combinatorial Science 11/2009; 28(11‐12):1487 - 1499. DOI:10.1002/qsar.200960074 · 1.55 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: A single Reed-Solomon (RS) codeword is transmitted in a channel where each transmitted symbol may experience a different interference level. Each received symbol is decoded using a hard decision mechanism, and the entire codeword is decoded using a bounded-distance (BD) decoder. Due to complexity and speed concerns, it is common practice to assume the probability of incorrect codeword decoding is negligible, and assume the decoder either correctly decodes the received codeword or fails the decoding process. However, we develop an efficient, recursive, mechanism for generating the approximation probabilities of correct decode, incorrect decode, and decoder failure. In the case where each symbol experiences the same fading level our approximation is a tight, and in the case where each symbol is faded differently we show a fast mechanism which gives a lower bound and upper bound
Show more