Econlib Resources
Subscribe to EconLog
XML (Full articles)RDF (Excerpts) Feedburner (Oneclick subscriptions) Subscribe by author
Bryan CaplanDavid Henderson Scott Sumner Subscribe by email
More
FAQ
(Instructions and more options)

TRACKBACKS (3 to date)
TrackBack URL: http://econlog.econlib.org/mt/mttb.cgi/363
The author at Mahalanobis in a related article titled Collinearity writes:
COMMENTS (14 to date)
Radford Neal writes:
The critique by Rummel suffers from at least two statistical misconceptions. First, as quoted in the post above, he says If two independent variables are highly correlated they are no longer statistically independent, and the first one entered into the regression, in this case economic freedom, steals that part of the correlation it has with democracy from the dependent variable. Thus, economic freedom is highly significant, while democracy is not. But for a simple regression model, the order of the variables is irrelevant. The first doesn't "steal" the correlation from the second  the standard errors for both are simply increased. He goes on to express a second misconception: (An important statistical point about his use of significance tests  he is not analyzing a sample, but the universe of cases  thus standard significance tests are irrelevant). This is totally wrong. We already know what wars were fought in the past. The whole purpose of the study is to predict what might happen in the future. The future cases are NOT in the available sample. Signficance tests are entirely appropriate. I haven't read the original study, so I can't say whether it was competently done, but Rummel's critique certainly provides no grounds for doubting its validity. InsertTextHere Posted September 20, 2005 3:20 PM
Robert Book writes:
If you don't have a lot of data, then again your standard errors tend to be large. As well they should be! If you have three data points, you should be uncertain of your results. Yes, but if you have only two data points, you should be uncertain of your results, but you'll appear to be very certain! (In a problem with one independent variable.) Actually, now that I think about it, if you have three data points and a problem with two independent variables, you'll appear to be very certain also, though you should not be! Posted September 20, 2005 3:37 PM
JAV writes:
I'm puzzled by this post. I'll take a simplified example to highlight my confusion. It's been a while since I did stats so pardon me if I make elementary errors. Let aD + bE = P A possible soln (when P=101, and D =1) would be (a =1, b=50), another soln would be (a=99, b=1) and so on. So as you put it, the effects of different variables on the output are highly uncertain. Gartzke is claiming Economic freedom as more significant than Democracy. I feel one should really be hesitant to draw that conclusion. One could easily draw erroneous conclusions about the effects the different variables have. PS: If E.F and Democracy are highly correlated then how could E.F be 50 times more effective than Democracy!! Posted September 21, 2005 11:23 AM
jsmith99 writes:
Robert Book writes, Yes, but if you have only two data points, you should be uncertain of your results, but you'll appear to be very certain! (In a problem with one independent variable.) That's very true. If there are only two data points for a model with a constant term and an independent variable, you have zero degree of freedom. Ordinary least square regression will therefore give you not only a perfect fit, but also infinitely large standard errors. You'll appear to be very certain because you see a perfect fit, but you should be uncertain of you results becasue the standard errors are infinitely large. Posted September 22, 2005 4:41 AM
dsquared writes:
Peter Kennedy's "Guide to Econometrics" is also very good on this subject, pointing out that with a small number of exceptions (he doesn't use the example, but John Lott's work on the 2000 Florida elections where he more or less intentionally constructed a model so as to be collinear would be one of the exceptions), multicollinearity is a feature of the data, not of the model, and to claim that "the data are biased" brings into sharp relief how silly most critiques of multicollinearity are. Posted September 22, 2005 7:21 AM
Aaron Chalfin writes:
It all depends on the context. If you are using the regression model primarily to predict y, there will not be any bias (though due to high standard errors the prediction may not be very good.) On the other hand, if you are using the model to determine the relative impacts of X1 vs. X2, you may have a problem. Posted September 22, 2005 9:02 AM
Roger McKinney writes:
My experience with regression comes from the quality control field where you must have independent predictor variables in order to determine which one causes the defect. We achieved independence by designing experiments. But if we had to use historical data instead, we would sove the problem of multicollinearity by using factor analysis or partial least squares, both of which combine the data into fewer, but independent predictors. It works quite well. I've done something similar with the Heritage Foundation's Freedom Index and found that all of their variables fit nicely into just two orthogonal factors. Posted September 22, 2005 10:30 AM
Roger McKinney writes:
One more thought: My experience has been that with correlated predictors, the coefficients change, sometimes even the sign, as you enter and remove different predictors. So if they're as highly correlated as are economic freedom and democracy, which coefficients are correct? In addition to Rummel's suggestion of using factor analysis, I would think that the Cato authors would have at least tried stepwise regression, which often retains the strongest predictor and drops the weaker ones. Posted September 22, 2005 10:41 AM
Aaron Chalfin writes:
This is what I was getting at. Cato is trying to use regression to directly compare the strength of various predictors (economic freedom & democracy). So they do not want to drop either variable from the regression. As much as I love to apply regression to almost any set of data I can find, I think this might be a time when a series of thoughtful case analyses would be more convincing than regression. Posted September 22, 2005 10:56 AM
Jon writes:
Rummel seems to be stale on multilinear regression. He proposes orthogonalization as a "cure". This does nothing to address the question. If two variables a and b are highly correlated, orthogonalization would just replace them by something like a+b and ab. This does nothing to resolve the cause and effect issue of whether a or b is more significant. There are other problems with the CATO study though. First, does lack of economic freedom cause war or is it a result of the same factors causing war or does war cause a loss of economic freedom. Secondly, "economic freedom" is a myriad of items. Some may prevent war and some may make it more likely. For example leading up to war, a government may impose higher taxes and inact rationing. There may also be mandatory conscription and restrictions on imports or exports. Posted September 23, 2005 6:47 AM
Roger McKinney writes:
Rummel isn't stale; he's stating a fact: When two predictors are highly correlated, you can't compare the strengths of their effects. My experience has been that regression will take the slightly stronger effect and give it a large coefficient, then, as if to compensate, give the slightly weaker effect a very low coefficient or even an opposite sign. If Cato would leave out economic freedom, they would find the coefficient of democracy increasing dramatically. The best one can say in this situation is that the two go together and it's impossible to separate the impact of one from the other. Posted September 23, 2005 9:23 AM
Aaron Chalfin writes:
What Cato could have tried is a test to see if economic freedom is either a mediator or a moderator of democracy or vice versa. My own guess is that democracy explains why there is a relationship between economic freedom and violence/warfare and is therefore a partial mediating variable in the analysis. In other words, the relationship between economic freedom and warfare is made stronger by the inclusion of democracy. Posted September 23, 2005 11:25 AM
Bill Stepp writes:
Rummel also thinks that no democracies ever fought a war against each other, which is contradicted by both the Civil War (or War of Southern Independence/Northern Aggression) and WW One. Posted September 23, 2005 6:35 PM
Rudy Rummel writes:
RE: your comments on my use of the term multicollinearity, see my Monday blog (9/25/05) for a "Little Primer on Multicollinearity" at: http://freedomspeace.blogspot.com/ This is not to say you should read such a primer, but simply to bring it to your attention. Posted September 25, 2005 1:08 PM
Comments for this entry
have been closed

