Heteroskedasticity tests

Assume you have a variable y, which has an expectation and a variance. The expectation is often modeled using linear regression so that E(y) equals, on average, \beta_0 +\beta_1x. The origin of the variability in y is the residual. Now, standard econometric courses start with the simple notion of “constant variance”, which means that the variance of the disturbances is steady and is not related to any of the explanatory variables that were chosen to model the expectation, this is called homoskedasticity assumption. In fact, in real life it is rarely the case. Courses should start with the heteroskedasticity assumption as this is the prevalent state of the world. In almost any situation you will encounter, the variance of the dependent variable is not constant, it matters what is the x for which we want to determine the variance of y. So:

homoskedasticity assumption: The variance of y is unaffected by the value of x, and so is just a constant number throughout the sample.
heteroskedasticity assumption: The variance of y is affected by the value of x, and so is not a constant number, it changes with the values of x.

Implications
1. Your estimate for the vector \beta are still unbiased so your point estimation for E(y) are still valid in that sense.
2. Your estimate for the vector \beta are no longer the most efficient thing you can do. You can get more accurate estimate.
3. Your inference is troubled. Under heteroskedasticity, the confidence intervals are false as they were derived under homoskedasticity.

Testing for it
There are many ways, I give just a couple which are standard practice. I noticed many students learn how to perform the tests but have little idea why these tests work. After reading more than a couple of econometric text books I cannot really fault them as the explanations provided there are somewhat poor.

The two tests are related, the first is the Breusch–Pagan test (named after Trevor Breusch and Adrian Pagan). The second is White test. I read somewhere that white’s paper from 1980 is the most cited paper in economics, which points to the pervasive nature of the problem. We use the squared residual from the regression, denote it \widehat{e}^2 as an estimate for the variance. The reason is: V(residual) = E(residual^2) – E(residual)^2 = E(residual^2) – 0^2. So that is why \widehat{e}^2 is used to measure the variance of y. The idea is simple, we perform an extra regression called auxiliary regression:

    \[\widehat{e}^2  = \beta_0 + \beta_1 x + \nu,\]

and check if the regression is meaningful, that is, if one of the covariates is related to the variance of y. The statistic is \chi^2 distributed and is computed as (number of observations)*(R^2 of the auxiliary regression).

White test is only slightly different, we add the squares of the covariates and the cross product to check for a non-linear impact on the variance. The computation of the test statistic is the same.

Demonstration
We will use three variables, unemployment rate, Short rate and Industrial production. Data is public, you can just copy paste the code to load it.

?View Code RSPLUS
dat = as.matrix(read.table(file = "https://dl.dropbox.com/u/9409065/UnemployementData.txt") )
par(mfrow = c(3,1))
plot(dat[,1], ty = "l", main = "Unemployment Rate", xlab = "Time (1960 - 2012, Monthly)", ylab = " ")
plot(dat[,2], ty = "l", main = "Short Rate", xlab = "Time (1960 - 2012, Monthly)", ylab = " ")
plot(dat[,3], ty = "l", main = "Industrial Production",xlab = "Time (1960 - 2012, Monthly)", ylab = " ")

Unemployement Rate over time
Transform to stationary to avoid spurious regression,

?View Code RSPLUS
library(tseries)
adf.test(dat[,1])
kpss.test(dat[,1])
##
adf.test(diff(dat[,1])) # After first difference
kpss.test(diff(dat[,1]))
 
ddat = data.frame(apply(dat,2,diff))
colnames(ddat) <- c("UnemploymentRate","ShortRate","IP")

A regression:

?View Code RSPLUS
lm0 = lm(UnemploymentRate~ShortRate+ShortRate+IP, data = ddat) ; summary(lm0)
 
Call:
lm(formula = UnemploymentRate ~ ShortRate + ShortRate + IP, data = ddat)
 
Residuals:
    Min      1Q  Median      3Q     Max 
-0.5932 -0.0989 -0.0033  0.0997  0.7452 
 
Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept)  0.02179    0.00676    3.22  0.00134 ** 
ShortRate   -0.05562    0.01482   -3.75  0.00019 ***
IP          -0.15014    0.01439  -10.44  < 2e-16 ***
---
Signif. codes:  0***0.001**0.01*0.05 ‘.’ 0.1 ‘ ’ 1 
 
Residual standard error: 0.164 on 624 degrees of freedom
Multiple R-squared: 0.189,	Adjusted R-squared: 0.187 
F-statistic: 72.8 on 2 and 624 DF,  p-value: <2e-16

The Breusch–Pagan test – using a built-in function:

?View Code RSPLUS
library(lmtest)
bptest0 = bptest(lm0) ;bptest0
 
#studentized Breusch-Pagan test
#data:  lm0 
#BP = 14.2, df = 2, p-value = 0.0008316

The Breusch–Pagan test – just so you know what you are doing:

?View Code RSPLUS
alm = lm(lm0$res^2~IP+ShortRate, data = ddat) ; summary(alm)
Call:
lm(formula = lm0$res^2 ~ IP + ShortRate, data = ddat)
 
Residuals:
    Min      1Q  Median      3Q     Max 
-0.0572 -0.0237 -0.0160  0.0079  0.5179 
 
Coefficients:
             Estimate Std. Error t value Pr(>|t|)    
(Intercept)  0.028474   0.001905   14.95  < 2e-16 ***
IP          -0.014879   0.004051   -3.67  0.00026 ***
ShortRate   -0.000803   0.004172   -0.19  0.84745    
---
Signif. codes:  0***0.001**0.01*0.05 ‘.’ 0.1 ‘ ’ 1 
 
Residual standard error: 0.0462 on 624 degrees of freedom
Multiple R-squared: 0.0226,	Adjusted R-squared: 0.0195 
F-statistic: 7.22 on 2 and 624 DF,  p-value: 0.000793 
## Calculate the test statistic:
length(lm0$res)*summary(alm)$r.squared
#14.2

We can see the variable that is related to the variance is Industrial Production, or is it?..

White test – no built in function that I know of.

?View Code RSPLUS
blm = lm(lm0$res^2~ddat$IP+ ddat$ShortRate+I(ddat$IP^2)+I(ddat$ShortRate^2)+
I(ddat$IP*ddat$ShortRate)) # So we add squares and cross products
summary(blm)
## Calculate the test statistic:
length(lm0$res)*summary(blm)$r.squared 
#39

Here we see that the IP-squared.residual relation is less obvious. The variance of the dependent variable has non-linear relation with the variable Industrial Production as you can see in the following table:

Estimate Std. Error t.value P.val
(Intercept) 0.0248 0.0021 11.94 0.0000
IP -0.0070 0.0043 -1.62 0.1048
ShortRate 0.0018 0.0044 0.41 0.6833
I(IP^2) 0.0104 0.0027 3.79 0.0002
I(ShortRate^2) -0.0011 0.0028 -0.37 0.7084
I(IP * ShortRate) 0.0148 0.0100 1.48 0.1404

How to deal with it?
Weighted Least Squares (WLS) is a reasonable solution. We scale the equations so that observations with less information in them (high residuals) get lower weights. How much lower? proportional to their variance (squared residual) or to their standard deviation. Theoretically, if we knew the exact true variances, then WLS is better. However, we have one observation as an estimate of the variance, the estimated residual of each observation, and that residual is often a poor estimate for the unknown true residual which depend on the true generating process. So apart from the fact that you have only one, it is more often than not inaccurate estimate since you probably have not considered the “right” explanatory variables or the equation itself is not even linear. For those reasons, WLS is not as popular in practice as you might expect from the theory.
In R, it is very easy to do using the argument “weights” as follows:

?View Code RSPLUS
h = sqrt(lm0$res^2)
w = (1/h)/sum(1/(h))
par(mfrow = c(1,1))
plot(w~lm0$res, ty = "p", pch = 16, ylab = "Weights", xlab = "Residuals", main = "Weight function")

weight function

?View Code RSPLUS
lm1 = lm(UnemploymentRate~ShortRate+ShortRate+IP, data = ddat, weights = 1/w) ; summary(lm1)

To leave you with something to think about, does the regression resulting from the WLS procedure is better fit or worse fit in terms of R^2? higher R^2 or lower R^2 than the original regression with equal weights for all observation? (worse fit, but why?)

One thought on “Heteroskedasticity tests

  1. Pingback: Omitted Variable BiasEran Raviv

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Comment moderation is enabled. Your comment may take some time to appear.