Thursday, October 30, 2014

Testing......1, 2, 3, ......

I often think that most courses in econometric theory are somewhat unbalanced. Much more attention is given to estimation principles and estimator properties than is given to the principles of hypothesis testing, the properties of tests.

This always strikes me as somewhat ironic. In econometrics we're at least as interested in testing some interesting economic hypotheses as we are in estimating some particular parameters.

For that reason, even my introductory undergraduate "economic statistics" course always includes some basic material on the properties of tests. By this I mean properties such Uniformly Most Powerful; Locally Most Powerful; Consistent; and Unbiased. (With respect to the last two properties I do  mean test properties, not estimator properties.)

After all, when you're first learning about hypothesis testing, it's important to know that there are sound justifications for using the particular tests that are being taught. We don't use the "t-test" simply because it was first proposed by a brewer! Or, for that matter, because tables of critical values are in an appendix of our text book. We use it because, under certain circumstances, it is Uniformly Most Powerful (against one-sided alternative hypotheses).

If tests aren't motivated and justified in this sort of way, we're just dishing out recipes to our students. And I've never liked the cookbook approach to the teaching of statistics or econometrics.

There's a lot to blog about when it comes to hypothesis testing. In some upcoming posts I'll try and cover some testing topics which, in my view, are given too little attention in traditional econometrics courses.

To whet your appetite - the first two will be about the distributions of some standard test statistics when the null hypothesis is false; and how this information can be used to compute some power curves.

© 2014, David E. Giles