Showing posts with label LDV models. Show all posts
Showing posts with label LDV models. Show all posts

Friday, September 22, 2017

Misclassification in Binary Choice Models

Several years ago I wrote a number of posts about Logit and Probit models, and the Linear Probability Model LPM). One of those posts (also, see here) dealt with the problems that arise if you mis-classify the dependent variable in such models.  That is, in the binary case, if some of your "zeroes" should be "ones", and/or vice versa.

In a conventional linear regression model, measurement errors in the dependent variable are not a biog deal. However, the situation is quite different with Logit, Probit, and the LPM.

This issue is taken up in detail in an excellent, recent, paper by Meyer and Mittag (2017), and I commend their paper to you.

To give you an indication of what those authors have to say, this is from their Introduction:
".....the literature has established that misclassification is pervasive and affects estimates, but not how it affects them or what can still be done with contaminated data. This paper characterizes the consequences of misclassification of the dependent variable in binary choice models and assesses whether substantive conclusions can still be drawn from the observed data and if so, which methods to do so work well. We first present a closed form solution for the bias in the linear probability model that allows for simple corrections. For non-linear binary choice models such as the Probit model, we decompose the asymptotic bias into four components. We derive closed form expressions for three bias components and an equation that determines the fourth component. The formulas imply that if misclassification is conditionally random, only the probabilities of misclassification are required to obtain the exact bias in the linear probability model and an approximation in the Probit model. If misclassification is related to the covariates, additional information on this relation is required to assess the (asymptotic) bias, but the results still imply a tendency for the bias to be in the opposite direction of the sign of the coefficient."
This paper includes a wealth of information, including some practical guidelines for practitioners.

Reference

Meyer, B. D. and N. Mittag, 2017. Misclassification in binary choice models. Journal of Econometrics, 200, 295-311.

© 2017, David E. Giles

Saturday, June 3, 2017

June Reading List

Here are some suggestions for you:
  • Ai, C. and E. C. Norton, 2003. Interaction terms in logit and probit models. Economics Letters, 80, 123-129.
  • Hirschberg, J. and J. Lye, 2017. Inverting the indirect - the ellipse and the Boomerang: Visualizing the confidence intervals of the structural coefficient from two-stage least squares. Journal of Econometrics, in press.
  • Kim, I. and S. Park, 2017. Likelihood ratio tests for multivariate normality. Communications in Statistics - Theory and Methods, in press.
  • Knotek, E. S. and S. Zaman, 2017. Financial nowcasts and their usefulness in macroeconomic forecasting. Working Paper 17-02, Federal Reserve Bank of Cleveland.
  • Marczak, M. and V. Goméz, 2017. Monthly US business cycle indicators: A new multivariate approach based on a band-pass filter. Empirical Economics, 52, 1379-1408.
  • Sherwood, C. and D. W. Kwak, 2017. New insights into an old problem - enhancing student learning outcomes in an introductory statistics course. Applied Economics, in press.
© 2017, David E. Giles

Saturday, December 24, 2016

Top New Posts of 2016

Thank you to all readers of this blog for your continued involvement during 2016.

Of the new posts released this year, the Top Five in terms of page-views were:
  1. Forecasting From an Error Correction Model
  2. I Was Just Kidding......!
  3. Choosing Between the Logit and Probit Models
  4. The Forecasting Performance of Models for Cointegrated Data
  5. A Quick Illustration of Pre-Testing Bias
Season's greetings!

© 2016, David E. Giles

Sunday, November 6, 2016

The BMST Package for Gretl

As a follow-up to this recent post, I heard again from Artur Tarassow.

You'll see from his email message below that he's extended his earlier work and has prepared a new package for Gretl called "Binary Models Specification Tests".

It's really good to see tests of this type being made available for users of different software - especially free software such as Gretl.

Artur writes:

Wednesday, November 2, 2016

Specification Tests for Logit Models Using Gretl

In various earlier posts I've commented on the need for conducting specification tests when working with Logit and Probit models. (For instance, see here, here, and here.) 

One of the seminal references on this topic is Davidson and MacKinnon (1984). On my primary website, you can find a comprehensive list of other related references, together with EViews files that will enable you to conduct various specification tests with LDV  models.

The link for that material is here.

Today I had an email from Artur Tarassow at the University of Hamburg. He wrote:
I know that you're already aware of the open-source econometric software called "Gretl". 
I would like to let you know that I updated my package "LOGIT_HETERO.gfn". This package runs both the tests of homoskedasticity and correct functional form based on your nice program "Logit_hetero.prg" written for EViews.
If you want to have a look at it, simply run:
    set echo off
    set messages off
    install LOGIT_HETERO.gfn
    include LOGIT_HETERO.gfn
    open http://web.uvic.ca/~dgiles/downloads/binary_choice/Logistic_Burr.wf1
    logit Y 0 X1 X2
    matrix M = LOGIT_HETERO(Y,$xlist,$coeff,1)
    print M
Thanks for this, Artur - I'm sure it will be very helpful to many readers of this blog.

Footnote: See Artur's comment below, and the more recent post here. In particular, note Artur's comment: As a note to your blog readers: The two Logit model related packages “logit_burr.gfn” and “LOGIT_HETERO.gfn” are not available any more, as BMST includes both of them.

Reference

Davidson, R. & J. G. MacKinnon, 1984. Convenient specification tests for logit and probit models. Journal of Econometrics, 25, 241 262.

© 2016, David E. Giles

Saturday, June 25, 2016

Choosing Between the Logit and Probit Models

I've had quite a bit say about Logit and Probit models, and the Linear Probability Model (LPM), in various posts in recent years. (For instance, see here.) I'm not going to bore you by going over old ground again.

However, an important question came up recently in the comments section of one of those posts. Essentially, the question was, "How can I choose between the Logit and Probit models in practice?"

I responded to that question by referring to a study by Chen and Tsurumi (2010), and I think it's worth elaborating on that response here, rather than leaving the answer buried in the comments of an old post.

So, let's take a look.

Friday, June 12, 2015

Specification Testing in the Ordered Probit Model

Readers of this blog will know I'm a proponent of more specification testing in the context of Logit, Probit, and related models. For, instance, see this recent post, and the links within it.

I received an email from Paul Johnson, Chair of the Department of Economics at Vassar College, today. He wrote:
"I thought that, given your interest in specification tests in probit etc. models, you might find the attached paper of mine (written some years ago) to be useful as it expounds the straightforward generalization of the Bera, et al. (1984) test to the ordered probit case."
Paul's paper is, indeed, very interesting and I hadn't seen it before. It's titled, "A Test of the Normality Assumption in the Ordered Probit Model", and it appeared in the statistics journal, Metron (1996, LIV, 213-221).

Here's the abstract:
"This paper presents an easily implemented test of the assumption of a normally distributed error term for the ordered probit model, As this assumption is the central maintained hypothesis in all estimation and testing based on this model, the test ought to serve as a key specification test in applied research. A small Monte Carlo experiment suggests that the test has good size and power properties."
A year later, a closely related paper by P. Glewwe appeared in Econometric Reviews. That author doesn't mention Paul's paper, but these things happen. Glewwe's paper does take things a little further than Paul does, by allowing for censoring of the data.

© 2015, David E. Giles

Wednesday, October 1, 2014

October Reading

October already!
  • Chauvel, C. and J. O'Quigley, 2014. Tests for comparing estimated survival functions. Biometrika, 101, 535-552. 
  • Choi, I., 2014. Unit root tests for dependent and heterogeneous micropanels. Discussion Paper No. 2014-04, Research Institute for Market Economy, Sogang University.
  • Cho, J. S. and H. White, 2014. Testing the equality of two positive-definite matrices with application to in formation matrix testing. Discussion Paper, School of Economics,Yonsei University.
  • Hansen, B. E., 2013. Model averaging, asymptotic risk, and regressor groups. Quantitative Economics, in press.
  • Miller, J. I., 2014. Simple robust tests for the specification of high-frequency predictors of a low-frequency series. Mimeo., Department of Economics, University of Missouri.
  • Owen, A. B. and P. A. Roediger, 2014. The sign of the logistic regression coefficient. American Statistician, in press.
  • Westfall, P. H., 2014. Kurtosis as peakedness, 1905-2014. R.I.P.. American Statistician, 68, 191-195.

© 2014, David E. Giles

Monday, June 3, 2013

Last Week's Reading

There are some great econometrics papers out there, just waiting to be read. I need more hours in the day!

Some of the papers I enjoyed reading last week were:
  • Barsoum, F. and S. Stankiewicz, 2013. Forecasting GDP growth using mixed-frequency models with switching regimes. Department of Economics, University of Konstanz, Working Paper 2013-10.
  • Castle, J. L., M. P. Clements, and D. F. Hendry, 2013. Forecasting by factors, by variables, by both or neither? Journal of Econometrics, in press.
  • Chiu, C. W., B. Eraker, A. T. Foerster, T. B. Kim, and H. D. Seoane, 2012. Estimating VAR's sampled at mixed or irregular spaced frequencies: A Bayesian approach. Federal Reserve Bank of Kansas City, Research Working Paper 11-11 (revised, December 2012).
  • Dufour, J-M. and J. Wilde, 2013. Weak identification in probit models with endogenous covariates.
  • Lim, H. K., J. Song, and B. C. Jung, 2013. Score tests for zero-inflation and overdispersion in two-level count data. Computational Statistics and Data Analysis, 61, 67-82.
  • Millimet, D. L. and I. K. McDonough, 2013. Dynamic panel data models with irregular spacing: With applications to early childhood development. IZA Discussion Paper 7359.
  • Pesaran, H. H., A. Pick, and M. Pranovich, 2013. Optimal forecasts in the presence of structural breaks. Journal of Econometrics, in press.

© 2013, David E. Giles

Friday, July 13, 2012

More Comments on the Use of the LPM

Alfredo drew my attention to Steve Pische's reply to a question raised by Mark Schaffer in the Mostly Harmless Econometrics blog. The post was titled, Probit Better than LPM? The question related to my own  posts (here, here, and here, in reverse order) on this blog concerning the choice between OLS (the Linear Probability Model - LPM) or the Logit/Probit models for binary data.

Thanks, Alfredo, as this isn't a blog I follow. 

Alfredo asked: "Would you care to respond? I feel like this is truly an exchange from which a lot of people can learn".

Friday, June 1, 2012

Yet Another Reason for Avoiding the Linear Probability Model

Oh dear, here we go again. Hard on the heels of this post, as well an earlier one here, I'm moved to share even more misgivings about the Linear Probability Model (LPM). That's just a fancy name for a linear regression model in which the dependent variable is a binary dummy variable, and the coefficients are estimated by OLS.

Another Gripe About the Linear Probability Model

NOTE: This post was revised significantly on 15 February, 2019, as a result of correcting an error in my original EViews code. The code file and the Eviews workfile that are available elsewhere on separate pages of this blog were also revised. I would like to thank Frederico Belotti for drawing my attention to the earlier coding error.

So you're still thinking of using a Linear Probability Model (LPM) - also known in the business as good old OLS - to estimate a binary dependent variable model?

Well, I'm stunned!

Yes, yes, I've heard all of the "justifications" (excuses) for using the LPM, as opposed to using a Logit or Probit model. Here are a few of them: