Monday, December 16, 2013

Dennis Lindley Passes Away

The loss of Dennis Lindley, yesterday, will be received with sadness by Bayesians - econometricians included.

Dennis was a major driving force in the formalization and dissemination of Bayesian thought.

Two posts that comment on his many contributions can be found here and here.

I recall presenting a Bayesian paper at a statistics conference in New Zealand in the 1970's, with Dennis in the front row. It was an unnerving experience!


© 2013, David E. Giles

Sunday, December 15, 2013

Proxy Variables and Biased Estimation

Here's a problem from the exam. that one of my econometrics classes sat recently. It's to do with some of the consequences of mis-specifying a regression model, and then applying OLS estimation.

Specifically, let's suppose that data-generating process (the correct model specification) is actually of the form:

                       y = Xβ + ε     ;   ε ~ [0 , σ2In] .                         (1)

However, we can't observe the k variables in the X matrix, and instead we replace them with k "proxy variables" (substitutes) that we can observe. So, the model that we actually estimate is:

                      y = X*β + v .                                                     (2)

The students were asked to show that the usual (unbiased) estimator of σ2 is actually biased in this case; and they were asked if they could determine the "direction" of the bias.

Friday, December 13, 2013

On Staying Awake in Class

Pedagogy Unbound  is "A place for college teachers to share practical strategies for today's classrooms."

Their blog today contains a lovely piece by David Gooblar, titled " 'Trucker Tricks' for Keeping Students Awake". Not that any of you would have such problems on either side of the rostrum in econometrics classes, I'm sure!

David writes:
"Of all the tips that have been posted at Pedagogy Unbound since the site’s launch in August, the one that has been read the most—by far—is titled “Help your students stay awake in class.” This, it seems, is what professors are most concerned about. Not student writing. Not the plague of plagiarism. Not even students who don’t participate in discussions. No, the most pressing problem facing college teachers today is merely getting their students to stay conscious for an hour and 15 minutes.
.......The tip is one (from an associate professor who) worked as a truck driver when he was a college student and now, as a teacher, he passes on his “trucker tricks” for staying awake to his students. 
......Crucially, (he) follows up these tips by inviting the students, at any time during class throughout the term, to stand up if they feel like they are getting sleepy. They can take their notebooks and stand at the back or side of the classroom. He tells them he’d much prefer a class full of standing students to one full of sleeping, or even just drowsy, students. 
.......So ask your students to stand up if they feel they are in danger of falling asleep. If it turns out that a number of them take you up on the offer, you can tell yourself that you’re getting a standing ovation." 
I'm going to try it out!

© 2013, David E. Giles

Thursday, December 12, 2013

Time for Some More Reading!

With the weekend upon us once again, it's time to settle down with the papers - the econometrics research papers, that is. Here are my latest picks:
  • Cook, S., D. Watson, and L. Parker, 2014. New evidence on the importance of gender and asymmetry in the crime-unemployment relationship. Applied Economics, 46, 119-126.
  • Fan, J., F. Han, and H. Liu, 2013. Challenges of big data analysis. Mimeo.
  • Hashmi, A. R., 2014. Competition and innovation: The inverted-U relationship revisited. Review of Economics and Statistics, in press.
  • Juselius, K., N. F. Moller, and F. Tarp, 2104. The long-run impact of foreign aid in 36 African countries: Insights from multivariate time series analysis. Oxford Bulletin of Economics and Statistics, in press.
  • Li, R., D. K. J. Lin, and B. Li, 2013. Statistical inference in massive data sets. Applied Stochastic Models in Business and Industry, 29, 399-409.
  • Sanderson, E. and F. Windmeijer, 2013. A weak instrument F-test in linear IV models with multiple endogenous variables. CEMMAP Working Paper CWP58/13, The Institute for Fiscal Studies.

© 2013, David E. Giles

Data Do Not Imply Science

As a follow-up to my recent post on Big Data, I recommend today's post by Jeff Leek on the Simply Statistics blog. It's titled. 'The key word in "Data Science is not Data, it is Science'.

Jeff says:
"Most people hyping data  science have focused on the first word: data. They care about volume and velocity and whatever other buzzwords describe data that is too big for you to analyze in Excel. .........
But the key word in data science is not "data"; it is "science". Data science is only useful when the data are used to answer a question. That is the science part of the equation. The problem with this view of data science is that it is much harder than the view that focuses on data size or tools. It is much, much easier to calculate the size of a data set and say "My data are bigger than yours"......"
Right on, Jeff!


© 2013, David E. Giles

When Everything Old is New Again

We see it with clothing styles. Not just hemline lengths, but also the widths of jacket lapels and guy's ties. How wide should the trouser legs be? Cuffs or no cuffs? Leave your clothes in the closet long enough, and there's a good chance they'll be back in style some day!

And so it is with econometrics. Here are just a few examples:

Monday, December 9, 2013

Random Variable?

A big HT to Ryan MacDonald for drawing this quote to my attention:
"While writing my book (Stochastic Processes, 1953) I had an argument with Feller. He asserted that everyone said "random variable" and I asserted that everyone said "chance variable." We obviously had to use the same name in our books, so we decided the issue by a stochastic procedure. That is, we tossed for it and he won."

Joe Doob, in Statistical Science 12 (1997), No. 4, page 307.

Added - thanks to Arthur Charpentier for this link..

© 2013, David E. Giles

Friday, December 6, 2013

The Washing Machine Repairman

Here's a fun quote.
"As I remember, Bill X fixed my washing machine. My husband, Harry X, brought him home to talk economics after a Cambridge dinner in hall and they walked in on my frustration with the washer. I met a slight-statured, quiet man who modestly asked if he could help. He tried something with a screw-driver which may have worked - or perhaps it didn't work - and went back to talking economics'"

Who were  "Harry" and Bill?


© 2013, David E. Giles

Thursday, December 5, 2013

Econometrics and "Big Data"

In this age of "big data" there's a whole new language that econometricians need to learn. Its origins are somewhat diverse - the fields of statistics, data-mining, machine learning, and that nebulous area called "data science".

What do you know about such things as:
  • Decision trees 
  • Support vector machines
  • Neural nets 
  • Deep learning
  • Classification and regression trees
  • Random forests
  • Penalized regression (e.g., the lasso, lars, and elastic nets)
  • Boosting
  • Bagging
  • Spike and slab regression?

Probably not enough!

If you want some motivation to rectify things, a recent paper by Hal Varian will do the trick. It's titled, "Big Data: New Tricks for Econometrics", and you can download it from here. Hal provides an extremely readable introduction to several of these topics.

He also offers a valuable piece of advice:
"I believe that these methods have a lot to offer and should be more widely known and used by economists. In fact, my standard advice to graduate students these days is 'go to the computer science department and take a class in machine learning'."
Interestingly, my son (a computer science grad.) "audited" my classes on Bayesian econometrics when he was taking machine learning courses. He assured me that this was worthwhile - and I think he meant it! Apparently there's the potential for synergies in both directions.


© 2013, David E. Giles

Wednesday, December 4, 2013

The International Association for Applied Econometrics

Here's an organisation that deserves promoting - The International Association for Applied Econometrics. What more can I say?

Well, I had better add something!

First:
"The aim of the Association is to advance the education of the public in the subject of econometrics and its applications to a variety of fields in economics, in particular, but not exclusively, by advancing and supporting research in that field, and disseminating the results of such useful research to the public."
Second:

There next Annual Conference will be held in London, U.K., in June 2014, and the line-up of keynote speakers is impressive. Submissions of papers are due by 1 February 2014, and there is a nice prize for the best paper presented by a graduate student.


© 2013, David E. Giles