Pages

Yo Momma is a Data Miner

Having a lot of data makes research easier - we now have more data in easily readable formats than ever before, and an amazing amount of computing power on our desktops (I have far more horsepower on my desk than NASA had in total in the 1980s)..

Unfortunately, there's a flip side to that coin - we can easily find variables (or specifications) that seem to "predict" returns (or just about anything). In reality, we're often just overfitting the data.

Here's a pretty good piece on the topic titled "Yo Momma is a Data Miner", by David Leinwebber in which he fits a polynomial time-series regression to the S&P 500 with surprising (if you don;t follow what he's doing) good results - particularly since he's using things like the sheep population and Bangladesh Butter production as regressors.

0 comments:

Post a Comment

  • Stiglitz the Keynesian... Web review of economics: Stigliz has an article, "Capitalist Fools", in the January issue of Vanity Fair. He argues that the new depression is the result of:Firing...
  • It's Never Enough Until Your He... Web review of economics: Aaron Swartz quotes a paper by Louis Pascal posing a thought experiment. I wonder if many find this argument emotionally unsatisfying. It...
  • Michele Boldrin Confused About Marx... Web review of economics: Michele Boldrin has written a paper in which supposedly Marxian themes are treated in a Dynamic Stochastic Equilibrium Model (DSGE). He...
  • Negative Price Wicksell Effect, Pos... Web review of economics: 1.0 IntroductionI have previously suggested a taxonomy of Wicksell effects. This post presents an example with:The cost-minimizing...
  • Designing A Keynesian Stimulus Plan... Web review of economics: Some version of this New York Times article contains the following passage:"A blueprint for such spending can be found in a study financed...
  • Robert Paul Wolff Blogging On Books... Web review of economics: Here Wolff provides an overview of Marx, agrees with Morishima that Marx was a great economist, and mentions books by the analytical...
  • Simple and Expanded Reproduction... Web review of economics: 1.0 IntroductionThis post presents a model in which a capitalist economy smoothly reproduces itself. The purpose of such a model is not to...
  • How Individuals Can Choose, Even Th... Web review of economics: 1.0 IntroductionI think of this post as posing a research question. S. Abu Turab Rizvi re-interprets the primitives of social choice theory...