Measuring basketball
November 6, 2007 2:16 am by donaldThere is a (relatively) large upheaval in sports right now. The situation is similar to Wall Street a decade or more ago, when traders bought and sold stocks based on gut feeling and inside knowledge about a particular industry. Then came the quants — PhDs in quantitative disciplines such as Physics and Mathematics from the ivory tower — and their mathematical models that told people when to buy and when to sell. Wall Street has never been the same since…
The quants are now making a headway in sports. The success story has been baseball, where quantitative analysis has even made its way into the mainstream media. The relatively-avid baseball fan knows a bit about Billy Beane, Bill James, Baseball Prospectus, and SABR. It’s not uncommon for baseball to hire people with outstanding quantitative skills and limited traditional baseball experience (and this). It’s safe to say that quants have very much influenced baseball — people are now paying attention to the various statistics and measures that they’ve come up with (value over replacement, etc.).
Football seems to be the next sport to topple. One could actually argue that it’s already been toppled, what with the BCS already being decided by a bunch of freaking computers. Coaches are already paying attention to quants; Belichick might not be running up the score this season when he goes for it on fourth down in the fourth quarter — he might just be following the optimal dynamic programming schedule. It’s known that he’s read it.
And of course, basketball is seeing the eggheads. There’s Daryl Morey, who taught a course at MIT titled “Analytical Sports Management”, now as GM of the Rockets. And just this season, Ken Pomeroy has started a website Basketball Prospectus (named after the wildly successful Baseball Prospectus site) that takes an analytical approach to college basketball.
Now, don’t get me wrong. I am a man of science, and I truly believe in the power of reason over gut feelings. But I have strong reservations about such quantitative approaches to basketball. Baseball is a discrete game very amenable to analysis — each at-bat is reasonably well-approximated by just two players interacting (the pitcher and the hitter), each at-bat can reasonably be taken to be independent of previous at-bats, etc. It’s these simplifying assumptions that allow observations such as on-base percentage is what matters, not your hitting percentage. It allows people to reasonably simulate a baseball game and determine what order of hitters is optimal. My belief is that it’s these reasonable assumptions that have allowed quants to have such a large effect on baseball. I’m less of a believer that quantitative analysis can model football well, but I believe two things make football amenable to quantitative analysis — the first is that it’s discrete, so that events can be separated from one another with ease. The second is that most everything is planned — and it’s the plays that largely dictate play, rather than individual improvisation.
Basketball, on the other hand, has nothing going for it — something that happens on one side of the court directly affects the play on the other side, so the separability from play to play doesn’t exist. Individual improvisation is everything; sure, college run offenses and defenses, but more often than not those are general methodologies of play, rather than specific instructions as in football or baseball. Statistics that quants have been pushing for — pace-independent measures of ball security (turnovers divided by posessions), effective field goal percentage (weight three point makes more than two point makes) — make sense, but I don’t believe they capture basketball in the same way the measures do in baseball and football. Of course, I would love to be proven wrong.
Categories: Commentary, donald



















5 Responses to “Measuring basketball”
Great article. You’re right about football being as discrete as baseball. Basketball is totally, totally different. Like soccer, it’s the flow of the game that matters rather tahn individual plays. Sure, plays matter, and good plays matter alot, but it’s all about controlling the flow of the game, and how exactly do you find an exact science to that?
I have been an avid fan of D1 basketball for over 40 years and resisted applying quantitative analysis to the game. The stats, even the per game numbers told me very little about the player. I took a look at Ken Pomeroy’s tempo-free stats approach (pioneered by Dean Oliver), however and realized that using pace as the constant metric allowed me to understand a number of “things” I was watching on the court. It does provide a slightly different way of breaking the game down to see how the players interact (or don’t interact). The development of even more sophisticated techniques will bring more insight over time.
I love to watch the game, but I bring a slightly different way of organizing and interpreting what I see on the court. I does not diminish my appreciation of a well orchestrated offense (like the Princeton Offense used by your Hoyas), nor does it stop me from yelling at the top of my lungs for my favorite teams. It’s basketball for heaven’s sake, that will never change!
I understand what you’re saying (and thanks for the correct reference wrt tempo-free stats).
What’s interesting to me is that in baseball, you can reasonably consider each player independent of each other and determine good lineups based on individual player ratings. In football, this is more difficult to do, but I believe football is more about strategy than the individual talents of any one given player; as a result, it becomes more about analyzing the effectiveness of plays (which is still difficult to do).
With basketball, you don’t get either. The numbers still say something and can be used to understand what’s going on, but I wonder how they can be used strategically.
Anyway, great blog (we’ll keep an eye on it over here at Big East Hoops).
It seems to me you’d have to come up with some quasi-qualitative unconventional stats. Like “shot quality” which could be some combination of the shot distance, the amount of pressure from the defense, and the player’s shot-making ability.
Very interesting to see what might come out of this field.
[...] The authors at Basketball Prospectus should not be new to anyone–John Gasaway (Big Ten Wonk) and Ken Pomeroy (kenpom.com) continue what they started as “part-time” hobbies (good idea!) at this Baseball Prospectus spinoff. I’m a long-time junkie of the original BP. The baseball formula worked very well, and there’s little reason not to expect the same for other sports. Donald might not agree, but I see a lot of potential for basketball research. There’s a huge gulf between what announcers say and what really matters. If baseball provides any indication, this gulf will persist for quite a long time, if not forever. Analysis will inevitably invade the mainstream — I’ll put the over/under on Jim Nance dropping “tempo-based ratings” in context at 5 years. [...]
Care to comment?