Brexit polling
Others can discuss elsewhere the broader implications of Brexit. I want to make a few brief points about the Brexit polling.
The polls were about as accurate as I’d expect. Mostly they reported that the referendum was going to be close. Generally, their interval of expected outcomes included the critical 50 per cent level. I’d say the result was not unexpected by the models.
But probabilistic thinking is more difficult for humans. The focus of polling often seems to be the middle number. I think this means that pollsters have failed to communicate properly polling results. We need to get better at it, and I see this as the actionable lesson of the Brexit polling.
Petit Poll is as guilty of that as anyone else. I’m not sure that we have time to fix this before the Australian election, but we need to improve in the longer term. There are implications not just for polling, but also for forecasting more generally.
I’m not saying there weren’t mistakes made around turnout assumptions, sampling etc, - there were. But I’m not sure how it could have been done better, given the constraints. The rare nature of the Brexit referendum made is difficult to use history. So I don’t see these mistakes as actionable, especially compared with the glaring need to improve the way that polling firms communicate.
Some related posts: New York Times: http://www.nytimes.com/2016/06/25/upshot/why-the-surprise-over-brexit-dont-blame-the-polls.html Gelman: http://andrewgelman.com/2016/06/24/brexit-polling-what-went-wrong