Pollster quality

Here I compare the final polls of the pollsters to the election outcome. I hope this makes clear why I consider the Politieke Barometer the best pollster.

The average error averages all errors of each pollster, where the most recent error counts double.

Pollster errors

Lower numbers are better. The calculation is as follows:

  1. For each misassigned seat one point is given. In 2003 the Barometer gave the CDA two seats too few, the LPF one too few, the CU two too many, and the PvdA one too many. Thus it misassigned three seats and gets three points.
  2. If the pollster sees a party entering parliament but it wins zero seats, or if a party enters parliament but a pollster gives it zero seats, it gets an extra point.
    In 2010 Een Vandaag and TNS-NIPO both gave TON one seat, while it did not enter parliament. They both get a point because they were wrong about TON, in addition to the point for the misassigned seat.
  3. If the pollster incorrectly predicts the largest party it gets an extra point. In 2003 all pollsters showed the PvdA larger than the CDA, and they were all wrong and all get an extra point.

The PAM is the Politieke Aandelenmarkt (Political Stock Market), an initiative of De Volkskrant, which was supposed to give better results than the pollsters but didn’t. I played in 2006.

In 2010 I drew an average of the polls; I think I just averaged the numbers without weighting or other subtle tweaks. Since the pollsters were fairly close I also was fairly close. In 2012 I use the results of my poll average.

Poll data over 2002-2006 come from Cijfers.net.

2012

PvdA and especially VVD were underestimated by all pollsters — clearly a last-minute prime-minister race effect boosted them both, mostly to the detriment of the SP. Also, the PVV was overestimated for the first time, and by a lot less seats than it was underestimated in 2010. The theory that they lost last-minute seats to the VVD is defensible. So maybe the PVV is becoming predictable.

2010

In 2010 all pollsters underestimated Wilders’s PVV for the second time running, which is why it is a difficult party to predict. Some polls again missed the fact that the PVV would be the only extreme right party in parliament.

Also, the CU’s loss of one seat was not predicted (and Intomart even predicted a ridiculous 10 seats).

2006

All pollsters underestimated Wilders’s PVV, and only TNS-NIPO saw that it would be the only extreme right party — the others have one or two others win a few seats. Also, the SP polls diverged very widely.

2003

All pollsters but the PAM had the PvdA a tiny bit larger than the CDA, but in the elections the CDA became the biggest. This is a classic prime-minister-race effect.

2002

The big surprise was that the CDA grew a lot more than expected, and GL and CU lost one seat instead of winning a few. CU to CDA is a logical movement.

All pollsters got big newcomer LPF (List Pim Fortuyn) about right.

1998

Data as yet incomplete; Peil.nl is missing. And to be honest I’m not totally sure I got the very badly formatted data right, or whether it’s reliable. I mean, did they really predict 3 seats for Janmaat?