2010-03-02
Burlington Repeals IRV
The second election held using IRV produced the foulup documented in this page, a year later they repealed IRV.

IRV Failure In The Real World

Well, it has happened. That thing that a few math nerd election theory wankers warned about but nay-sayers said could never happen has happened. Instant Runoff Voting has elected the wrong person.

In the 2009 March 3 Burlington Vermont election for Mayor an IRV election was held and you can see the results on their site. Burlington is very nice in that they publish data of all the votes that I can then feed into my own analysis software.

Here's a histogram of how people voted on the candidates. (Note, I've turned rankings (1st, 2nd, 3rd) around into ratings (higher values better) because that's the native data for my software. "5" == "1st", "4" == "2nd", ...)

Andy Montroll
RatingVotes
5
2062
4
2630
3
1398
2
497
1
119
votes6706
average3.897
Kurt Wright
RatingVotes
5
2949
4
996
3
712
2
705
1
728
votes6090
average3.777
Bob Kiss
RatingVotes
5
2586
4
1394
3
948
2
717
1
540
votes6185
average3.771
Dan Smith
RatingVotes
5
1305
4
2102
3
1803
2
752
1
132
votes6094
average3.606
James Simpson
RatingVotes
5
35
4
303
3
655
2
1041
1
1357
votes3391
average2.003
Write-in
RatingVotes
5
38
4
46
3
42
2
44
1
73
votes243
average2.720

When I look at this table I see that Andy Montroll has pretty good 1st-choice support and even broader 2nd-choice support. Kurt Wright and Bob Kiss however are the favorite of substantial but narrow populations with less support at lower levels. However, because IRV only looks at the highest-ranked slot on a ballot, it misses this and produces the following sequence:

Round 1Round 2Round 3Round 4Round 5
NameCountNameCountNameCountNameCountNameCount
Bob Kiss2585.5Bob Kiss2599.5Bob Kiss2606Bob Kiss2982Bob Kiss4314
Kurt Wright2952.5Kurt Wright2956.5Kurt Wright2963Kurt Wright3297Kurt Wright4064
Andy Montroll2063Andy Montroll2067Andy Montroll2080Andy Montroll2554Andy Montroll2554
Dan Smith1306Dan Smith1315Dan Smith1317Dan Smith1317Dan Smith1317
Write-in38Write-in39Write-in39Write-in39Write-in39
James Simpson35James Simpson35James Simpson35James Simpson35James Simpson35

That's a few votes off (less than 5, usually) compared to the copy on the Burlington website, but close enough and shows the same result. My software runs more rounds instead of dropping many low count choices in one round as their software does.

Here's what a virtual round robin election (Condorcet's method) looks like:

123456
1Andy Montroll40674597457362676658
2Bob Kiss34774314394655176149
3Kurt Wright36684064397552746063
4Dan Smith29983577379355736057
5James Simpson59184513097213338
6Write-in104116163117165
Andy Montroll was preferred over Bob Kiss by 4067 voters. 3477 voters had the reverse preference.
Andy Montroll was preferred over Kurt Wright by 4597 voters. 3668 voters had the reverse preference.
Andy Montroll was preferred over Dan Smith by 4573 voters. 2998 voters had the reverse preference.
Andy Montroll was preferred over James Simpson by 6267 voters. 591 voters had the reverse preference.
Andy Montroll was preferred over Write-in by 6658 voters. 104 voters had the reverse preference.

That first line below the table really says it all. In a head to head election, Andy Montroll should have beaten Bob Kiss by a 7.8% margin. A solid win.

This is an IRV failure. The IRV result is clearly not what people actually wanted. More people liked Montroll over Kiss than the other way around, but IRV elected the loser.

Nail this coffin shut, don't implement IRV anywhere else when there are obviously better methods.


See also my standing page on IRV's shortcomings: http://bolson.org/voting/irv/


Because it's my pet system, here's the Instant Runoff Normalized Ratings result:

Round 1Round 2Round 3Round 4Round 5
NameCountNameCountNameCountNameCountNameCount
Andy Montroll3739.74Andy Montroll3749.16Andy Montroll3826.04Andy Montroll4332.18Andy Montroll5435.69
Kurt Wright3499.25Kurt Wright3507.25Kurt Wright3562.94Kurt Wright3970.06Kurt Wright4405.94
Bob Kiss3380.66Bob Kiss3388.07Bob Kiss3466.98Bob Kiss3883.05Bob Kiss3883.05
Dan Smith3116.61Dan Smith3122.40Dan Smith3191.96Dan Smith3191.96Dan Smith3191.96
James Simpson927.82James Simpson930.72James Simpson930.72James Simpson930.72James Simpson930.72
Write-in96.51Write-in96.51Write-in96.51Write-in96.51Write-in96.51