What can New Zealand’s Road Toll Teach us?

James K

James is a government policy analyst, and lives in Wellington, New Zealand. His interests including wargaming, computer gaming (especially RPGs and strategy games), Dungeons & Dragons and scepticism. No part of any of his posts or comments should be construed as the position of any part of the New Zealand government, or indeed any agency he may be associated with.

Related Post Roulette

38 Responses

  1. Burt Likko says:

    The high…. Periodicity? That attribute of the measurement that makes the graph all spiky rather than smooth. Suggests that there is a lot of randomness in what’s being tracked.

    But the downward trend over time — after smoothing. That is something. It’s safer cars, better drivers, public education about drinking over the holidays, maybe even less rainy summers because climate change. But something is causing average deaths to decline over time, even as year-to-year measurements remain highly volatile.Report

    • Mike Schilling in reply to Burt Likko says:

      It’s weirder than spiky. There’s an almost perfect alternation of points above and below the trend line, That can’t possibly come from random data over 40 years– the odds would be about a trillion to one against. James, what the hell is going on?Report

      • James K in reply to Mike Schilling says:

        @Mike-Schilling

        It’s not quite as spiky as it looks, if you look closely you’ll see most of those spikes are made of multiple points. There are 44 points and 27 runs in the data, that’s a Z statistic of 1.22 on a runs test.Report

      • Brandon Berg in reply to Mike Schilling says:

        @james-k A scatter plot might make that a bit more clear. It’s a bit tough to make out individual points when they line up closely enough.Report

      • Jaybird in reply to Mike Schilling says:

        Off the top of my head, I’d guess that it correlates to the length of the Holiday Period. Sometimes it’ll be 12.6, sometimes it’ll be 8.6, right? We’d expect mad fluctuation.Report

      • I like Jaybird’s question regarding the length of the measured period.

        As for the long-term trend, I’d ask how that compares to the long-term trend over the same period for deaths per million passenger miles. I suspect that the lesson is that seat belts, airbags, better-designed crumple zones, unibody construction with much stronger passenger compartment construction, anti-lock brakes and ubiquitous steel-belted radial tires all matter at the margin.Report

      • Jaybird in reply to Mike Schilling says:

        I suspect that the lesson is that seat belts, airbags, better-designed crumple zones, unibody construction with much stronger passenger compartment construction, anti-lock brakes and ubiquitous steel-belted radial tires all matter at the margin.

        From what I understand, that’s not the case. People (at the margins) say “Oh, I have these additional safeguards? That means that I can drive with my butt!” (or similar) and they end up with the same safety numbers they had before the improvement went in.

        I seem to recall reading that, at such, the best safety feature we could install in every car was a spearpoint in the middle of the steering wheel, pointing directly at the driver’s heart.Report

      • Brandon Berg in reply to Mike Schilling says:

        @jaybird The metric is deaths per day. There’s no particular reason to expect it to correlate strongly with the number of days. Maybe it does, but it’s not obvious why.

        Also, the compensation for increased safety that you describe is called the Peltzman effect.Report

      • Glyph in reply to Mike Schilling says:

        @brandon-berg There’s no particular reason to expect it to correlate strongly with the number of days. Maybe it does, but it’s not obvious why.

        The longer it is until you have to go back to work and the more figurative “weekend” you have in front of you, the more drinking gets done. On a normal week, a Friday night does not equal a Sunday night, I wouldn’t think. A holiday period with more effective “Fridays” and fewer “Sundays” could be a factor, or do I misunderstand you?Report

      • Jaybird in reply to Mike Schilling says:

        Maybe it’s the result of social hysteria (or the lack thereof)? “HEY! BE CAREFUL! LAST YEAR WE HAD A KABILLION DEATHS!!!!” morphs into “Hey, thanks for coming over and drinking with us tonight!” and back and forth.Report

      • @jaybird , while there may be a Peltzman effect, it’s been offset by something. The long-term trend in the US (which is easier to find than detailed data about New Zealand) is that number of accidents, number of injury accidents, and number of fatal accidents are all in decline. Those are declining absolute numbers, independent of the increasing number of drivers and vehicle miles driven. US fatalities and injuries are down 25% over the last 25 years, total accidents are down 19%. We made the cars safer, the marginal driver becomes more careless/aggressive,… accident count goes down? Something goes in those dots.

        Maybe it’s as simple as increasing congestion and the population shift from rural to urban/suburban: for more drivers, it’s simply not feasible to drive enough faster or more carelessly to offset the vehicle improvements. Fatality rates per million vehicle miles are much higher in rural states, where it’s easier to go fast, than in urban ones.

        For what it’s worth, New Zealand’s annual road toll for the last 25 years shows a decline that looks almost exactly like the smoothed holiday decline in James’s chart.Report

      • Note also that I wasn’t using marginal in the sense of marginal driver, I was using it in the sense of marginal accident. Perhaps it would have been better to say that improved auto engineering has shifted the characteristics of the marginally-survivable accident.Report

    • James K in reply to Burt Likko says:

      @burt-likko

      I agree that there’s a downward trend, but for some reason that doesn’t make the news.Report

  2. Nice post.

    That was also my first reaction on seeing the news stories: low frequency count data is jumpy.

    Then I remembered to adjust for expectations: they’d just cut the blood alcohol limit for adult drivers from .08 to .05 while claiming it would save a pile of lives. This is the first holiday season under that new regime. Second, they cut the speeding tolerance down from the 5% margin allowed during prior holidays to 0%. So where last year you’d be ticketed for doing 106kph in a 100, this year you’d be ticketed for 101.

    So I started thinking about mechanisms for getting an increased (relative to last year) road toll despite the policy shifts. One plausible one seemed to be that maybe the zero speed tolerance limit led to more dangerous overtaking. Didn’t seem nuts, fit my intuitions, but when I emailed the MoT’s stats guy, he said only 1 of the accidents involved overtaking.

    Noisy data is noisy still seems best explanation, but it is … odd. Had things dropped, the cops immediately would have been taking credit for their wonderfulness in pushing for a .05 limit and for the zero-tolerance speed policy, even had it been a noisy data thing. Maybe the weather was better this year and more people were on the roads.Report

    • dragonfrog in reply to Eric Crampton says:

      That’s a very good point, actually – when implementing measures to control inherently noisy and low-frequency data, there seems to be a very pronounced human tendency to look for conclusions about the effectiveness of the measure, before any real trends could conceivably emerge from the noise.

      Whoever’s favoured argument looks supported by what’s probably 95% noise at that point, will proclaim themselves right because science, while whoever’s argument looks undermined will say that the data are noisy and you can’t tell anything by such a small sample. The ones pointing out that you can’t draw any conclusions yet will be right, but most people will listen to the ones saying you can, because it makes for better editorial writing.

      So the conclusion for policy makers is, the impaired driving and speeding changes were poorly timed. They should have done the analysis you did, found the trend line, and waited for a year that was significantly above it to make the changes (it wouldn’t have taken more than a few years)Report

    • Roy Edwards in reply to Eric Crampton says:

      I am of the opinion that road deaths is the wrong metric for measuring road safety.
      Although it is easy to collect the data and makes for a better “juicy” headline.
      There are so many variables that impact a death rather than an injury.
      From the number of people in the crash thru to the rapid response(read helicopter) to get the injured to Hospital and a full medical response.
      Surely a better safety performance metric would be a number of crashes over the period(reduced to a crashes per day measurement)
      Ministry of transport extrapolate this from their crash database.
      http://www.transport.govt.nz/research/roadtoll/christmasnewyearholidayperiod/

      I have asked the Ministry for the last holiday numbers but they referred me to Police as they wont have them the numbers for up to 3 months.

      As a separate exercise I wondered about the effect of “clamping down” on speed. My assumption of increased speeding ticket should somehow correlate with a reduction in crashes does not stand up to the data.
      Luckily the number of speeding tickets is available from the NZ Yearbook(unfortunately only until 2012)
      http://www.stats.govt.nz/browse_for_stats/snapshots-of-nz/yearbook.aspx

      Trying to gather some meaning, I ran the annual number of speeding tickets issued, against the number of crashes. All I gleaned was that number of tickets per crash went up 60% from 2009 until 2012 which sort of leads me to the idea that issuing speeding tickets does not reduce the number of crashes….Report

  3. James Hanley says:

    Beautifully clear explanation, James. I’m going to have my methods students read this.Report

  4. Brandon Berg says:

    Tangential New Zealand question: I was looking at GDP figures and noticed that New Zealand is fairly poor by Anglosphere standards. Italy poor. Australia, the other non-Chinese Anglosphere island nation in the region, is richer by about a third. Is there any consensus on why that is? I’m guessing that it’s probably some combination of small population limiting internal division of labor, lack of the natural resources that fed the Australian boom, remote location driving up prices, and a legacy of extremely high government spending prior to the mid ’90s, which is about when it started catching up. Does that sound about right?Report

  5. Brandon Berg says:

    Your taxman is brutal over there. Our toll is only $2.50.Report

  6. Brandon Berg says:

    Warren Meyer over at Coyote Blog calls this media phenomenon a Trend That Is Not a Trend.Report

  7. Kazzy says:

    How does this compare to the rate during other, non-holiday periods?Report