Should Travelers Avoid Flying Airlines That Have Had Crashes in the Past?

Unlucky? Imprudent? Poorly managed? How to assess the safety record of airlines in an increasingly transportation-dependent world.

Was Malaysian Airlines just a victim of random chance or did its policies, procedures and systems make both the plane that disappeared several months ago and the one that was shot down in the Ukraine the likely result of increased and possibly inevitable risk? Who hired those pilots, who thought it was logical to fly over a war zone filled with thugs whose weapons were far more powerful than their training, discipline or intellect?

The answers turn out to be less conclusive than one might hope. As the following article explains, the safety records of most major airlines are fairly similar. Socio-economic development of the home country may be a more statistically significant predictor of future behavior than past performance.

It is possible to extrapolate and deduct that wealthier countries simply have more resources to apply to the procedures that safeguard affluent citizens who demand that level of service. But Malaysia is a developed nation with a strong economy and a relatively impressive infrastructure. Which is to say that there is risk in most human endeavors but it may be that the prevalent culture may be the best indicator of future results. JL

Nate Silver reports in 538 Blog:

If you want to predict an airline’s future rate of crashes, you’re best off looking at its home country’s GDP and largely ignoring its track record.
The downing of Malaysia Airlines Flight 17 in Ukraine on Thursday, following the disappearance of its Flight 370 in March, is the second mysterious incident involving the airline this year. The incidents don’t appear to be related, but that isn’t preventing people from insisting that they’ll never fly Malaysia Airlines again. Some of them will follow through — academic studies have found that high-profile crashes can shift passenger demand away from the airlines involved in the disasters.
Is this behavior rational? Should we really be less inclined to fly airlines that have had fatal crashes in the past — even when the crashes don’t appear to be their fault? Or are crashes essentially random events that occur at about the same rate on all airlines over the long run? (The two fatal accidents involving Malaysia Airlines this year were the first for the carrier since 1995.)
We can study this by looking at safety records for major commercial airlines over the past 30 years, as based on the Aviation Safety Network’s database. The method is relatively simple. I’ll break the 30-year period down into two halves: first from 1985 to 1999, and then from 2000 to 2014. Then I’ll look to see whether there was a correlation in crash rates from one half of the dataset to the other. If we identify a correlation, that will imply that crash risk is persistent — predictable to some extent based on the airline.
I’ll be making a couple of simplifying assumptions:

• First, I’ll include all crashes regardless of their cause. The airline is clearly more culpable in cases such as the 1977 Tenerife disaster than others like Flight 17. But the causes of many other disasters (such as Malaysia Flight 370) are controversial or poorly understood — I’m not going to try to assign blame.
• Next, I’ll take crash rates on the basis of the number of available seat kilometers (ASKs), which is defined as the number of seats multiplied by the number of kilometers the airline flies.¹ ASK figures are taken as of December, 2012. This implicitly assumes that the number of ASKs has been constant for each airline since 1985, which is obviously not true — some airlines have grown while others have shrunk — but this is a necessary simplification until we can track down some older data. I do, however, exclude any airlines that were not operational as of Jan. 1, 1985², and account for some major mergers (so Northwest’s data is combined into Delta’s, and so forth). I also include data for regional subsidiaries under the flagship carrier — so incidents for American Eagle are grouped with the data for American Airlines, for instance.
• I’ll define crashes in three ways:
  • First, based on the rate of incidents as listed in the database, whether or not they resulted in a fatality.
  • Next, based on the rate of fatal accidents.³
  • Finally, by the rate of fatalities among passengers and crew on the airline.

Here’s the data for 56 airlines that were in the global top 100 as of December 2012 and which have operated continuously since Jan. 1, 1985. Airlines are sorted based on the rate of fatalities per ASK.

As you should see, the number of fatalities is not very consistent from the first half of the dataset to the next. Avianca, the national airline of Colombia, had a series of major crashes from 1983 through 1990. But it has had almost no problems since then — no fatal accidents since 1990, and no incidents of any kind since 1999. By contrast, Kenya Airways was fatality-free until 2000 but has had two major accidents since then and ranks as the worst airline since 2000 based on the number of fatalities per ASK.
One or two other carriers, such as Taiwan’s China Airlines (not be confused with Beijing’s Air China⁴), have had problems in both halves of the dataset. But these cases are more the exception than the rule. Overall, there is no correlation in the rate of fatalities from one period to the next.

Accidents that produce a massive number of fatalities are rare as compared to fatal accidents of any kind, however. And fatal accidents represent only about one-quarter of all incidents listed in the database. So it may be better to compare airlines on the basis of their number of incidents, whether or not they resulted in a fatality, which has the effect of increasing the sample size. These near-misses can still produce non-fatal injuries. They may also provide useful evidence about the overall hazard associated with flying a given airline, in the same way that the number of smaller earthquakes in a region over a period of time can be used to predict the likelihood of a catastrophic one.⁵

Viewed this way, there is a modest correlation from one period to the next.⁶ There are also a few major outliers in the chart: two are Pakistan International Airlines and Ethiopian Airlines, which have had a persistently high rate of incidents. A third outlier, Russia’s Aeroflot, had an extraordinarily high number of reported incidents in the 1990s — many of them attempted hijackings around the time of the breakup of the Soviet Union — but only an average number in recent years. There is still a positive correlation even if those three airlines are excluded, however, which rates as modestly statistically significant⁷ — some airlines are slightly safer to fly than others.
Our preliminary answer, then, is that an airline’s track record tells you something about its probability of future crashes — although not a lot, and only if looked at in the right way. In particular, you should look toward an airline’s rate of dangerous incidents of any kind rather than its number of fatalities or fatal accidents. These near-misses are more consistent from period to period — and could result in a deadly crash the next time around.
But there’s a better rule to follow. If you’re insistent on minimizing your crash risk, you should avoid airlines from developing countries.
Let’s combine our three measures of crash rates — incidents, fatal accidents and fatalities — into a single measure which I’ll call the airline’s safety score. I calculate it as follows:

• For each category, subtract an airline’s crash rate from the average for all airlines since 1985. This gives safer airlines positive scores and less safe airlines negative scores.
• Multiply the result by the square root of the number of seat kilometers flown. This gives more credit to an airline that has achieved a strong safety record over a larger sample of flights.
• Standardize the score in each category to calculate how many standard deviations an airline is above or below the mean. Then average the scores from the three categories together. This is the safety score.

Positive scores indicate a safe track record — Australia’s Qantas, for instance, which is famous for avoiding crashes — has a safety score of +0.70. By contrast, Pakistan International Airlines has a score of -1.44.

The chart also lists the per capita GDP for the airline’s home country as of 1999 (the middle of the 30-year period). The correlation between a country’s wealth and the crash rates of its airlines is quite strong⁸. Over the past 30 years, the top 10 safety scores belong to two airlines from the United States (Southwest Airlines and United Airlines), two from the United Kingdom, and one each from Canada, Australia, Hong Kong, Singapore, Germany and the Netherlands. By contrast, the 10 worst scores are for airlines from Colombia, Egypt, Ethiopia, Indonesia, Kenya, Malaysia, Morocco, Pakistan, Russia, Taiwan. In fact, if you want to predict an airline’s future rate of crashes, you’re best off looking at its home country’s GDP and largely ignoring its track record.⁹
Perhaps this shouldn’t be surprising. Commercial airlines are subject to extremely stringent safety standards, and the same standards are applied to all airlines from the same country or region. Richer countries, in air travel and many other aspects of public planning, can afford to buy more safety in the form of higher prices and more expensive regulations.
So should you never fly an airline from a developing country again? No, that would be silly — commercial airline travel is an extraordinarily safe means of transit overall. What you should do is avoid airlines on blacklists, such as that periodically put out by the European Union. (None of the airlines on the list of 56 above is currently on the EU’s blacklist, although one, Pakistan International Airlines,  Otherwise — even on Malaysia Airlines — the risk of being involved in a crash is very low, and that risk doesn’t increase much after a recent disaster.