Is the Internet Growing Too Big for Its Aging Infrastructure?

Remember Y2K? Well, ok, maybe you read about it or one of your teachers used it as a cautionary tale. In 1999  (a couple of years earlier, in fact) everyone started freaking out about the fact that when the year 2000 dawned every computer in the world was going to crash because they had not been programmed to deal with the fact that the Twentieth Century was coming to an end and they would not know what to make of the 2 replacing the 1.

That was the theory, anyway, and trust me on this: consulting, tech and accounting firms made a frickin' TON money on the ensuing panic. Turned out not be as big a deal as everyone had predicted (by a long shot).

So now we have 512, which is to say that many routers are programmed to handle only 512,000 routes to memory so once again, we face impending doom. Or maybe not. The big telcos like Verizon and ATT swear they have it under control. Not to worry. Only based on our history, why should their reassurances be any more believable than the abject terror of 15 years ago? Do we really trust anything that Verizon, ATT, Orange and whoever else provides your connection says? Or with anything less important, for that matter? Yeah, didnt think so.

Now, maybe this 512 thing is for real. Or maybe it is yet another potential disaster we shouldnt worry too much about. But it is worth noting that the web of relationships and connections we have with the rest of the universe just might be a tad more tenuous than we'd like to believe. Just sayin.' JL

Robert McMillan reports in Wired:

Some routers max out when their list of routes hits 512,000. Different routers have different total routes in memory, but most of them have been closing in on the 500,000 level for a few months now.
The 20,000 customers who use a Lansing Michigan web hosting company called Liquid Web had some big internet problems. The reason: the internet grew too big for the memory chips in the company’s Cisco routers.
Think of it as the internet’s latest growing pain. It’s a problem that networking geeks have seen coming for awhile now, but yesterday it finally struck. And it’s likely to cause more problems in the next few weeks. The bug doesn’t seem to have affected core internet providers—companies like AT&T and Verizon, which haul vast quantities of data over the internet’s backbone, “but certainly there are a number of people that were caught by this,” says Craig Labovitz, founder of network analysis company Deepfield Networks.

The issue affects older, but widely used, routers such as the Cisco 7,600. These machines store routing tables in their memory—directions describing the best way for packets of data to move to their ultimate destination—but some routers max out when their list of routes hits 512,000. Different routers have different total routes in memory, but most of them have been closing in on the 500,000 level for a few months now. Yesterday Verizon published an extra 15,000, kicking many routers over the 512,000 crash-point.
Verizon quickly withdrew most of these routes, kicking things back to normal, but some routers had problems. Andree Toonk, a network engineer who runs a blog tracking networking issues says on a typical day there are about 1,500 network outages on the internet. Yesterday, that number spiked to 2,587. That’s not enough to quality as a major problem, but it’s noticeable.

The problem is real, and we still haven’t seen the full effects.

It’s not the first time this kind of thing has happened. Toonk says that there were similar memory problems a few years back when the internet crossed over 256,000 addresses.
And Toonk and others predict that there could be more problems ahead, when we again cross that magic 512,000 threshold. “The problem is real, and we still haven’t seen the full effects, because most of the Internet hasn’t yet experienced the conditions that could cause problems for underprovisioned equipment,” wrote Jim Cowie, Chief Scientist at networking company Dyn, on his company’s blog.
Still, there’s a work-around out there. Outage will put the issue front-and-center with most networking staff, which means that the vast majority of the internet should be unaffected when we finally hit 512,000 addresses for good.