Amazon has a new service that makes Google Fiber seem slow. And it rides on 18 wheels.
Yes, todayâ€™s speediest internet connections make it faster to download movies than to go to the store and buy them. But downloading or uploading truly large amounts of data can still take days, months, or even yearsâ€”think a film studioâ€™s entire video archives or the satellite imagery collections of government agencies. That lag is a problem for Amazon, which wants companies to store their information in its lucrative cloud. But itâ€™s also a natural one for Amazonâ€”a logistics company at heartâ€”to solve. So this week the company announced one of its strangest ideas yet: a tractor trailer that will transport your data to Amazonâ€™s own data centers. (Insert information superhighway joke here.)
Amazon announced the new service, confusingly named Snowmobile, at its Re:Invent conference in Las Vegas this week. Itâ€™s designed to shuttle as many as 100 petabytesâ€“around 100,000 terabytesâ€“per truck. Thatâ€™s enough storage to hold five copies of the Internet Archive (a comprehensive backup of the web both present and past), which contains â€œonlyâ€ about 18.5 petabytes of unique data.
Amazon has long let businesses ship hard disks full of data to Amazon for uploading into the retail giantâ€™s cloud. But copying 100 petabytes to individual hard drives isnâ€™t practical. Snowmobile acts like a giant hard drive that comes to you.
Using multiple semis to shuttle data around might seem like overkill. But for such massive amounts of data, hitting the open road is still the most efficient way to go. Even with a one gigabit per-second connection such as Google Fiber, uploading 100 petabytes over the internet would take more than 28 years. At an average speed of 65 mph, on the other hand, you could drive a Snowmobile from San Francisco to New York City in about 45 hoursâ€”about 4,970 gigabits per second. That doesnâ€™t count the time it takes to actually transfer the data onto Snowmobileâ€“which Amazon estimates will take less than 10 daysâ€“or from the Snowmobile onto Amazonâ€™s servers. But all told, that still makes the truck much, much faster. And because Amazon has data centers throughout the country, your data probably wonâ€™t need to travel cross-country anyway.
â€œOn the security side, Snowmobile incorporates multiple layers of logical and physical protection, including chain-of-custody tracking and video surveillance,â€ Amazon cloud evangelist Jeff Barr wrote in a blog post announcing the service. In other words, Amazon is keeping a close eye on your data while itâ€™s on the road. Each truck is weather-proofed and tamper-resistant and all data is encrypted, Barr says.
The big question is whether there are many businesses out there who need or want such as service. Snowmobile is an outgrowth of an existing Amazon service called Snowball, in which Amazon sends customers an appliance that can hold 80 terabytes of data. Customers fill this up and ship it back to Amazon, which uploads it directly into its cloud.
Apparently Snowball wasnâ€™t quite enough for some customers. In fact, Amazon seems to believe that some companies will need multiple Snowmobiles. The site advertises itself as capable of handling data at the exabytes scaleâ€”or by Amazonâ€™s new measurement, ten truckloads.