CIO Today

CIO Today Network Sites:   Top Tech News  |   CIO Today   |   Mobile Tech Today   |   Data Storage Today
Daily Briefing for Technology's Top Decision-Makers
Saturday, April 19th 
The future of tape is here.
This ad will display for the next 20 seconds. Please click for more information, or scroll down to pass the ad, or Close Ad.
Trending Topics:   Security Heartbleed Big Data Cloud Computing Windows XP Data Centers OS X Mavericks
Home
Enterprise Software
Enterprise Hardware
Big Data
Network Security
Cloud Computing
CRM Systems
Data Storage
Operating Systems
Communications
CIO Issues
Mobile Tech
Chips & Processors
World Wide Web
Business Briefing
After Hours
Press Releases
 
Free Newsletters
Top CIO News
 
Mobile Tech Today
 

Druva Resource Center

Public-Cloud Lessons Learned After Dropbox Outage

Public-Cloud Lessons Learned After Dropbox Outage
January 13, 2014 12:14PM

Bookmark and Share
"The important thing for businesses to realize is that cloud computing can come in many different flavors," said cloud service expert Charles Weaver. "There are consumer-grade and business-grade cloud providers, and it is important for organizations to assess their needs prior to selecting a cloud platform. This includes both data privacy and security."

Neustar, Inc. (NYSE: NSR) is a trusted, neutral provider of real-time information and analysis to the Internet, telecommunications, information services, financial services, retail, media and advertising sectors. Neustar applies its advanced, secure technologies in location, identification, and evaluation to help its customers promote and protect their businesses. More information is available at www.neustar.biz.

The sky didn't fall but the cloud was dark over the weekend as Dropbox faced service disruptions that angered many users. The company reported its online storage service went down on Friday evening during scheduled maintenance and was back up and running about three hours later, with core service fully restored by 4:40 p.m. PT on Sunday.

So what happened? And what can we learn from the outage? Akhil Gupta, head of infrastructure at Dropbox, offered his insights in a blog post Sunday.

Gupta said Dropbox relies on thousands of databases to run -- and each database has one master and two slave machines for redundancy. The company performs full and incremental data backups and stores them in a separate environment. The trouble came during an operating system upgrade to some of Dropbox's machines.

What Really Happened?

"During this process, the upgrade script checks to make sure there is no active data on the machine before installing the new OS," Gupta said. "A subtle bug in the script caused the command to reinstall a small number of active machines. Unfortunately, some master-slave pairs were impacted, which resulted in the site going down."

Gupta assured users that their files were never at risk during the outage. These databases do not contain file data, he said, but are used to provide some Dropbox features, like photo album sharing, camera uploads, and some API features.

To restore service as fast as possible, Dropbox performed the recovery from its backups. Gupta said the company was able to restore most functionality within three hours, but the large size of some of the Dropbox databases slowed recovery, and it took until several more hours for complete restoration.

What Dropbox Learned

In response to the incident, Dropbox has added an additional layer of checks that require machines to locally verify their state before executing incoming commands. This, Gupta said, enables machines that self-identify as running critical processes to refuse potentially destructive operations.

"When running infrastructure at large scale, the standard practice of running multiple slaves provides redundancy. However, should those slaves fail, the only option is to restore from backup. The standard tool used to recover MySQL data from backups is slow when dealing with large data sets," he said. "To speed up our recovery, we developed a tool that parallelizes the replay of binary logs. This enables much faster recovery from large MySQL backups. We plan to open-source this tool so others can benefit from what we've learned."

What It All Means

So what does all this mean for cloud-based service users? We asked Charles Weaver, CEO of the International Association of Cloud and Managed Service Providers, for his take on the deeper meaning. He told us the Dropbox outage draws attention to the inherent risks and issues with public cloud services.

"Not just regarding security and privacy, but also with respect to transparency. When private cloud providers have outages, their customers usually have a better sense of accountability about what their cloud provider is doing and who is managing their data. Not so with public cloud," Weaver said.

"The important thing for businesses to realize is that cloud computing can come in many different flavors. There are consumer-grade and business-grade cloud providers, and it is important for organizations to assess their needs prior to selecting a cloud platform. This includes both data privacy and security requirements, which impact the type of cloud provider you choose."

Tell Us What You Think
Comment:

Name:

Brad T.:

Posted: 2014-02-13 @ 5:07pm PT
I really don't like using both...so cal who do you use??

Cal Towns:

Posted: 2014-02-05 @ 11:06am PT
While I completely agree that the owner of the data should encrypt and securely share it, why use separate services? I’ve been encrypting my own data for nearly five years now, and it’s actually offered by the cloud service that I’m with, so I don’t have to pick a cloud service and an encryption service. People need to start doing a little research about this stuff IMO. There’s a lot of really interesting technology available.

Tom Murphy:

Posted: 2014-01-15 @ 8:52am PT
At nCrypted Cloud (www.ncryptedcloud.com) we believe that encrypting and sharing securely are two actions that the owner of the data is responsible for and should do before allowing data to be stored in the Public Cloud



 Druva Resource Center
1. Druva inSync Earns Highest Marks
2. Druva VP Named an IT 'Channel Chief'
3. Do You Need a Chief Data Officer?
4. Do One Thing To Make the Net Safer
5. Druva inSync Boosting BYOD Security




 Most Popular Articles
1. BlackBerry Drops T-Mobile After Nasty Spat
2. Cisco, IBM Launch Internet of Things Consortium
3. Salesforce CRM Gets Industry Specific for Internet of Customers
4. IBM Applies Big Data Analytics To Fight Against Fraud
5. Intel Bets on Cloudera for Big Data Analytics


Have an informed opinion on this story?
Send a Letter to the Editor.
We want to know what you think.
Send us your Feedback.

 Related Topics  Latest News & Special Reports

  Heartbleed Exploit Could Cost Millions
  Poll: A Mix of Feelings on Future Tech
  Google, Rockstar Suit Stays in Calif.
  Michaels: Nearly 3M Cards Breached
  'Like' Cheerios, Give Up Right To Sue

 Technology Marketplace

Business Intelligence
Get real-time, cloud-based information services with Neustar.
 
Cloud Computing
BMC's I.T. solutions unleash the power of your business
Next Generation Data Center Is Here! Vblock™ Systems from VCE
 
Contact Centers
HP delivers the future of the contact center with HP Qfiniti 10.
 
Data Storage
Next Generation Data Center Is Here! Vblock™ Systems from VCE
Barium Ferrite (BaFe) is the future of tape.
2.5" Enterprise-class SATA & SAS SSDs for server & storage applications
 
Enterprise Hardware
Barium Ferrite (BaFe) is the future of tape.
2.5" Enterprise-class SATA & SAS SSDs for server & storage applications
 
Enterprise I.T.
BMC's I.T. solutions unleash the power of your business
 
Hardware
Protect your network with APC Smart-UPS battery backup
 
Network Security
Protect your network with APC Smart-UPS battery backup
 

Network Security Spotlight
Heartbleed Could Cost Millions, Could Have Been Prevented
Early estimates of Heartbleed’s cost to enterprises are running in the millions. The reason: revoking all the SSL certificates the bug exposed will come at a very hefty price. Some say it all could have been avoided.
 
Michaels Says Nearly 3M Credit, Debit Cards Breached
Arts and crafts retail giant Michaels Stores has confirmed that a data breach at its POS terminals from May 2013 to Jan. 2014 may have exposed nearly 3 million customer credit and debit cards.
 
Google's Street View Software Unravels CAPTCHAs
The latest software Google uses for its Street View cars to read street numbers in images for Google Maps works so well that it also solves CAPTCHAs, those puzzles designed to defeat bots.
 

Enterprise Hardware Spotlight
Vaio Fit 11A Battery Danger Forces Recall by Sony
Using a Sony Vaio Fit 11A laptop? It's time to send it back to Sony. In fact, Sony is encouraging people to stop using the laptop after several reports of its Panasonic battery overheating.
 
Continued Drop in Global PC Shipments Slows
Worldwide shipments of PCs fell during the first three months of the year, but the global slump in PC demand may be easing, with a considerable slowdown from last year's drops.
 
Google Glass Finds a Home in Medical Education, Practice
The innovative headpiece may find its niche in markets where hands-free access to data can be a big advantage. Glass experiments for doctors are already under way, with some promising results.
 

Mobile Technology Spotlight
Review: Siri-Like Cortana Fills Windows Phone Gap
With the new Cortana virtual assistant, Windows catches up with Apple's iOS and Google's Android in a major way, taking some of the best parts of Apple's and Google's virtual assistants, with new tools too.
 
With Galaxy S5, Samsung Proves Less Can Be More
Samsung has produced the most formidable rival yet to the iPhone 5s: the Galaxy S5. The device is the fifth edition of the company's successful line of Galaxy S smartphones, and shows less can be more.
 
Facebook Rolls Out Potentially Intrusive Location-Sharing
Looking for friends? Facebook users in the U.S. will soon be able to see which of their friends are nearby, using a smartphone's GPS. Could be a cool feature in some cases, or way too much information.
 

Navigation
CIO Today
Home/Top News | Enterprise Software | Enterprise Hardware | Big Data | Network Security | Cloud Computing | CRM Systems
Data Storage | Operating Systems | Communications | CIO Issues | Mobile Tech | Chips & Processors | World Wide Web
Business Briefing | After Hours | Press Releases
Also visit these Enterprise Technology Sites
Top Tech News | CIO Today | Mobile Tech Today | Data Storage Today

Services:
FreeNewsFeed | Free Newsletters | XML/RSS Feed

About CIO Today Network | How To Contact Us | Article Reprints | Services for PR Pros (In partnership with NewsFactor) | Top Tech Wire | How To Advertise

Privacy Policy | Terms of Service
© Copyright 2000-2014 CIO Today. All rights reserved. Article rating technology by Blogowogo. Member of Accuserve Ad Network.