Believe me, a RAID failure is a frustrating thing. I've been without access to my photos and most of my data for over a week. Now it's almost over.
If you didn't know about my RAID failure, here's my first post talking about the problem due to a single point of failure. The problem centered around the failure of my Oyen Digital DataTale 4-Bay RAID enclosure just two months after the warranty period ended.
Repairing my RAID enclosure was relatively inexpensive at only $50. I spent more on shipping it back and forth than the repair. Even so, it takes time for this process to happen. Overnight shipping was $111, so I ended up with 2-day shipping each way. The folks at Oyen Digital gave me an expedited service so it was out the day after they received it. Still, it left me without my main system while the enclosure was away.
Once it returns early this week, I should just be able to place my drives back inside and all will be right. For now. It's clear to me that not only do hard drives fail, but so does every other component in the storage system. I had to revamp my data protection plan.
After the RAID Failure
Here's the plan that I've put together to protect my information. It isn't perfect or cheap, but it's the best I can do right now.
Improve my backup capacity & frequency
My old backup plan involved a few hard drives connected by USB or FireWire. More than a few of these were consumer devices, such as the WD MyBook drives, that bit the dust after about a year of use. No more Best Buy level consumer crap. I moved one step up to a solution from Other World Computing (OWC).
They have a bundle that includes a LaCie Thunderbolt to eSATA adapter and an OWC Mercury Elite Pro. I bought a 6 TB unit, configured it as a pair of Striped 3TB drives using Mac OS X Disk Utility, and then turned it on as a Time Machine backup. Each drive in the unit plugs an eSATA cable to the LaCie adapter, which in turn connects to my iMac by Thunderbolt. I haven't benchmarked the performance, but it seems faster than a USB 2.0 mdrive.
Once my RAID enclosure returns, I ought to be able to put my drives back in order and then let Time Machine do its thing. I'll still keep my Aperture Vaults updated, too. This enclosure is an end-of-life product, though. When (not if) it breaks in the future, the manufacturer may not be able to repair it because the controller chip isn't available anymore. I have a limited period of time to use this thing.
Time to buy a new RAID enclosure
Of course, they all have the same problem. Use their RAID chip and you're stuck in a proprietary product that may not survive. I could get an enclosure that supports JBOD (which stands for “just a bunch of disks”) and let Mac OS X take care of the RAID for me. Not quite as efficient, but it moves the proprietary problem from the enclosure to the operating system.
Archival cloud storage
Amazon Glacier is a service that lets you store archival data for a penny per gigabyte each month. It isn't meant to be interactive – that's why I have the Time Machine unit.
If my home gets hit by a major disaster, though, I'd still have my most important data available to me. Those Aperture Vaults I mentioned would be fairly easy to upload quarterly.
Where Are the Thunderbolt Enclosures?
Since I had to buy new drives and enclosures, I really wanted to take advantage of Thunderbolt. I'm astonished that Thunderbolt RAID enclosures are still limited to a sole vendor – the very overpriced Pegasus RAID products. Other manufacturers, like QNAP, announced products in this space and then vanished. Even OWC has to jury-rig its products to an adapter to provide a partial Thunderbolt solution.
This doesn't pass the smell test. Thunderbolt has been out for a couple of years now. It's long past time that a competitor would show up with a Thunderbolt RAID enclosure. I'd love to know why the other announced products never saw the light of day.
It's Almost Over
This was a pretty big wake-up call for me. It's not that I never planned to upgrade my data protection plan. The problem is that I didn't take action before I needed it. To be honest, I got pretty lucky here and dodged a big bullet. So I hope you learn from my misery and go spend the money now. Make sure your backup is equivalent to all your data, not just your most important data. Yes, I would have saved my photos, but I also would have lost a lot of other stuff that probably wouldn't have been replaced.
Storage systems fail. Consider them temporary. The trick is to have multiple copies and keep shuffling the systems before they fail – not to mention having an ace in the hole, like an online backup service. Just don't rely upon any single one of them. It's the system that works, not a component.