Smart ways to store

Until recently, adding another terabyte might have seemed like the right thing to do to futureproof storage needs. However, this overprovisioning is now part of the problem. Customers who use smarter tools to manage their storage may find there is more than enough for
their requirements.

When IT managers forecasted their storage requirements in boom times, they tended to stay safe and procure more space than initially required. Their loyal suppliers then doubled that again, just in case. The result today is an unprecedented amount of unused storage capacity clogging up back-offices and data centres around Australia, demanding more management, more power, more cooling, more floor space and, surprisingly, even more storage.

Some forecasters have storage underutilisation at 30 to 40 percent, but Simon Piff, IDC storage research program director, Asia Pacific, believes it is even lower.

"Personally I think it's 20 to 30 percent, but there aren't any hard statistics because people don't want to look foolish and admit they made a mistake."

With data volumes growing at 50-60 percent a year in Australia - faster in some other parts of the region - due to the unprecedented growth of online transactions, video, email and presentation files, the need for optimised storage is crucial.

However the solution might be in the crisis itself: now is the time for resellers and their clients to rethink storage requirements and prove they can make their data storage smarter.

"We're seeing 60 percent compound annual growth in data, but we are not getting 60 percent compound increase in IT budgets to cope with it, so we're coming to a crossroads where something has to change for organisations to continue operating," says Scott Morris, NetApp director of channels, Australia and New Zealand.

Clive Gold, marketing chief technology officer, Australia and New Zealand, at EMC concurs: "In times like these, struggling SMEs tend to do just what they did yesterday. They just buy another server because that's what they did before. But now is the time to stop and think about it. And that's where the channel can help."

The key
The key to making storage smarter is to consolidate first. This applies to hardware and software as well as the data itself.

"There's a proliferation of storage devices at the moment. The first point to start is to see how many assets you have and how many are underutilised," says Morris. He suggests resellers and customers start by auditing the hardware they do have before exploring ways to store more data in the same footprint. They should also consider reducing the number of devices by choosing higher density, higher volume drives.

Consolidation of software is more difficult given the abundance of specialised tools marketed by different vendors.

Gold says customers are confused by this complexity, adding another layer of redundancy to their storage systems.

"It's too hard for customers to get all the benefits from their storage. To really use all the fancy little tools you get in the storage arena you need human intervention. Vendors have created lots of functionality and individually solved lots of different problems, but they are just tools," Gold says.

Piff says IDC surveys show customers want vendors and resellers to install and configure their solutions. "They just want them to make it work. It's a great opportunity for resellers, but it does require them to get close to their customers."

Backup is not archive
Customers need to distinguish between archive and backup before they can begin storage consolidation, says Dr Kevin McIsaac, advisor for virtualisation, storage and data centre infrastructure at research firm IBRS.

"Many organisations use the term ‘backup' and ‘archive' interchangeably, but there is a distinct difference in these processes," McIsaac says in his latest briefing paper which will be the subject of a seminar in June.

"A backup copies data to a secondary medium - such as tape and increasingly disk - leaving the data on the original system. The purpose of the backup process is to enable recovery. An archive migrates data from the primary system to the archive system, removing the data from the primary."

McIsaac says failure to understand the difference and to sort out the active data from the inactive results in backup processes that can't be completed inside established backup windows, longer-than-needed data recovery times, and unnecessary costly human intervention to find archived files to restore.

He says many organisations respond tactically to this problem by increasing backup throughput through virtual tape libraries, backup to disk or deduplication technologies.

"While these approaches can be effective in the short term, they are a band-aid solution that fails to address the underlying issue - that most of the data being backed up every night never changes."

Deduplication
Used in archival and backup, deduplication shrinks storage needs by eliminating the compound storage of unchanged data. In other words, it only stores data that has been modified and only once, avoiding a full backup every time. In the case of more than one instance of a file needing to be referenced, deduplication allows the storage of pointers to the unique copy.

It can be used to reduce backup, save space on existing disks and tapes, can lower storage procurement needs, reduce data transmission and result in faster recovery times. But depending on the level of granularity, it can also require more processing power to re-assemble the pointers when retrieval is needed."Deduplication is such a huge topic now. The technology is very young - everyone defines it as they wish," says Gold.

"EMC's Avamar, for example, will look into the files it has been requested to backup and will see if anything in them has changed. Then it will see if any other files already in the backup contains that change. If nothing has changed, it won't move the file," he says.

NetApp's Scott Morris says deduplication makes mathematical sense. "If you have 10TB of data, you need 10TB for a second copy and another 10TB to keep a third copy. It adds up very quickly." Deduplication can eliminate up to 95 percent of the data needing to be replicated.

"Deduplication is not just suited to backup and disaster recovery environments. We also do it at the primary device. Our competitors say we can't, but we can. We dedupe at the source," Morris claims.

Mark Nielsen, StorageWorks product marketing manager for HP's enterprise storage and servers division, says resellers should talk to customers about how deduplication leads to more efficient backups and helps reduce the storage footprint. And how much faster their storage ROI can be.

"Typically, we are seeing the two- to three-year ROI window shrink to between six to 12 months," he says.

Included in the deduplication bag of tricks is snapshots, an ability of dedupe systems to store a snapshot of a file, rather than the file itself. The snapshot contains the pointers to the data contained in the file and already stored elsewhere. For example, a PowerPoint presentation may include photos and graphs used by a number of users.

Under conventional backup, those logos and graphs would be stored several times. Snapshot will store a picture of the presentation and will point to where the photos and graphs are, eliminating the need to re-store them.
The delay associated with restoring those elements to the backed-up presentation should it be required are negligible, according to vendors CRN spoke to.

"If it was slower, the market wouldn't take it up," says Morris.

While deduplication is moving from buzz word to reality, there's tangible demand in the marketplace for resellers who can translate the benefits to customers in business terms.

"While all these features are great to have, going in and talking at a feature level, like "I can deduplicate' isn't actually the answer organisations want to hear," Morris says.

They would rather learn how to achieve sustainable reductions in the total cost of ownership of storage devices and how to reduce their overall storage operating budget.

"It's endemic in our industry today that we get so caught up in the technology that we forget people are buying it for business, not technology, reasons."