Storage management software is more important than ever, thanks to the increasing big-ness of big data, the rise of cloud computing, and the coming wave of Internet of Things information. This guide is an entry-level summary of software management software.
To help explain which way is up, we sought advice from Evaluator Group analyst Randy Kerns, who's been in the storage field since its days of punched cards and data hieroglyphics. We also received input from Mark Peters of Enterprise Strategy Group.
- What is it? The more data you have, the more tender loving care it requires—that comes in the form of storage management software. The software keeps your data safe, ensures the right bits are stored in the right place, coordinates with your applications, and continuously reports on the data's health.
- Why does it matter? Other than people, your company's data is its most valuable asset.
- Who does this affect? Traditionally, the answer is just storage management professionals; Kerns explained how that is changing. Cloud-centric businesses may have whole other teams that lack storage management experience yet are still tasked with managing storage.
- When is this happening? Now. In addition to the trends in big data, cloud, and IoT, there are also hardware trends such as object-based storage and all-flash arrays, which increasingly need unique kinds of storage management applications.
- How do I get it? Storage management software can come from a storage hardware manufacturer, an independent software vendor, or open-source channels. It could even be homemade, although we wouldn't recommend that except in very special cases.
- Data backups: The smart person's guide (TechRepublic)
- All-flash arrays: The smart person's guide (TechRepublic)
- Storage-area networks: The smart person's guide (TechRepublic)
- Network-attached storage: The smart person's guide (TechRepublic)
- Gartner's 2016 data backup software report: Commvault and Veeam are standouts (TechRepublic)
- Veritas NetBackup's roots: A brief history of the software (TechRepublic)
What is storage management software?
Kerns said he views storage management software in three categories. These are hardware management, which looks after your drives, logical/physical partitions, virtualization, and so on; resource management, which includes tasks such as capacity planning, performance monitoring, and operational analytics; and of course data backup, which is a big enough field to warrant its own smart person's guide. Kerns sees that too few companies are using storage resource management, largely due to its complexity and the storage industry's lack of adoption of standards. (Storage standards were all the rage a decade ago, but industry support turned out to be lip service.) Meanwhile, the same categories exist—though perhaps by other names—among cloud storage services and hybrid cloud/on-premise storage products.
ESG's Peters said storage management software is largely overrated. "It would be dumb for a smart person to waste time learning about the purpose-built storage management software market in 2016. It's a declining market that was born in the late '90s and got a ton of VC investment,"—almost $1 billion, he figures—"and never really took off. The number of IT organizations that have a need—and, more importantly, budget—for storage management software is dwindling."
- Data Backup Policy (Tech Pro Research)
- End User Data Backup Policy (Tech Pro Research)
- Ebook: SAN, NAS, tape, and all-flash arrays (Tech Pro Research)
- Is the IT budget ready to power digital transformation? The journeys of four CIOs (ZDNet)
Why does storage management software matter?
Hardware can be replaced, but information can't. Even companies that focus heavily on data backups still need the rest of their storage network and management scheme in order to make sense of all the raw data.
Storage resource management in particular evolved a decade ago, and many companies said it would solve all the complexity, but that rarely came true. Even where real products exist, "You have to dig one or two levels deeper to figure out what they're really talking about," Kerns noted.
- All-flash arrays gaining popularity but with unique side effects (TechRepublic)
- New standards may bring run-flat tech to hard drives in Microsoft Azure and data centers (TechRepublic)
- SUSE Enterprise Storage 3 released for serious storage work (ZDNet)
Who does this affect?
Large organizations probably already have some form of storage management software, either from major hardware builders such as EMC or NetApp, or from independent software vendors such as Veritas. Companies that don't have it, or that need to apply storage management to anything cloud-based, need to learn fast.
Cloud systems managers typically are part of entirely separate teams from on-premise system administrators, Kerns observed. "Typically they're not the same people administrating them or even architecting them," he said. Archivists, database administrators, e-discovery specialists (ask your legal department), network administrators, and security specialists all need to be part of the plan.
- Job Description: Cloud Engineer (Tech Pro Research)
- Interview Questions: Cloud Engineer (Tech Pro Research)
- Job Description: System Engineer (Tech Pro Research)
- Ebook: Executive's guide to the future of enterprise storage (TechRepublic)
- Power checklist: Managing and troubleshooting cloud storage (Tech Pro Research)
When is this happening?
Companies that make storage management software are constantly adding new features that tend to focus on usability, integration with other products, and performance reporting. The next waves in storage management software may be automation and open-source products, Kerns said.
Peters added: "Storage management functionality is, instead, moving up the stack into operating systems, virtualization layers, converged and hyperconverged systems, software-defined infrastructure stacks, and the public cloud."
- The Evolution of Enterprise Storage (ZDNet/TechRepublic special feature)
- Building the Software Defined Data Center (ZDNet/TechRepublic special feature)
- 10 things you should know about deploying a software defined network (TechRepublic)
- Software defined data centers: The smart person's guide (TechRepublic)
- 3 public cloud fallacies: Busting the myths (TechRepublic)
How do I get it?
The best way to find the right storage management software for you is to do your homework. Google, participate in user groups, network at trade shows, read analysts' reports, ask vendors for customer references, and see which offering is most cost-effective.
There are many catches, such as products that only deliver full feature sets when used with certain hardware or standards-based installations in name only. Name-brand products may have a premium price, while open-source products may lack the support you need.
Peters opined: "For the shrinking number of apps that need to stay on-premises, the move to iSCSI and shared direct-attached storage application architectures (e.g., Hadoop) is driving out much of the fiber channel SAN complexity that drove the birth of the stillborn storage management market in the early-2000s. NetApp, IBM, HP, and Dell/EMC are duking it out for the small sliver of the dwindling on-premises storage management market that's left in the data center. We feel that what's left is an element of storage management that should be—and increasingly is—built into an on-premises storage array at no additional cost."
- The 5 coolest storage companies of 2016 (TechRepublic)
- EMC and smaller players planning open-source storage middleware (TechRepublic)
- Why your next storage solution may depend on blockchain (TechRepublic)
- How storage startup Rubrik models DevOps (TechRepublic)
- Storage arrays are dying: Meet their replacement (TechRepublic)
Evan Koblentz began covering enterprise IT news during the dot-com boom times of the late 1990s. He recently published a book, "Abacus to smartphone: The evolution of mobile and portable computers". He is director of Vintage Computer Federation, a 501(c)3 non-profit and can often be found running marathons or having deep conversations with Floppy Disk Cat.