Storage-area networks (SAN) and network-attached storage (NAS) are large-scale storage arrays on the inside. The storage array is made of dozens or hundreds of hard disks. What if you replace those hard disks with flash memory? You get an all-flash array (AFA), which is disrupting the traditional data storage industry. This guide is an entry-level summary of AFA technology.
- What are all-flash arrays? Exceedingly fast! AFAs are entirely solid state. Without any moving parts blocking the bandwidth, your data can travel as fast as wires allow.
- Why do all-flash arrays matter? Speed changes everything. Reducing read/write times tenfold means your entire organization can operate more efficiently—that would please customers and expose any weak links among your partner company's networks.
- Who do all-flash arrays affect? Larger or mission-critical organizations that can afford an AFA would see the impact on every department whose users need to access servers.
- When are all-flash arrays available from vendors? The trend began a few years ago and is still evolving. All of the major storage hardware vendors now offer all-flash (and hybrid disk-flash) arrays, along with specialists—most notably Pure Storage, which became a major player and thus far remains independent.
- How can I get an all-flash array? You can buy a flash array the same as any other enterprise storage hardware—directly from manufacturers if you're a bigger customer, or through partners/resellers if you're a smaller customer or in a special industry.
SEE: Free ebook: Executive's guide to the future of enterprise storage (TechRepublic)
What is an all-flash array?
An AFA is still a SAN or a NAS (or theoretically even a direct-attached file server)—it's the interior drive types that differ, along with system architecture details. Speed is the major advantage. Real-world numbers are hard to determine; generally hard-disk latency is in the low 10s of milliseconds vs. low single-digits of milliseconds for flash storage. There is one real-world example that is easy to see: Compare your desktop bootup time with a conventional hard disk, and then install the same operating system on a flash drive. The time saved is astounding.
Performance can depend on the array's architecture. Some products are traditional arrays retrofitted with flash memory, while others are purpose-built for flash—the latter would be faster. Many storage companies offer both options due to their original market-foothold products (now positioned as hybrids) along with all-flash products that were acquired from startups.
AFA capacity is much lower than that of traditional drive arrays, but the gap is closing. AFAs currently reach approximately 100 TB, whereas standard drive arrays routinely step into the petabytes of storage. As such, AFAs are best suited for your organization's most speed-sensitive data. They're also best suited for data that needs to be read far more often than written, because each flash drive has a finite (although well-documented) amount of write cycles before it fails.
Flash arrays may soon get even faster. First-generation AFA technology simply swapped traditional hard drives out and put solid-state drives in. But the solid-state drives remain limited by the bandwidth of interconnection standards. There are efforts underway to improve those standards, including new Ethernet options, which in turn would free flash storage to run at its full potential. Another speed-increasing change are new sixth-generation fiber channel networks.
- All-flash arrays gaining popularity but with unique side effects (TechRepublic)
- 20 Simple Questions you should ask about All-flash Arrays (EMC white paper/TechRepublic Resource Library)
Why do all-flash arrays matter?
Speed isn't everything. AFA-based SAN/NAS systems have other advantages vs. their spinning-disk counterparts. For example, flash media is physically smaller than hard disks, so the overall rack count can be smaller. Flash uses less power, as there aren't any motors to spin or heads to move. This means less heat is produced, which means less cooling is needed, which means less electricity is used, which means more money is saved—after you get over the initial purchasing costs.
Flash drives have more predictable mean times between failure than regular drives, so replacement budgets are easy to plan. However, if a drive fails unexpectedly, you'd better have a good data backup, because failed flash drives are more difficult to recover than standard hard disks.
- Video: What all-flash storage means for the future of enterprise IT (TechRepublic)
- Want to go flash? Will that be PCIe, fabric connected, all-flash, hybrid, or all of the above? (ZDNet)
- Data backup policy (Tech Pro Research)
Who do all-flash arrays affect?
AFAs impact any department that relies on networked data storage. Examples are easy to imagine. Engineers could download/upload CAD files in seconds instead of minutes. Customer support staff can answer questions faster and reduce on-hold times by accessing read-centric databases much more quickly. Dynamically produced web pages load faster.
Some applications may need tweaking to efficiently use such fast data storage. That is a reasonable request for custom-built programs, but whether necessary changes will arrive from off-the-shelf applications is a great unknown. Software companies are starting to think about it, though.
- Accessing data in a flash: When storage becomes part of the business plan (ZDNet)
- Flash goes beyond storage with these performance enhancements in the data center (TechRepublic)
- IT Networking Fundamentals Certification Training (TechRepublic Academy)
When are all-flash arrays available from vendors?
This is happening right now, and there is plenty of room for all-flash technology to evolve. The field is still in its mergers-and-acquisitions phase. NetApp recently acquired SolidFire for $870 million. Kaminario and Violin Memory are important independent players, according to market research firm International Data Corp.
- Pure Storage outlines AI engine, bevy of software updates, 75-blade all-flash system (ZDNet)
- Pure Storage launches NVMe flash storage array (ZDNet)
- Promise Technology unleashes new high-performance storage devices (ZDNet)
- Hewlett Packard Enterprise eyes growth in flash storage market (ZDNet)
- Hitachi Data Systems launches all-flash arrays (ZDNet)
- SanDisk, Nexenta release open-source, flash software-defined storage arrays (ZDNet)
How can I get an all-flash array?
Flash arrays may be 50% of all network storage by 2020, and there are plenty of important buying decisions. Generally, purchasing an AFA costs more than a traditional hard-disk-filled SAN or NAS on a per-terabyte basis, simply because flash memory costs more than spinning media. However, customers feel that AFAs are easier to install and maintain than the alternatives.
Dell-EMC, IBM, Hitachi, HP Enterprise, NetApp, Oracle, and Pure Storage are the major players. Or wait a few years—some people predict that data storage will go away entirely and will be replaced by nothing but vast amounts of memory.
- Flash storage and the diseconomies of sharing (ZDNet)
- Data storage: Preferred vendors, demands, challenges (Tech Pro Research)
- Hardware purchasing task list (Tech Pro Research)
- IT hardware procurement policy (Tech Pro Research)
Evan Koblentz began covering enterprise IT news during the dot-com boom times of the late 1990s. He recently published a book, "Abacus to smartphone: The evolution of mobile and portable computers". He is director of Vintage Computer Federation, a 501(c)3 non-profit and can often be found running marathons or having deep conversations with Floppy Disk Cat.