The Machine by Hewlett Packard Enterprise: The smart person's guide

By 2020, there will be billions of interconnected devices, exchanging and processing tremendous amounts of data. It is difficult for most of us to fathom how much information technology, and the way we react and interact with it, is going to change. What will our lives be like in this world?

For researchers at Hewlett Packard Enterprise (HPE), the question is not only how will we live, but how will we process all that data. Computer processing is quickly reaching a physical limitation that cannot be overcome with conventional methods. The possibilities provided by memory-driven computing could be the key to transforming the massive amounts of data generated by enterprises into useful information for decision makers. Researchers at HPE have developed a new method based on memory-driven computing they call The Machine.

This smart person's guide on The Machine explains what it is and how it may usher in a new era for IT. We'll update this guide as more details are available about The Machine.

SEE: All of TechRepublic's smart person's guides

Executive summary

• What is The Machine? It's a research project from HPE that uses memory-driven computing to find better ways to process huge amounts of data.
• Why The Machine matters: The ability to process vast amounts of data efficiently is vitally important to success in the era of big data and the Internet of Things (IoT).
• Who The Machine affects: Any enterprise, organization, or government generating or collecting vast amounts of data from the billions of interconnected devices and sensors.
• When is The Machine happening: The research project is happening now.
• How do I get The Machine? There are several open-source projects available if you would like to participate in the research.

SEE: Free ebook: Executive's guide to IoT and big data (TechRepublic)

What is The Machine?

The Machine is a memory-driven computing device developed by researchers at HPE. The project takes advantage of certain properties inherent in a system built with huge amounts of byte-addressable non-volatile memory. The research leverages the open-source community to discover new and better ways to process data.

Additional resources:

• The Machine: The Future of Computing (HP video on YouTube)
• Machine learning: The smart person's guide (TechRepublic)
• Understanding the differences between AI, machine learning, and deep learning (TechRepublic)
• Storage-class memory supporters may heed lessons learned from the 1970s (TechRepublic)
• Enterprise IoT Research 2017: Benefits, Trends, and Security Concerns (TechPro Research)

Why The Machine matters

The era of big data and IoT is creating vast amounts of raw data that must be processed before it can be useful. As more and more data is generated, enterprises may find that conventional CPU-driven computing becomes overwhelmed. A new approach is required, and HPE believes The Machine and memory-driven computing is the answer.

Additional resources:

• Storage-class memory supporters may heed lessons learned from the 1970s (TechRepublic)
• The non-volatile memory revolution: Bigger than SSDs (ZDNet)
• Google weaves AI and machine learning into core products at I/O 2017 (TechRepublic)
• Machine learning and microbes: How big data is redefining biotechnology (TechRepublic)
• IBM's brain-inspired chip TrueNorth changes how computers 'think,' but experts question its purpose (TechRepublic)
• Cern: 'We generate 1PB each second. Here's what that's taught us about big data' (TechRepublic)
• Microsoft Ignite: Nadella outlines 4 pillars for democratizing AI (TechRepublic)
• Supercomputer speed records: World's fastest machines of the past 15 years (TechRepublic photo gallery)
• Gallery: Top 20 supercomputers in the world (TechRepublic)

Who The Machine affects

Any enterprise, organization, or government generating or collecting vast amounts of data from the billions of interconnected devices and sensors created by the IoT will have to find a way to process that data. The Machine attempts to find a new, more efficient, way to transform data into useful information.

In addition to finding new ways to process data, The Machine research has provided HPE with new insights and ideas with regard to products currently under development, including byte-addressable non-volatile memory, photonics, and security.

Additional resources:

• Want a career in IT? Forget electrons and think photons (TechRepublic)
• How to use machine learning to improve customer service (TechRepublic)
• Quick glossary: Business intelligence and analytics (Tech Pro Research)
• Job description: Data Scientist (Tech Pro Research)
• Hiring kit: Data architect (Tech Pro Research)

Competitors to The Machine

As a concept device in its prototype stage of development, The Machine is essentially still a research project. However, if the research is successful and HPE develops a commercially viable version of The Machine, the most obvious competition will be from Watson, IBM's supercomputing platform.

Additional resources:

• IBM Watson: The smart person's guide (TechRepublic)
• IBM launches IBM Machine Learning cognitive platform for the private cloud (TechRepublic)
• Intel launches silicon photonics (ZDNet)
• The cloud war moves to machine learning: Does Google have an edge? (TechRepublic)
• SAP invests in machine learning to simplify customer transition to cloud (TechRepublic)
• Cray launches new supercomputers that can run AI workloads more effectively (TechRepublic)
• Microsoft partners with Cray to run deep learning algorithms on supercomputers (TechRepublic)
• Will cloud vendors dominate machine learning? Early signs point to yes (TechRepublic)

When The Machine is happening

The project is currently in its prototype stage, but HPE has several open-source projects available that use the principles of The Machine and memory-driven computing for processing data and is looking for more input from programmers and developers.

Additional resources:

• HPE unveils memory-driven computing prototype with 160TB of memory (ZDNet)
• Transparent machine learning: How to create 'clear-box' AI (TechRepublic)
• How machine learning's hype is hurting its promise (TechRepublic)
• Microsoft adds new cloud-based tools and machine learning features to Office apps (TechRepublic)
• Infographic: Many companies lack skills to implement and support AI and machine learning (TechRepublic)

How to get The Machine

The Machine is currently in the prototype stage, but there are open-source projects available if you would like to help with the research. Demonstrations for lab projects designed for The Machine will be presented at the Hewlett Packard Discover 2017 conference in Las Vegas, June 5 - 8.

Additional resources:

• Code contributions to The Machine developer toolkit (HPE)
• IBM says new Watson Data Platform will 'bring machine learning to the masses' (TechRepublic)
• How machine learning and AI will 'save the entire security industry' (TechRepublic)
• Special report: How to implement AI and machine learning (free PDF ebook) (TechRepublic)

Big Data Insights Newsletter

Master the fundamentals of big data analytics by following these expert tips, and by reading insights about data science innovations. Delivered Mondays

Sign up today