Data warehousing continues its rapid move from on-premise to cloud-based solutions, but organizations still struggle to manage data, according to Panoply's annual Data Warehouse Trends report, released Friday.
Migration to cloud-based data warehouse solutions today is estimated to be around 10x the adoption of on-premise solutions, the report found. However, 29% of the 800 data engineers, scientists, and analysts surveyed said they are still using an on-premises data warehouse, and 23% said they are not using any data warehouse solution at all, demonstrating that the move to the cloud is not yet complete, according to the report.
SEE: The Power of IoT and Big Data (Tech Pro Research)
While Amazon's Redshift is still the data warehouse leader across companies of all industries and sizes, it has lost substantial market share to other offerings, the report found. In 2017, 60% of respondents reported using RedShift, while in 2018, only 40% did, the report found.
Other industry leaders like BigQuery and Azure SQL Server are not significantly picking up the slack, but smaller companies like Snowflake and Oracle are emerging as market contenders, according to the report.
Complexity is still a major barrier for data warehouse users: More than half of those that use these solutions characterize them as "difficult" or "very difficult" to use, the report found. Some 62% of RedShift users said they found it difficult to use, largely due to issues around complexity. And 81% of those using on-premise solutions said that complexity was a pain point.
More than half of respondents also reported frustrations with hanging or slow queries in their data warehouse solutions, the report found.
To win more market share, data warehouse solutions must be powerful, customizable, and dependable to meet customer needs and address pain points, the report noted.
To learn more about data center trends, check out TechRepublic's coverage here.
The big takeaways for tech leaders:
- 29% of organizations are still using an on-premises data warehouse. — Panoply, 2019
- In 2017, 60% of respondents reported using RedShift, while in 2018, only 40% did. — Panoply, 2019
- How to become a data scientist: A cheat sheet (TechRepublic)
- Download Crystal Reports 2008 (TechRepublic download)
- Hiring kit: Data architect (Tech Pro Research)
- Volume, velocity, and variety: Understanding the three V's of big data (ZDNet)
- Best cloud services for small businesses (CNET)
- Big data: More must-read coverage (TechRepublic on Flipboard)
Alison DeNisco Rayome has nothing to disclose. She does not hold investments in the technology companies she covers.
Alison DeNisco Rayome is a Senior Editor for TechRepublic. She covers CXO, cybersecurity, and the convergence of tech and the workplace.