In a day when there is plenty of processing power, plenty of storage, and plenty of people who know how to make it all work, that we are returning to an old, failed mode of operation. I remember it was probably around 1980, my spouses boss showing us his computer system. He was going to sell time on it to other people.
Didn't work out well.
THe only reason Big data and the cloud exist is to eliminate a lot of IT jobs.
Discussion on:
View:
Show:
Nice article Mary. We are seeing an increase in businesses seeking specialized skills to help address challenges that arose with the era of big data. The HPCC Systems platform from LexisNexis helps to fill this gap by allowing data analysts themselves to own the complete data lifecycle. Designed by data scientists, ECL is a declarative programming language used to express data algorithms across the entire HPCC platform. Their built-in analytics libraries for Machine Learning and BI integration provide a complete integrated solution from data ingestion and data processing to data delivery. More at http://hpccsystems.com
One of the places companies make a mistake with Big Data is they assume its only about new data. Its not. Its also about the volume growth of traditional transactional data, which according to one survey, is growing 50-60% a year. This is making transactional applications ans analytics infrastructure fall down, and requiring significant hardware upgrades to keep up with the pace. Its also about trying to take advantage of the variety of new data, which is growing 3-4x a year.
Those companies who realize this are working through these roadblocks. With regards to budget, theyre changing their architecture to avoid the expensive hardware upgrades. Theyre offloading processing of source systems and data warehouses by moving to real-time data integration technologies running on commodity hardware (see the webinar recording Tackling Big Data Using Informatica PowerCenter Grid at http://vip.informatica.com/cathertoninformaticacom7562?elqPURLPage=10297. Theyre also addressing the challenges associated with IT know how and the storage buldge by analyzing data more carefully, archiving what theyre not using and using a tiered storage approach. This is freeing up a lot of cash that can be used for new investments related to big data projects. All these savings helps them invest in handling the variety of data and innovations leading to new revenue generating data products and services.
Data integration and data cleanup is often 80% of the work involved with Big Data Analytics so organizations are investing in no-code visual development environments to build these data flows which also enables them to utilize more readily available resources like ETL developers.
Those companies who realize this are working through these roadblocks. With regards to budget, theyre changing their architecture to avoid the expensive hardware upgrades. Theyre offloading processing of source systems and data warehouses by moving to real-time data integration technologies running on commodity hardware (see the webinar recording Tackling Big Data Using Informatica PowerCenter Grid at http://vip.informatica.com/cathertoninformaticacom7562?elqPURLPage=10297. Theyre also addressing the challenges associated with IT know how and the storage buldge by analyzing data more carefully, archiving what theyre not using and using a tiered storage approach. This is freeing up a lot of cash that can be used for new investments related to big data projects. All these savings helps them invest in handling the variety of data and innovations leading to new revenue generating data products and services.
Data integration and data cleanup is often 80% of the work involved with Big Data Analytics so organizations are investing in no-code visual development environments to build these data flows which also enables them to utilize more readily available resources like ETL developers.
- Keyboard Shortcuts:
- Prev
- Next
- Toggle
