Dell, Cloudera and Syncsort designed a new solution for Hadoop users – the Dell | Cloudera | Syncsort Data Warehouse Optimization – ETL Offload Reference Architecture.
Dell said its new solution will put the planning, design, construction and deployment process in order before transforming data into a ready state for analysis and loading it for business reporting. This process is called extract, transform and load or ETL.
“Our new solution, which now incorporates Syncsort, will bring the power of big data insights to a whole new set of users who were once unable to justify the costs and complications of previously available commercial solutions,” said Jim Ganthier, vice president and General Manager of Engineered Solutions and Cloud, Dell.
The company pointed out an increase in industry-wide skills gap due to the less availability of Hadoop expertise, coupled with higher demand for big data and analytics technologies.
Dell said traditional tools such as relational database management systems (RDBMS) and enterprise data warehouses (EDW), are not meeting the requirements of today’s business needs due to high costs, low performance and a lack of scalability.
IT research agency Gartner predicts 70 percent of Hadoop deployments will fail to meet cost savings and revenue generation objectives by 2018 due to skills and integration challenges.
With that in mind, the Dell | Cloudera | Syncsort Data Warehouse Optimization – ETL Offload Reference Architecture is designed, tested and validated for customers looking for a cost-effective, faster, more efficient solution for ETL workloads, Dell said.
An efficiency test conducted by Dell proved that an entry-level technician created ETL jobs with the Dell | Cloudera | Syncsort solution 60 percent faster than an expert level senior engineer running the same scenario with do-it-yourself, open-source ETL solutions. Additionally, the entry-level technician was able to streamline ETL design by 53 percent, giving businesses the equivalent of four days back.
“End customer big data and analytic needs continue to evolve; they’re moving past general architectures in search of use case driven solutions that can solve real world problems,” said Tim Stevens, vice president, Corporate and Business Development, Cloudera.