Storage giant Seagate Technology Inc. is moving to accommodate Big Data workloads with the introduction of a new ClusterStor Hadoop Workflow Accelerator tool. It offers a set of tools and services for optimizing Hadoop, which should boost the performance of its ClusterStor scale-out storage system.

Seagate’s Hadoop Workflow Accelerator sounds promising for those who are running high performance data analytics environments, as the company is claiming a significant reduction in data transfer speeds. The premise is that clusters based on Hadoop and the open source Lustre file system can use “exactly the same data without having to move the data between file systems or storage devices.”

Clusterstor’s HPC architecture creates a central repository that allows for both Hadoop and HPC tools to work with the same data sets in ClusterStor at the same time. Meanwhile, the Hadoop Workflow Accelerator enables immediate Hadoop data processing from the start of each job by eliminating the time consuming task of bulk copying data from a separate repository. Using the Accelerator, computing and storage resources can now be scaled independently within Hadoop environments, allowing for analysis resources to be further optimized.

“Organizations not only want to manage the tremendous volume of data that they are collecting from a wide variety of sources, they also want to derive new insights that enable actionable intelligence and improve operational efficiency,” Ken Claffey, Vice President of ClusterStor, Seagate Cloud Systems and Solutions, said in a statement. “The Hadoop Workflow Accelerator meets our customers’ performance demands and optimizes the performance of Hadoop Ecosystem deployments, thus helping customers achieve the fastest time to results for their data intensive workloads and hardware configuration.”

Seagate says its Hadoop Workflow Accelerator will be released next January with a variety of product bundles to choose from, with varying levels of services, support and performance optimization.

photo credit: BobMical via photopin cc