Datatorrent co-founder and CEO Phu Hoang, and his co-founder and CTO Amol Kekre, both spent several years in the early part of their careers with Yahoo, working on the company’s search, advertising, commerce, news, finance and sports services. Toward the end of his time at Yahooo, Hoang ran the web search and web monetization groups, and he was instrumental in bringing the Hadoop platform to Yahoo’s operational model.

Kekre was one of the engineers behind the development of YARN, a sub-project of Hadoop meant to separate the resource management and processing components. Their backgrounds have now come together in what they claim is the industry’s first enterprise-class real-time streaming platform. Datatorrent RTS is now generally available on Hadoop.

YARN moves Hadoop away from specific batch Map Reduce infrastructure, Hoang says, and this decoupling enables users to process and analyze events in real-time and in distributed memory. “When you can move insight from 30 hours to real-time something profound happens,” he explains. “You can act on those insights even as they are coming in.”

The GA release, which is available on the Datatorrent website, is offered under two options. There’s a sandbox download, that doesn’t require a Hadoop cluster. “It is a full stack VM that works on any operating system,” Hoang stated. Potential users can download it to test functionality and basically give the tires a kick.

Option two is an evaluation copy meant to be deployed on an Hadoop cluster. Users get four months to test it before paying a license fee.

Datatorrent buys in to predictions that the Internet of Things will grow rapidly, and that will create a crush of data.

“When we started this company, we shared the same outlook that as much as we are dealing with big data today, most of it is human generated,” Hoang said. As machines generate more and more sensor data, “The scale will dwarf what we are currently seeing,” he said. Datatorrent is building its platform to deal with that.”