As the cloud computing environment matures, complexities increase. But as new pain points arise with each technological advancement in the cloud, there’s almost always a subsequent innovation that crops up to address each issue.

As such, organizations have been able to overcome technical, perceptual and regulatory barriers, leading to a widespread embrace of public cloud and a wave of movement to Amazon Web Services Inc., Google LLC and Azure that has accelerated over time, according to Dan Potter (pictured), vice president of product management and marketing at Attunity Inc., an organization that provides data integration solutions for enterprise-grade cloud computing.

Attunity, an Advanced Technology Partner of AWS, has been assisting its customers on multiyear journeys as they move data into the cloud. “It’s fun to see the success that [clients are] having now with all the new technologies in the Amazon stack,” Potter said.

Potter spoke with John Walls (@JohnWalls21) and Rebecca Knight (@knightrm), co-hosts of theCUBE, SiliconANGLE Media’s mobile livestreaming studio, during AWS re:Invent in Las Vegas. They discussed how organizations can get the best from their data lakes, as well as trends in cloud technology. (* Disclosure below.)

Creating analytics-ready data sets

In order for organizations to get the most value from their data lakes and clouds, they must shape the data to make it purpose-fit and analytics-ready, Potter pointed out. The recent launch of Attunity for Data Lakes aims to streamline this process for enterprises, making it easier for them to manage and run their data pipelines.

For instance, if an organization needs data to be shaped into a data mart or if there is a requirement for an operational data store for real-time reporting, they’ll need a historic data store on a subset of information. By shaping that data, making it analytics-ready via a fully automated process, Attunity removes many of the data management headaches, Potter explained.

“So [Attunity for Data Lakes is] a streaming data pipeline process that is really leveraging the best of core transactional systems, mainframe, SAP, Oracle, legacy apps, files, and moving that to the cloud in real time so you can take advantage of all the wonderful capabilities on the Amazon platform,” Potter said.

As technologies for the cloud constantly change over time, and with new products being introduced almost continuously, the evolution of enterprise tech won’t slow down anytime soon, according to Potter. One of the big trends that he currently sees deals with real-time analytics, where analytics can be accessed as data flows into a system, creating a need for a real-time data movement infrastructure. The recent announcement of Amazon Managed Streaming for Kafka provides that service, and it is becoming an integral part of organizations’ data integration fabric, Potter concluded.

Watch the complete video interview below, and be sure to check out more of SiliconANGLE’s and theCUBE’s coverage of AWS re:Invent. (* Disclosure: Attunity Inc. sponsored this segment of theCUBE. Neither Attunity nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)

Photo: SiliconANGLE