Any company wanting to survive in the 21^st century knows the importance of embracing the capabilities of data, but integrating the data into enterprise infrastructure and even figuring out how to efficiently utilize artificial intelligence in data management are challenging tasks all on their own.

Prophecy Inc. is taking advantage of the rising hot market of data engineering and bringing it to the masses, providing a low-code environment that enables the development of simple yet high-quality code.

“The data stays where it is. It stays in Databricks. It could stay in Snowflake,” said Raj Bains (pictured), founder and chief executive officer of Prophecy. “We transform it. We make it much easier to clean it and put it all together.”

Bains spoke with theCUBE industry analysts  Rob Strechay at the Databricks Data + AI Summit, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed how Prophecy is simplifying data integration, implementing AI and machine learning, and closing the gap between data analysts and data engineers.

Empowering the masses

While data analysis and data engineering have historically been separate roles, Prophecy aims to bring the two together. By simplifying engineering, data analysts that previously didn’t have the proficiency to develop data pipelines are now taking on tasks previously locked behind skill barriers.

“That’s what we are focused on as we make it easier and easier. You can be a data engineer. You can be a data analyst. Everybody’s empowered,” Bains said.  “As important as data is becoming, you have got to enable everybody. They should be experts in their domain, not in the underlying technologies.”

Generative AI is the future, Bains said, and Prophecy is taking advantage of the emerging innovation. Recently, Prophecy released Data Copilot, which harnesses generative AI and large language models, streamlines data pipeline creation and acts, essentially, as an AI data assistant.

“Data engineering will become great with generative AI, but the Data Copilot will make the business data users much more productive,” Bains said. “Trying to wrestle with a particular SQL or this format is just so last generation. It’s all moving to generative AI and visual development. If that can do 70% of your work, why would you wrestle with code?”

Here’s the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of the Databricks Data + AI Summit:

Photo: SiliconANGLE