Multicloud data lake pioneer ChaosSearch Inc. said today it’s launching a generative artificial intelligence-powered search assistant to transform log and event data analytics processes into a conversational experience.

ChaosSearch is the creator of a cloud-native data lake platform that indexes information at enormous scale. It’s a fully managed service that can be used by companies to search, find and interrogate their historical log and event data from the various computing systems and applications they use.

The company positions its platform as an alternative to what’s called the ELK stack, which refers to a complex stack of the Elasticsearch, Logstash and Kibana open-source projects. The company argues that the ELK stack and similar tools have limitations when it comes to scalability, and that forces companies to break up data into multiple clusters to analyze it properly.

At a high level, the company’s platform extends the Elasticsearch and Kibana application programming interfaces to Amazon Web Services Inc.’s S3 storage service and Google Cloud’s storage, providing a cost-effective way for teams to access, search, query and visualize terabytes of information.

Analyzing log and event data is of critical importance to many companies, since it allows them to monitor the software and infrastructure they’re using, troubleshoot any problems, keep them secure and derive business insights.

The new AI Assistant is powered by OpenAI LP’s large language models and integrates seamlessly with the ChaosSearch platform. It’s a generative AI assistant similar to ChatGPT, and it enables users to engage in natural language dialogues with their data. Users simply ask questions of their data in everyday language, and Chaos AI Assistant will provide the answers, making log and event data analytics accessible to anyone.

ChaosSearch said the AI Assistant will empower users to better understand their data, process queries and access relevant insights with natural language queries. It provides a way to gain instant visibility into things such as system behavior and application performance, the company said. The assistant also has an integrated Code Co-Pilot that can assist users in writing, debugging and optimizing code. ChaosSearch has created a short video showing how it works:

The AI Assistant also ensures that none of the customer’s data is shared with the underlying LLM for security reasons. Rather, it achieves its enhanced insights through the “intelligent utilization of hints and partial schema sharing,” while preserving the confidentiality of customer’s data, the company explained.

ChaosSearch founder and Chief Technology Officer Thomas Hazel said the AI Assistant helps to bridge the gap between complex data and human interaction. “Our vision of the future of data analytics is conversational AI that drives actionable insight for all users, regardless of their technical expertise,” he said. The company said its generative AI assistant is available now through an early access program.

Hazel recently stopped by theCUBE, SiliconANGLE’s mobile livestreaming studio, appearing alongside ChaosSearch’s other co-founder, Chief Executive Ed Walsh, at the Supercloud 2 event:

Image: ChaosSearch