The data found in logs can tell an enterprise a great deal, everything from which pages on a website are the most or least popular to what critical network may be about to crash when usage spikes.

The problem has been that the process of moving information in and out of data lakes has not been easy. It’s often quite laborious at scale, which has made extracting and analyzing log data chaotic and tough. It also provides a likely explanation for why cloud data indexing specialist ChaosSearch Inc. recently reported a year-over-year revenue increase in its first quarter of 611%, after raising $40 million in December.

TheCUBE, SiliconANGLE Media’s livestreaming studio, will explore the ebb and flow of data as it travels into the cloud and the data lake during our “ChaosSearch: Make Your Data Lake Deliver” event on Nov. 15. Tune in for interviews with company executives and a customer use case as theCUBE examines how ChaosSearch and Amazon Web Services Inc. are addressing how to extract value from massive enterprise data stores. (* Disclosure below.)

Multicloud insights

ChaosSearch’s indexing solution is gaining market traction because it avoids the onerous extract, transform and load process. The firm’s data platform connects and indexes data directly within a customer’s Google Cloud or AWS environments. The company’s competitive edge is based on a solution developed by Chief Technology Officer Thomas Hazel. In order to conduct a detailed content search, information must be indexed, and full text means massive files. ChaosSearch’s technology combined compressing with indexing in a much more space-saving and efficient way.

ChaosSearch’s platform received a major update in May, when the company added an ability to perform Structured Query Language processing, opening a new window into ad hoc analytics for business insights. Some analysts greeted the move positively based on the firm’s ability to index data directly within customers’ cloud environments.

“Enterprises cannot afford to look at siloed information and automation for each cloud they use,” said Constellation Research Inc. analyst Holger Mueller, in an interview with SiliconANGLE. “What they want is multicloud insights that allow them to analyze and operate the multicloud reality through a single pane of glass. That’s what ChaosSearch provides.”

Urban impact

A prime example of how one customer captures, stores and analyzes significant volumes of log data can be seen in the case of BAI Communications Pty. Ltd. BAI provides communications infrastructure for major urban areas to keep commuters connected while in transit.

This involves being able to analyze an immense amount of data, streamed into a data lake and automatically indexed. The insights BAI was able to generate not only helped provide consistent Wi-Fi coverage for subway riders in Toronto, but it allowed the city to speed up transit overall.

Stories such as this one will be just a part of theCUBE’s ChaosSearch event on Nov. 15. Hazel and his company’s chief executive officer – Ed Walsh – will be interviewed, along with Kevin Miller, vice president and general manager of S3 at AWS.

“So-called Big Data promised to usher in a new era of innovation where companies competed on the basis of insights and agile decision-making,” said Dave Vellante, host of theCUBE and chief analyst at Wikibon, SiliconANGLE’s research affiliate. “Data in their lakes was plentiful, but actionable insights aren’t so much. ChaosSearch is a startup that wants to change this dynamic with a new approach designed to simplify and accelerate time to insights and dramatically lower costs.”

Livestream of the ChaosSearch: Make Your Data Lake Deliver event

The ChaosSearch: Make Your Data Lake Deliver is a livestream event. You can watch the event here live on Nov. 15, as well as on-demand after the event.

How to watch theCUBE interviews

We offer you various ways to watch the live coverage of the ChaosSearch: Make Your Data Lake Deliver event, including theCUBE’s dedicated website and YouTube channel. You can also get all the coverage from this year’s events on SiliconANGLE.

TheCUBE Insights podcast

SiliconANGLE also has podcasts available of archived interview sessions, available on iTunes, Stitcher, and Spotify, which you can enjoy while on the go.

Guests

Guests who will be interviewed on theCUBE during the ChaosSearch: Make Your Data Lake Deliver event include ChaosSearch’s Ed Walsh, chief executive officer, and Thomas Hazel, founder and chief technology office, as well as Kevin Miller, vice president and general manager of S3 at Amazon Web Services, and Mark Hill, senior director of IT operations at Digital River.

(* Disclosure: TheCUBE is a paid media partner for the ChaosSearch: Make Your Data Lake Deliver event. Neither ChaosSearch Inc., the sponsor for theCUBE’s event coverage, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)

Photo: SiliconANGLE