As companies ramp up their data focus, accessibility becomes critical. Most companies use scaleable log analytics solutions based on the ELK stack (aka Elasticsearch).

But faced with data at scale, the ELK stack faces challenges, including rising retention costs and crashing clusters, according to Ed Walsh (pictured), chief executive officer of ChaosSearch Inc. But ChaosSearch, a scalable log analytics data platform, is promising a way out of the data disorder.

“We’re an ideal replacement for … either Elasticsearch or ELK Stack deployments if you’re hitting scale issues,” Walsh said.

Walsh spoke with Justin Warren, guest host of theCUBE, SiliconANGLE Media’s livestreaming studio, during AWS re:Invent. They discussed how the ChaosSearch Data Platform is delivering data lake-level benefits at a fraction of the cost of current log analytics solutions. (* Disclosure below.)

True data lake benefits

The ChaosSearch Data Platform connects and indexes data within a client’s Amazon Web Services Inc. S3 or Glacier accounts. “So inside your data lake, not our data lake,” Walsh stated. “What we do is index it and publish open APIs like Elasticsearch APIs.”

Bypassing the complex data pipelines required by other solutions, ChaosSearch is able to index data in situ without the need for transformation. Simply put, the data is fully searchable and available for analysis using the customer’s existing tools, which saves time and costs.

Specific stats come from a use case from ChaosSearch client HubSpot Inc., which was struggling with scale issues, denial of service attacks, and data outages. Switching over to the ChaosSearch data platform was “an easy swap” because the company was using Kibana open-source data visualization and exploration tool. The company’s retention time instantly increased from five days to unlimited. There have been no outages since switching to ChaosSearch, and it saved over $4 million, according to Walsh.

“We save you about 80% off your monthly bill and give you unlimited retention — and as much as you want to keep on S3 or Glacier,” Walsh stated. “It’s just easy. Use the same tools you use today, but you get the benefits of a true data lake.”

Watch the complete video interview below, and be sure to check out more of SiliconANGLE’s and theCUBE’s coverage of AWS re:Invent. (* Disclosure: ChaosSearch Inc. sponsored this segment of theCUBE. Neither ChaosSearch nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)

Photo: SiliconANGLE