UPDATED 19:45 EDT / MAY 13 2020

INFRA

AWS UltraWarm nozzles microservices-data hose with distributed caching

Cloud-based applications built with microservices are firehosing log data at DevOps teams. This is where open-source search-and-analytics engine Elasticsearch comes in for many teams. But Elasticsearch by itself doesn’t solve the problem of where to put all that data. Can a managed-service spin on Elasticsearch do the legwork for them?

The sheer amount of data is potentially great for analyzing app performance but also expensive to store and hard to get a handle on at times, according to Herain Oberoi (pictured), general manager of databases, analytics, and blockchain marketing at Amazon Web Services Inc. “[Users] either start to store that in archives or they don’t store it at all. If you store in archives, now you’ve got DevOps engineers and security experts that have to spend days to restore that data from the archive in order to search and analyze that data [with Elasticsearch],” Oberoi said.

Oberoi spoke with John Furrierhost of theCUBE, SiliconANGLE Media’s livestreaming studio, during the AWS Summit Online event. They discussed how AWS is addressing Elasticsearch’s storage weakness with smart caching. (* Disclosure below.)

Smart cache takes it in, Elasticsearch churns out new use cases

AWS has announced the general availability of UltraWarm — basically, storage-optimized Elasticsearch as a managed service. The main advantage for customers is that it introduces a distributed storage cache for frequently accessed data. It moves cold, or less frequently accessed, data to low-cost Amazon S3 storage.

The service allows DevOps teams to focus on high-level data search and analysis rather than time-consuming problems around storage, configuring and scaling. It costs about 80% less and executes queries about 50% faster than other managed ES services, according to Oberoi.

The types of queries and analyses possible for Elasticsearch users evolves once the engine’s been optimized not just for search, but also distributed storage caching.

“You can now go from storing a few days or maybe weeks worth of operational data to months of operational data at really low cost. With UltraWarm, now you can now use Elasticsearch for a broader set of use cases,” Oberoi concluded.

Watch the complete video interview below, and be sure to check out more of SiliconANGLE’s and theCUBE’s coverage of the AWS Summit Online event. (* Disclosure: TheCUBE is a paid media partner for the AWS Summit Online event. Neither Amazon Web Services, the sponsor for theCUBE’s event coverage, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)

Photo: Herain Oberoi

A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU