Avalanche of operations data is forcing DevOps to look closer at monitoring tools

Four billion of anything is a lot to imagine. When it involves 4 billion Kubernetes instances, each containing multiple data points on spin-up, operation, and spin-down, the scale becomes truly hard to imagine.

That’s how many Kubernetes instances Google LLC launches every week just for its own use.

“If you think of Google launching 4 billion containers every week, they’re collecting a number of different data points,” said Nancy Gohring (pictured), senior analyst at 451 Research LLC. “It’s not even just 4 billion pieces of data. The volume of operations data that people are faced with is just out of this world.”

Gohring spoke with Jeff Frick, host of theCUBE, SiliconANGLE Media’s mobile livestreaming studio, during the Sumo Logic Illuminate event in Burlingame, California. They discussed the impact of growing data volumes on developer operations teams and the danger of using different monitoring tools within one organization (see the full interview with transcript here). (* Disclosure below.)

Turning to autonomous tools

The sheer scale of enterprise data being generated in companies like Google and others is driving many firms in the solutions space to offer autonomous tools for managing the massive volume of information. This is creating new questions of organizational responsibility and culture as DevOps shoulders much of the overall management workload.

“DevOps are running autonomously; they’re doing their own thing so they can move quickly,” Gohring noted. “But is there anybody overseeing the application that’s made up of maybe a thousand microservices? In some cases, the answer is no.”

One outcome of this scenario is that organizations implement monitoring tools to help DevOps teams keep a closer eye on running applications. Yet, this can also create issues, especially when each team selects a different tool of choice.

“As applications are getting much more complex, looking at that data in a siloed tool tends to obscure the bigger picture,” Gohring said. “In most cases, businesses aren’t going to just settle on one monitoring tool that does it all. If you have 100 DevOps teams and they have chosen their own monitoring tools, this is not efficient.”

Here’s the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of Sumo Logic Illuminate. (* Disclosure: TheCUBE is a paid media partner for Sumo Logic Illuminate. Neither Sumo Logic Inc., the sponsor for theCUBE’s event coverage, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)

Photo: SiliconANGLE

A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One-click below supports our mission to provide free, deep and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy