Data analytics software firm Sumo Logic Inc. today unveiled an expanded Data Pipelines service that lets customers cut and reroute telemetry before any of it is ingested and stored.

The controls sit inside the company’s own platform rather than in a separate tool. Security and operations teams are collecting more telemetry than ever, and Sumo Logic argues that artificial intelligence workloads are steepening that curve. Ingesting everything gets expensive fast. The usual alternative is to collect less, which saves money until the missing data turns out to be what an investigation needs.

Sumo Logic pointed to a recent Gartner Inc. report published Sept. 2 that describes organizations defaulting to ingesting all their operational data and analyzing it later. Ingestion and storage costs have made that unworkable, the research firm said. Gartner also said high volumes of poor-quality telemetry hold back the generative AI and large language models reading that data.

The company said it ingests and analyzes close to seven exabytes of data a day for thousands of security and operations customers. What stays out of that flow is now the customer’s call, made before ingestion.

Two capabilities carry the release. The first is a live preview that shows what a rule will do to a stream before it is switched on, including routing data to a lower-cost tier or out to a destination outside Sumo Logic. The second is an assistant that writes those rules, work the company said used to take hours. Anomalies and format shifts in incoming data are flagged as they appear. Recommendations on what to route, transform or drop still go to a person for approval.

Keith Kuchler, chief product and technology officer at Sumo Logic, said the company has spent 15 years turning “exabytes of noise into actionable insights” for customers. AI has made that job harder and more expensive, he said. Moving data strategy decisions upstream, he added, lets teams set the purpose of their data before they pay to keep it.

More is due later this year. Sumo Logic said a visual, AI-assisted way to shape telemetry before it lands in its platform or a customer’s own cloud storage will follow, with controls over what gets collected from cloud and edge sources. A platform-neutral version, covering data headed to other vendors’ tools, comes after that.

An OpenTelemetry-native management layer is also planned, putting collector configuration, monitoring and deployment in one console. Sumo Logic said that removes the cost of running additional agents.

Sumo Logic is owned by Francisco Partners, which took the company private in 2023 for $1.7 billion. The company is showing the expanded pipelines in London this week, at the Gartner Security & Risk Management Summit.

Photo: Melissambeck12/Wikimedia Commons