UPDATED 09:00 EDT / NOVEMBER 29 2017

BIG DATA

Snowflake’s new data loading service aims to speed up analytics

Snowflake Computing Inc. has a new service that it says can enable companies to act upon new business information faster.

Unveiled this morning, Snowpipe is accessible from within the startup’s cloud-based data warehouse and provides the ability to automatically ingest updates as they come in.  Normally, analyzing information in real-time requires setting up complicated workflows that can be difficult to operate on a large scale. Snowflake says that its new tool takes the hassle out of the process.

To get started, a company must create a bucket in Amazon Web Services Inc.’s popular S3 object store to serve as a staging ground for incoming data. Since many modern applications already rely on S3 to hold their records and its interface is quite familiar to enterprise developers, this part is fairly straightforward. Snowflake says that the next step is simply to connect link Snowpipe with the target bucket.

According to the startup, the service continuously checks for new items and quickly loads them into its data warehouse when they arrive. Companies can customize how data is handled via a relatively straightforward programming interface.

Behind the scenes, Snowpipe automatically provisions the infrastructure necessary to transfer the information without requiring any manual input. It runs on AWS and relies on the Amazon Kinesis stream processing engine to perform the heavy-lifting. Snowflake says that customers will only be billed for the computational resources used to move their records.

Coupled with the service’s automation features, this pricing model could potentially help lower the entry barrier to real-time data streaming. The ability to ingest fresh records as soon as they becomes available can in turn benefit analytics initiatives by allowing business users to base their decisions on the most-up-to-date information. That’s particularly important in areas such as the financial sector where potentially significant changes can occur from one moment to the next.

Snowpipe is currently available in public beta.

Image via Pixabay

A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.