Organizations adopt streaming data feeds so they can react to events in real time—as they happen. It is the very opposite of batch processed data. If you’re looking to visualize and analyze streaming data, you know there’s immense value in acting on the freshest data. You also know that the interpretation of real-time events often needs a look back in history for context.
Today, enterprises reap value from high velocity, real-time data such as device logs, sensor readings, social media feeds, IoT data, and more. Real-time analysis of these streams requires a paradigm shift from batch-oriented architectures. Recent technologies such as Apache Kafka, Spark Streaming, Apache Storm, Apache Apex, Apache Nifi, and Amazon Kinesis have emerged to manage the velocity of big data.
While much of the discussion on real-time data focuses on machine processing, helping data users see these streams through real-time analytics and visualization is just as important.
IoT data processing brings several challenges to data analytics platforms. First, there’s simply a lot of it and the volume of IoT data will balloon in the next decade as many millions of IoT devices come online. In fact, industry analysts including Gartner predict 25 billion IoT devices by 2020. Even if that prediction turns out to be wrong by half, that’s still a virtually unimaginable amount of data.
The promise of streaming analytics for IoT is that it presents a chance to gather and analyze real-time information about every aspect of a business. Although IoT data is real-time data, the speed at which it can be processed and ingested—speeds and feeds—is another matter. That’s what the architects of streaming analytics platforms are facing.
Zoomdata provides enterprise-grade real-time visualization and streaming analytics based on self-service, interactive, sub-second response to ad hoc queries of high-velocity data. It’s purpose-built for streaming data, with a scalable architecture that can push updates from the source through our stream processing engine to end users via a WebSockets connection.
Zoomdata features an interface for integrating with any stream processing infrastructure. It is independent of the exact streaming infrastructure used. More than just simply monitoring real-time data feeds, Zoomdata enables streaming analytics based on visual interaction with the stream. Users can dynamically filter the stream and change the aggregation level, as well as pause, rewind, replay, and fast-forward the stream.
Data DVR is another reason why Zoomdata is great for visualizing big data--especially streaming data. Working with streaming data demands a different approach than querying historical data, such as monitoring updates pushed to the user interface.
Traditionally, organizations have been forced to use different tools and techniques for real-time data visualization versus historical data analysis. The Zoomdata Data DVR unifies these techniques in a single user experience. It brings a video DVR (digital video recorder) model to streaming data, making it accessible to business users through this familiar interface.
As the name implies, Data DVR works like the DVR you use to watch and record live television. It has similar controls so rather than simply monitoring real-time data, you can pause it, rewind, replay, or fast-forward. In addition, Data DVR’s time controls function the same way for historical data replayed as a stream. Users can transition seamlessly from real-time monitoring to historical analysis, just by expanding the time bar.
The time controls let you choose the time period to display for a data set by using the time slider. Simply expand the time window from monitoring the live feed to a longer time horizon to analyze the full history. To see changes reflected in your chart or graph, you simply scroll forward or backward in time. You can also change the speed at which a visualization progresses, every second, every minute, every hour or every day.
The point of any analytics is to gain deeper insight into a situation or problem with an eye towards solving it or producing a better outcome. Because streaming analytics gives visibility into what’s happening right now, it can:
A good example of the power of streaming analytics would be a company like GuestDNA, which helps many of the largest retailers transform huge volumes of transaction and sentiment data into a consistent and pleasant experience for their guests, employees, and franchisees. To do this, the company built a data lake on AWS and chose Zoomdata for its visual analytics tool. GuestDNA updates data in real time, 24 hours a day from thousands of sites handling millions of transactions.
Zoomdata enables users to execute streaming analytics against real-time, historical, and asynchronous data sources.