Modern Big Data Analytics Architecture

Modernize Your Big Data Architecture for Real-Time Analytics

The Stream Processing Engine

Within the Zoomdata server, its stream processing engine treats all data as fast streams. Of course, streaming analytics are not limited to real-time data. A good analogy is streaming video: just because you are streaming video doesn’t mean it’s live -- you can also stream historical video like a movie. Through its stream processing engine, Zoomdata streams real-time and historical data from any database or modern big data source to the user.

For historical data, the effect of this streaming architecture is easiest to see through Data Sharpening. As soon as the user creates a visualization, Zoomdata instantly streams an initial set of results. The visualization sharpens with data updates as the rest of the query completes and becomes available.

Bring Analytics To Your Data

Zoomdata pushes query processing to the source as much as possible. For sources like Impala that speak SQL, Zoomdata generates SQL queries and sends them to the source. For sources like Elasticsearch, Cloudera Search, and Solr that speak search, Zoomdata generates search queries and, again, sends them to the source. The “heavy lifting” involved with resolving a query, such as aggregation, filtering and calculations, is performed by the system where the data resides. Only the final result set is transferred from the source to the Zoomdata server. Avoiding unnecessary data movement is essential for big data scalability.
Learn More

Fast Visual Analytics Using Spark

Zoomdata leverages Apache Spark as a complementary processing layer within the Zoomdata server. As we look under the hood of Zoomdata, you’ll see how we leverage Spark to provide the fastest visual analytics at a high scale.
Learn More

Deliver Analytics At Scale With Microservices

With recent advances in cloud computing, virtualization, containerization, continuous integration, and the DevOps movement, deploying software solutions today is very different from even just a few years ago. Today’s software adheres to a set of principles that deliver modern distributed applications.

Zoomdata Server

Modern distributed applications are built as a set of independently deployable microservices distributed over clusters of commodity hardware. Why is this good?

  • The architecture scales, period. Add more servers as needed to meet demand.
  • It scales easily. Scale out by adding standard commodity nodes, as opposed to scaling up by adding beefier nodes.
  • It scales efficiently. Scale the granular components differently based on need, for example scaling for more users rather than to analyze more data.

Modern distributed applications also provide flexibility:

  • Flexibility of choice for deployment -- deploy the same set of microservices on-premise, in the cloud, or across hybrid infrastructures.
  • Flexibility for future evolution -- swap out or upgrade components without affecting other components of the system.
  • Flexibility for integration -- embed and extend components with other services to build integrated applications.

Here's How Zoomdata Uses Microservices

Zoomdata is built with all these principles in mind. If you’re building a software-as-a-service (SaaS) application that includes visual analytics, using Zoomdata ensures that your application architecture is scalable and flexible. Even if you’re an enterprise deploying visual analytics for internal use cases, these same principles apply as you deploy on a hybrid mix of cloud and on-premise infrastructure.

Zoomdata’s microservices architecture enables the software to scale out on commodity hardware. You can scale out additional Zoomdata server nodes to meet greater user demand. Or add Spark nodes as data processing demand grows. And scale out nodes of the original data sources as data volumes increase. Zoomdata is also available in a containerized format, so it’s easy to deploy in the cloud, on premise, or in a hybrid environment.
Learn More About Zoomdata in the Cloud

Security

No big data solution is complete without security. Our data architects have built security in to Zoomdata's architecture. Regardless of whether Zoomdata is used as a standalone BI platform or used to visually analyze data in an embedded application, it ensures adherence to the "three As" of security -- proper authentication, authorization, and auditing of the visual analytics environment.


Learn More About Zoomdata Security

Featured Resources

Zoomdata Architecture

Streaming architecture is fundamentally different from that used by traditional business intelligence (BI) systems. A streaming analytics architecture expects data to be in motion and flowing from the original source to the end user. Zoomdata is built for stream processing and consists of a set of data sources, the Zoomdata server, and clients that present visual analytics to end users.

Contact

Sales:
+1-571-279-6166

General Inquiries:
+1(571-279-6000)

[email protected]