Streaming Analytics and the Internet of Things

Building Real-Time BI Systems With Kafka, Spark, And Kudu

Watch Zoomdata CTO, Ruhollah Farchtchi, present at Spark Summit East 2017.

One of the key challenges in working with real-time and streaming data is that the data format for capturing data is not necessarily the optimal format for ad hoc analytic queries. For example, Avro is a convenient and popular serialization service that is great for initially bringing data into HDFS. Avro has native integration with Flume and other tools that make it a good choice for landing data in Hadoop. But columnar file formats, such as Parquet and ORC, are much better optimized for ad hoc queries that aggregate over large number of similar rows.

View slides here

Building Real-Time BI Systems With Kafka, Spark, And Kudu

Watch Zoomdata CTO, Ruhollah Farchtchi, speak about building real-time BI systems with Kafka at Spark Summit East 2017.

Contact

Sales:
+1-571-279-6166

General Inquiries:
+1(571-279-6000)

[email protected]