Zoomdata Version

Managing Spark SQL Connectors

The Spark SQL connector allows users to visualize data stored in the Spark SQL databases. Zoomdata supports version 2.0 - 2.2.

The table below lists information on the features that are supported by Spark SQL.

Supports Distinct Count? Yes
Supports Group-by Time? Yes
Supports Multi Group-by Charts? Yes
Supports Histogram? Yes
Supports Box Plot? Yes
Supports Derived Fields? Yes
Custom SQL Capable? Yes
Live Mode & Playback Yes
Supports Last Value? No
Supports Partition? Yes

Managing your spark sql CONNECTIONs

When establishing a connection to Spark SQL, you need to provide the following information when setting up the partition settings.

Configure the partition settings. For the partitioned fields you can select one of the following options:

  • No
  • Date - this option is available for the Time field type. If you select this option, the list of the partitioned columns will be displayed in the Configure column.

For the Configure column, numeric and time-based fields may be edited:

  • Numeric types including Money, Number and Integer - ability to select a default aggregation function
  • Time fields - ability to define the default time pattern and granularity; if the time field provides granularities of hour, minute and second, then a time zone label may be applied

Select fields for Distinct Counts as needed.

When you create a data source, the specific number of distinct values for the attribute fields are saved in Zoomdata depending on the data sample from your data set. You can filter the data on your chart by these values. While editing a data source, if you want to use all distinct values in the filter (that is from whole data source), click the Refresh button in the Statistics column.

Chart Settings for Spark SQL

On the Charts page, you can:

  1. Edit Global Default Settings .
  2. Select the Standard and, if available, Custom chart styles to be used with the data source.
  3. Set default parameters (group, sub-group, colors, sorting, and so on) for each chart style.

Select Finish to save your changes. Once your data connection has been established, it is listed under My Data Sources.

Was this topic helpful?