Zoomdata Version

Managing Connectors in Zoomdata

Overview

Zoomdata connects to a wide array of data sources available in the marketplace today—from modern databases (including Hadoop, Search, Streaming, and NoSQL) to traditional sources like SQL-based stores. 'Out-of-the-box', Zoomdata comes prepackaged with the following connectors that are automatically installed during the Zoomdata installation process:


Figure 1

Starting from version 2.3, Zoomdata's architecture was enhanced to enable the deployment of many of these connectors as standalone components running in their own process space. These 'connector servers' are used to extend the built-in set of connectivity options, providing the Zoomdata Account Administrator with greater granular control over their availability. Management of these connector services is handled using the Supervisor credential and by accessing the Connectors page (as shown in Figure 2).

In addition, with the release of v2.5.3, JDBC drivers for a few of the connectors are no longer included in the installation package. This means that if you use one of those connectors, then you would also need to configure a JDBC driver before it can be enabled and accessible from within Zoomdata. For additional details including the list of connectors, refer to the article Adding a JDBC Driver.


Figure 2

As Figure 2 shows, the management of connector services is broken out into two sections:

  • Connector Servers
  • Connectors

Specifically, the following data sources each have a dedicated connector server in the Zoomdata environment:


Figure 3

Each connector server runs independent of each other within the Zoomdata environment. You can set up a Connection Type for each connector server and manage the ones to be available to users in the Zoomdata account.

This means that you are able to enable or disable any number of these servers at any time, depending on the sources that you use and what you need to connect to Zoomdata. Refer to Figure 4 for a high level concept diagram of the Zoomdata environment.


Figure 4

Table 1 provides a comprehensive listing of the connector servers that are installed by default and their state in the environment (meaning, whether they are readily accessible from the Sources page or whether additional configuration is needed). More specifically, the table details the following states:

  • Available? Connector servers are enabled in the Zoomdata environment during the installation process (unless it does not have a JDBC driver configured for it). This means that the connector server is set up and activated and Zoomdata administrators may use the Supervisor credential to manage these servers via the Connectors page. For those connectors that are not activated due to the need for manual JDBC configuration (applicable only to Zoomdata v2.5.3), refer to the article Adding a JDBC Driver.
  • Enabled? Relates to the Connection Types section and lets Zoomdata Admins manage whether the connection appears on the Sources page (see Figure 5) for users.
    The ones that comes with Zoomdata 'out of the box' are enabled by default.
Table 1
Connector Type Available? Enabled?

Amazon S3
Yes Yes

Apache Phoenix
Yes Yes

BigQuery
No No

Cloudera Search
Yes Yes

Elasticsearch
Yes Yes

MongoDB
Yes Yes

Oracle

v2.5.2 and earlier: Yes

v2.5.3: No

v2.5.2 and earlier: Yes

v2.5.3: No


Presto for Cassandra
No No

Teradata
No No

Solr
Yes Yes

SparkSQL
Yes Yes

Flat File
Yes Yes
Table 2
Connector Type Available? Enabled?

Amazon Redshift

v2.5.2 and earlier: Yes

v2.5.3: No

v2.5.2 and earlier: Yes

v2.5.3: No


Apache Drill
No No

Aurora

v2.5.2 and earlier: Yes

v2.5.3: No

v2.5.2 and earlier: Yes

v2.5.3: No


Cloudera Impala
Yes Yes

HDFS
Yes Yes


MemSQL

v2.5.2 and earlier: Yes

v2.5.3: No

v2.5.2 and earlier: Yes

v2.5.3: No


MySQL

v2.5.2 and earlier: Yes

v2.5.3: No

v2.5.2 and earlier: Yes

v2.5.3: No


PostgreSQL
Yes Yes

SQL Server

v2.5.2 and earlier: Yes

v2.5.3: No

v2.5.2 and earlier: Yes

v2.5.3: No


Vertica
No No

Upload API
Yes Yes

 

 

The setup and management of the connector servers (in the Zoomdata environment) is handled via the Manage Connector Services page, which is accessible using the Supervisor credential. To make the actual connection between Zoomdata and your data source, you need to go to the Data Sources page, which is accessible from the icon, Sources menu option. See Connecting to Data for guidance in this area.


Figure 5

  • The Manage Connector Services page lets you toggle the availability of the servers for data sources.
  • The Sources page lets you set up the connection between Zoomdata and your data source.

You may also add a new connector server that is not available 'out-of-the-box' in Zoomdata. The Manage Connector Services page is where you register a new server and set up the connection type so that it will be accessible by users from the Sources page. Instructions to set up a new connector server is covered in Configuring a New Connector Manually . Refer to the article for additional connector servers that are available from Zoomdata and may be requested by contacting Zoomdata Support.

Manage Connector Services Page

The connector services page consists of two sections (as shown in Figure 6):

  • Connector Servers
  • Connectors


Figure 6

Connector Servers

The connector server section lets the Zoomdata administrator manage the connectivity between Zoomdata and the data store. The list of connector servers already installed in the Zoomdata environment is shown in Figure 7:


Figure 7

The Connector Server table provides the following information:

  • Connector Server Name
  • Type: identifies the type of connector server in the Zoomdata environment
  • URL/Host: shows the URL or host information
  • Available: specifies whether the server is enabled or not
  • Delete: option to delete a connector server, if available
    You can delete a connector server that you manually configured. However, keep in mind that before deleting, you will to first delete the connections to the server from the Data Sources page. Then you need to delete the Connection Type.

Connector Server Types

The Type column identifies the type of server used for connecting Zoomdata to your data source. The following types are supported by Zoomdata:

  • Discovery: utilizes a capability integrated in the Zoomdata environment allowing the Zoomdata server to locate and set up the connector server automatically
  • HTTP/Socket: if you manually add a connector server to the Zoomdata environment, then it will be either an HTTP or a Socket type
  • Core - identifies the connectors that are built into the Zoomdata Server.
A Note About Core Connectors
Connectors that are of type 'Core' include Flat Files as well as HDFS and S3 buckets which do not require a dedicated connector server. These types of connectors are always be available for use in the Data Sources page. This means they are always-on, but do not require any additional network resources to keep them so.

Connector servers that you registered and connected in Zoomdata are accessible and the registration details may be edited (for example, if the server has moved or changed). Default connector servers provided by Zoomdata are not editable.

See Configuring a New Connector Manually for guidance to set up your own connector server.

If your Zoomdata environment contains a large number of connector servers, a search box is available to help you locate the desired one.


Figure 8

Connectors

Connectors represent the ability to connect to a specific type of data store (such as SQL Server, MongoDB, or Elastic Search). This section enables the connected data source to be displayed in Zoomdata's Data Sources page and have them be accessible to users.

The list of connectors that are already set up and available in the Zoomdata environment is shown in Figure 9:


Figure 9

The Connectors table provides the following information:

  • Connector Name
  • Connector Server Name
  • Description (optional field that you fill in)
  • Toggle to enable or disable the availability of the connector on the Data Sources page
  • Delete: option to delete a connection type, if available
    The 'Internal' connection type cannot be deleted.

To edit a Connector, select the Connector Name. Remember that any connector denoted as 'internal' cannot be edited. If your Zoomdata environment contains a large number of connector servers, a search box is available to help you locate the desired one.


Figure 10

Enabling or Disabling a Connector

A connector may be enabled or disabled at any time. Checking or unchecking the checkbox in the Enabled column for the target connector will determine whether its representative icon appears in the Data Source page. The toggle is instantaneous, removing or adding the icon to the Data Source page.

This capability simply adds or removes the icon from the Add a New Data Source section. Existing connected data sources may still be accessed and used.


Figure 11