Zoomdata Version

Connecting Zoomdata to a Spark Cluster v1.3.1

By default, Spark Proxy can connect to standalone Spark server v1.5.1. To work with Spark servers of older vestions like v1.3.1, perform the steps listed below.

Before you proceed with configuration of Zoomdata to use Spark v1.3.1, you need to perform the steps listed in the Configuring a Connection to a Standalone Spark Server article.
  1. Run the following commands to copy the v1.3.1 distribution to the server on which the Spark Proxy runs:
sudo mkdir /opt/zoomdata/spark-distro
sudo wget -P /opt/zoomdata/spark-distro/ http://apache.mesi.com.ar/spark/spark-1.3.1/spark-1.3.1-bin-hadoop2.6.tgz
sudo tar -xvf /opt/zoomdata/spark-distro/spark-1.3.1-bin-hadoop2.6.tgz -C /opt/zoomdata/spark-distro/
  1. In the /etc/zoomdata/zoomdata.env file, for the SPARK_ASSEMBLY_JARS value, specify the path to the spark distribution files.
SPARK_ASSEMBLY_JARS=$(ls /opt/zoomdata/spark-distro/spark-1.3.1-bin-hadoop2.6/lib/{spark-assembly-*.jar,datanucleus-*.jar} | tr '\n' ':')
  1.  Restart the Spark Proxy service:
sudo service zoomdata-spark-proxy restart