automate spark jobs #3

Supports: xenial
Add to new model

Automate Spark Jobs

The bundle contains the following services:


  • Spark is running with 2 spark jobs
  • getdata
  • validatedata
  • => SparkUI can be accessed on http://url:4040


  • Hadoop is running and has a relationship with Zeppelin. In this way Zeppelin can use HDFS to store data.
  • The hadoop service consists of:
    • Hadoop namenode
    • Hadoop resourcemanager
    • 1 hadoop slave


  • Zeppelin Notebook has a relation with spark and Hadoop. There is 1 Notebook available that will retrieve data from your hdfs and makes it possible to query the data. The notebook is called Tengu-notebook
  • => Zeppelin can be accessed on http://url:9080


  • this bundle can be deployed in your juju environment by cloning this repo and clone the required charms that are not avilable on the juju charm store. to deploy this bundle use:
juju deploy cs:~tengu-team/bundle/automate-spark-jobs-3
Juju expert partners
  • Your own Big Data workspace
  • Use all Juju-charmed technologies
  • Machine Learning, IoT, Microservices

Bundle configuration

Embed this bundle

Add this card to your website by copying the code below. Learn more.