datafellas notebook #1
Description
Originally forked from the amazing scala-notebook,
almost entirely refactored for Massive Dataset Analysis using Apache Spark.
The tool allows performing reproducible analysis with Scala, Apache Spark and more.
This is achieved through an interactive web-based editor that can combine Scala code,
SQL queries, Markup or even JavaScript in a collaborative manner.
The Spark is available out of the box, and is simply accessed by the variable sparkContext.
Overview
This charm will deploy the DataFellas Notebook http://spark-notebook.io
The tool allows performing reproducible analysis with Scala, Apache Spark and Mesos.
Installation
To deploy this charm you will need at a minimum: a cloud environment,
working Juju installation and a successful bootstrap. Once bootstrapped,
deploy the Mesos(mesos-master & mesos-slave) charm and then this Notebook charm:
juju deploy mesos-master
juju deploy datafellas-notebook
Add a relation between the two of them:
juju add-relation mesos-master datafellas-notebook
And finally expose the Vanilla service:
juju expose datafellas-notebook
You can add more slaves nodes, example to add 3 slaves:
juju deploy mesos-slave -n 3
Add a relation between mesos-master and mesos-slave:
juju add-relation mesos-master mesos-slave
Configuration
- port
- (int) DataFellas listening port. (default: 9000)
- 9000