datafellas notebook #1
Description
Originally forked from the amazing scala-notebook, almost entirely refactored for Massive Dataset Analysis using Apache Spark.
The tool allows performing reproducible analysis with Scala, Apache Spark and more.
This is achieved through an interactive web-based editor that can combine Scala code, SQL queries, Markup or even JavaScript in a collaborative manner.
The Spark is available out of the box, and is simply accessed by the variable sparkContext.
Overview
This charm will deploy the DataFellas Notebook http://spark-notebook.io The tool allows performing reproducible analysis with Scala, Apache Spark and Mesos.
Installation
To deploy this charm you will need at a minimum: a cloud environment, working Juju installation and a successful bootstrap. Once bootstrapped, deploy the Mesos(mesos-master & mesos-slave) charm and then this Notebook charm: juju deploy mesos-master juju deploy datafellas-notebook Add a relation between the two of them: juju add-relation mesos-master datafellas-notebook And finally expose the Vanilla service: juju expose datafellas-notebook You can add more slaves nodes, example to add 3 slaves: juju deploy mesos-slave -n 3 Add a relation between mesos-master and mesos-slave: juju add-relation mesos-master mesos-slave
Configuration
- port
- (int) DataFellas listening port. (default: 9000)
- 9000