This is the step to install standalone spark in AWS Ubuntu Ec2. Working and tested steps
Install Java
————
- sudo apt-add-repository ppa:webupd8team/java
- sudo apt-get update
- sudo apt-get install oracle-java7-installer
Install Scala (www.scala-lang.org)
————-
- sudo mkdir /usr/local/src/scala
- sudo tar -xvf scala-2.11.7.tgz -C /usr/local/src/scala/
- sudo vim .bashrc
- export SCALA_HOME=/usr/local/src/scala/scala-2.11.7
- export PATH=$SCALA_HOME/bin:$PATH
- . .bashrc
Install Git
———–
- sudo apt-get install git
Build Spark
———–
- sudo tar -xvf spark-2.0.0.tgz
- cd spark-2.0.0
- sudo build/sbt assembly
- sudo build/sbt package
No Comments
Leave a comment Cancel