Public
Authored by Martin Perdacher

spark SBT template

Edited
build.sbt 442 Bytes
  • see also spark matrix multiplication example.

    typical sbt directory structure: mkdir -p src/{main,test}/{resources,java}

    in SBT use the following commands:

    • compile to compile your code
    • package to generate a jar file located in target/scala-2.10/
    • use ${SPARK_HOME}/bin/spark-submit --driver-memory 12g --master local[64] target/scala-2.10/matrix-multiplication_2.10-0.1.0.jar to submit your application to your local machine with 64 threads
    Edited by Martin Perdacher
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment