Spark job server throwing Out of memory when uploading jar -

Spark job server throwing Out of memory when uploading jar -

trying upload jar built using maven shaded plugin spark job server results in next error.

job-server[error] uncaught error thread [jobserver-akka.actor.default-dispatcher-2] shutting downwards jvm since 'akka.jvm-exit-on-fatal-error' enabled actorsystem[jobserver] job-server[error] java.lang.outofmemoryerror: java heap space job-server[error] @ akka.util.bytestring$bytestrings.compact(bytestring.scala:253) job-server[error] @ spray.can.parsing.httpmessagepartparser.entity(httpmessagepartparser.scala:210) job-server[error] @ spray.can.parsing.httpmessagepartparser.parsefixedlengthbody(httpmessagepartparser.scala:124) job-server[error] @ spray.can.parsing.httpmessagepartparser$$anonfun$parsefixedlengthbody$3.apply(httpmessagepartparser.scala:129) job-server[error] @ spray.can.parsing.httpmessagepartparser$$anonfun$parsefixedlengthbody$3.apply(httpmessagepartparser.scala:129) job-server[error] @ spray.can.parsing.httpmessagepartparser$$anonfun$needmoredata$2.apply(httpmessagepartparser.scala:215) job-server[error] @ spray.can.parsing.httpmessagepartparser$$anonfun$needmoredata$2.apply(httpmessagepartparser.scala:215) job-server[error] @ spray.can.server.requestparsing$$anon$1$$anon$2$$anonfun$2.apply(requestparsing.scala:87) job-server[error] @ spray.can.server.requestparsing$$anon$1$$anon$2$$anonfun$2.apply(requestparsing.scala:85) job-server[error] @ spray.io.rawpipelinestage$$anon$3$$anonfun$2.apply(pipelines.scala:115) job-server[error] @ spray.io.rawpipelinestage$$anon$3$$anonfun$2.apply(pipelines.scala:115) job-server[error] @ spray.io.connectiontimeouts$$anon$2$$anon$1$$anon$3$$anonfun$2.apply(connectiontimeouts.scala:56) job-server[error] @ spray.io.connectiontimeouts$$anon$2$$anon$1$$anon$3$$anonfun$2.apply(connectiontimeouts.scala:55) job-server[error] @ spray.io.dynamicpipelines$class.process(pipelines.scala:50) job-server[error] @ spray.io.connectiontimeouts$$anon$2$$anon$1.process(connectiontimeouts.scala:39) job-server[error] @ spray.io.dynamicpipelines$$anonfun$eventpipeline$1.apply(pipelines.scala:48) job-server[error] @ spray.io.dynamicpipelines$$anonfun$eventpipeline$1.apply(pipelines.scala:48) job-server[error] @ spray.io.rawpipelinestage$$anon$3$$anonfun$2.apply(pipelines.scala:115) job-server[error] @ spray.io.rawpipelinestage$$anon$3$$anonfun$2.apply(pipelines.scala:115) job-server[error] @ spray.io.preventhalfclosedconnections$$anon$1$$anon$2$$anonfun$connected$1.apply(preventhalfclosedconnections.scala:30) job-server[error] @ spray.io.preventhalfclosedconnections$$anon$1$$anon$2$$anonfun$connected$1.apply(preventhalfclosedconnections.scala:25) job-server[error] @ spray.io.dynamiceventpipeline$switchableeventpipeline.apply(pipelines.scala:79) job-server[error] @ spray.io.dynamiceventpipeline$switchableeventpipeline.apply(pipelines.scala:78) job-server[error] @ spray.io.rawpipelinestage$$anon$3$$anonfun$2.apply(pipelines.scala:115) job-server[error] @ spray.io.rawpipelinestage$$anon$3$$anonfun$2.apply(pipelines.scala:115) job-server[error] @ spray.io.tickgenerator$$anon$1$$anon$2$$anonfun$1.apply(tickgenerator.scala:41) job-server[error] @ spray.io.tickgenerator$$anon$1$$anon$2$$anonfun$1.apply(tickgenerator.scala:38) job-server[error] @ spray.io.rawpipelinestage$$anon$3$$anonfun$2.apply(pipelines.scala:115) job-server[error] @ spray.io.rawpipelinestage$$anon$3$$anonfun$2.apply(pipelines.scala:115) job-server[error] @ spray.io.backpressurehandling$$anon$2$$anon$1$$anon$3$$anonfun$eventpipeline$1.apply(backpressurehandling.scala:122) job-server[error] @ spray.io.backpressurehandling$$anon$2$$anon$1$$anon$3$$anonfun$eventpipeline$1.apply(backpressurehandling.scala:103) job-server[error] @ spray.io.dynamicpipelines$class.process(pipelines.scala:50) job-server ... finished exit code 255

i starting job server next setting "re-start config/local.conf --- -dspray.can.parsing.max-content-length=200m"

command used upload jar

curl --data-binary @uber-bestselling-0.0.1-snapshot.jar localhost:8090/jars/bestseller

spark jobs tests , word count works custom jar fails uploaded.

you should modify spray-can http server parsing.max-content-length setting allow larger files uploaded:

in next illustration increased max-content-length 100mb:

spray.can.server { parsing.max-content-length = 100m }

instructions configuring spray-can http server available here: http://spray.io/documentation/1.1.2/spray-can/configuration/

apache-spark