Re: Please assist: Building Docker image containing spark 2.0

2016-08-27 Thread Marco Mistroni
all good. Tal's suggestion did it. i shud have read the manual first :( tx for assistance On Sat, Aug 27, 2016 at 9:06 AM, Marco Mistroni wrote: > Thanks, i'll follow advice and try again > > kr > marco > > On Sat, Aug 27, 2016 at 4:04 AM, Mike Metzger > wrote: > >> I would also suggest buildi

Re: Please assist: Building Docker image containing spark 2.0

2016-08-27 Thread Marco Mistroni
Thanks, i'll follow advice and try again kr marco On Sat, Aug 27, 2016 at 4:04 AM, Mike Metzger wrote: > I would also suggest building the container manually first and setup > everything you specifically need. Once done, you can then grab the history > file, pull out the invalid commands and

Re: Please assist: Building Docker image containing spark 2.0

2016-08-26 Thread Mike Metzger
I would also suggest building the container manually first and setup everything you specifically need. Once done, you can then grab the history file, pull out the invalid commands and build out the completed Dockerfile. Trying to troubleshoot an installation via Dockerfile is often an exercise in

Re: Please assist: Building Docker image containing spark 2.0

2016-08-26 Thread Michael Gummelt
Run with "-X -e" like the error message says. See what comes out. On Fri, Aug 26, 2016 at 2:23 PM, Tal Grynbaum wrote: > Did you specify -Dscala-2.10 > As in > ./dev/change-scala-version.sh 2.10 ./build/mvn -Pyarn -Phadoop-2.4 > -Dscala-2.10 -DskipTests clean package > If you're building with sc

Re: Please assist: Building Docker image containing spark 2.0

2016-08-26 Thread Tal Grynbaum
Did you specify -Dscala-2.10 As in ./dev/change-scala-version.sh 2.10 ./build/mvn -Pyarn -Phadoop-2.4 -Dscala-2.10 -DskipTests clean package If you're building with scala 2.10 On Sat, Aug 27, 2016, 00:18 Marco Mistroni wrote: > Hello Michael > uhm i celebrated too soon > Compilation of spark

Re: Please assist: Building Docker image containing spark 2.0

2016-08-26 Thread Marco Mistroni
Hello Michael uhm i celebrated too soon Compilation of spark on docker image went near the end and then it errored out with this message INFO] BUILD FAILURE [INFO] [INFO] Total time: 01:01 h [INFO] Finished at: 2016-08-26

Re: Please assist: Building Docker image containing spark 2.0

2016-08-26 Thread Michael Gummelt
:) On Thu, Aug 25, 2016 at 2:29 PM, Marco Mistroni wrote: > No i wont accept that :) > I can't believe i have wasted 3 hrs for a space! > > Many thanks MIchael! > > kr > > On Thu, Aug 25, 2016 at 10:01 PM, Michael Gummelt > wrote: > >> You have a space between "build" and "mvn" >> >> On Thu, Au

Re: Please assist: Building Docker image containing spark 2.0

2016-08-25 Thread Marco Mistroni
No i wont accept that :) I can't believe i have wasted 3 hrs for a space! Many thanks MIchael! kr On Thu, Aug 25, 2016 at 10:01 PM, Michael Gummelt wrote: > You have a space between "build" and "mvn" > > On Thu, Aug 25, 2016 at 1:31 PM, Marco Mistroni > wrote: > >> HI all >> sorry for the pa

Re: Please assist: Building Docker image containing spark 2.0

2016-08-25 Thread Michael Gummelt
You have a space between "build" and "mvn" On Thu, Aug 25, 2016 at 1:31 PM, Marco Mistroni wrote: > HI all > sorry for the partially off-topic, i hope there's someone on the list who > has tried the same and encountered similar issuse > > Ok so i have created a Docker file to build an ubuntu co

Please assist: Building Docker image containing spark 2.0

2016-08-25 Thread Marco Mistroni
HI all sorry for the partially off-topic, i hope there's someone on the list who has tried the same and encountered similar issuse Ok so i have created a Docker file to build an ubuntu container which inlcudes spark 2.0, but somehow when it gets to the point where it has to kick off ./build/mvn