Re: [FYI] SBT Build Failure

2020-01-18 Thread Manu Zhang
Thanks Dongjoon for the information and the fix in https://github.com/apache/spark/pull/27242 On Fri, Jan 17, 2020 at 6:58 AM Sean Owen wrote: > Ah. The Maven build already long since points at https:// for > resolution for security. I tried just overriding the resolver for the > SBT build, but

Re: How to implement a "saveAsBinaryFile" function?

2020-01-18 Thread jelmer
I think you could also try saveAsHadoopFile with a custom output format like https://github.com/amutu/tdw/blob/master/qe/contrib/src/java/org/apache/hadoop/hive/contrib/fileformat/protobuf/mapred/ProtobufOutputFormat.java On Thu, 16 Jan 2020 at 09:34, Duan,Bing wrote: > Hi all: > > I read binar

Re: Spark master build hangs using parallel build option in maven

2020-01-18 Thread Sean Owen
I think we can remove that note from the README then, I'll do that. On Sat, Jan 18, 2020 at 1:38 AM Dongjoon Hyun wrote: > > Hi, Saurabh. > > It seems that you are hitting > https://issues.apache.org/jira/browse/SPARK-26095 . > > And, we disabled the parallel build via > https://github.com/apac

Re: Spark master build hangs using parallel build option in maven

2020-01-18 Thread Saurabh Chawla
Hi Dongjoon, Thanks for sharing the information related to parallel build issue in spark. Sure will disable parallel build. Regards Saurabh Chawla On Sat, Jan 18, 2020 at 1:08 PM Dongjoon Hyun wrote: > Hi, Saurabh. > > It seems that you are hitting > https://issues.apache.org/jira/browse/SPAR