Re: DAG in Pipeline

2017-09-07 Thread Srikanth Sampath
Hi, Pranay/Joseph, Can you share an example of ML DAG pipeline? Thanks, -Srikanth -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Spark ML DAG Pipelines

2017-09-07 Thread Srikanth Sampath
Hi Spark Experts, Can someone point me to some examples for non-linear (DAG) ML pipelines. That would be of great help. Thanks much in advance -Srikanth

Spark 2.0 and Yarn

2016-08-28 Thread Srikanth Sampath
Hi, With SPARK-11157, the big fat assembly jar build was removed. Has anyone used spark.yarn.archive - the alternative provided and successfully deployed Spark on a Yarn cluster. If so, what does the archive contain. What should be the minimal set. Any suggestion is greatly appreciated. Thanks

Re: Assembly build on spark 2.0.0

2016-08-27 Thread Srikanth Sampath
Found the answer. This is the reason https://issues.apache.org/jira/browse/SPARK-11157 -Srikanth On Sat, Aug 27, 2016 at 8:54 AM, Srikanth Sampath wrote: > Hi, > Thanks Radek. However mvn package does not build the uber jar. I am > looking for an uber jar and not a distribution

Re: Assembly build on spark 2.0.0

2016-08-26 Thread Srikanth Sampath
dir false . On Sat, Aug 27, 2016 at 1:02 AM, Radoslaw Gruchalski wrote: > mvn package might be the command you’re looking for. > > – > Best regards, > Radek Gruchalski > ra...@gruchalski.com > > > On August 26, 2016 at 3:59:24 PM, Srikanth Sampath ( &

Assembly build on spark 2.0.0

2016-08-26 Thread Srikanth Sampath
Hi, mvn assembly is creating a .tgz distribution. How can I create a plain jar archive? I would like to create a spark-assembly-.jar -Srikanth