Re: Use cases around image/video processing in spark

2016-08-10 Thread Benjamin Fradet
Hi, Check out the the thunder project On Wed, Aug 10, 2016 at 5:20 PM, Deepak Sharma wrote: > Hi > If anyone is using or knows about github repo that can help me get started > with image and video processing using spark. > The images/videos will be s

Re: ml ALS.fit(..) issue

2016-07-22 Thread Benjamin Fradet
Seems like there is an incompatibility regarding scala versions between your program and the scala version Spark was compiled against. Either you're using scala 2.11 and your spark installation was built using 2.10 or the other way around. On Fri, Jul 22, 2016 at 11:06 PM, Pedro Rodriguez wrote:

Re: Spark Streaming KafkaUtils missing Save API?

2016-01-15 Thread Benjamin Fradet
There was a PR regarding this which was closed but the author of the PR created a spark-package: https://github.com/cloudera/spark-kafka-writer. I don't know exactly why it was decided not be incorporated into spark however. On 15 Jan 2016 8:04 p.m., "Renyi Xiong" wrote: > Hi, > > We noticed the

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

2015-12-22 Thread Benjamin Fradet
+1 On 22 Dec 2015 9:54 p.m., "Andrew Or" wrote: > +1 > > 2015-12-22 12:43 GMT-08:00 Reynold Xin : > >> +1 >> >> >> On Tue, Dec 22, 2015 at 12:29 PM, Michael Armbrust < >> mich...@databricks.com> wrote: >> >>> I'll kick the voting off with a +1. >>> >>> On Tue, Dec 22, 2015 at 12:10 PM, Michael Ar

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

2015-12-12 Thread Benjamin Fradet
-1 For me the docs are not displaying except for the first page, for example http://people.apache.org/~pwendell/spark-releases/spark-1.6.0-rc2-docs/mllib-guide.html is a blank page. This is because of SPARK-12199 : Element[W|w]iseProductExample.scala is

[ML] Missing documentation for the IndexToString feature transformer

2015-12-05 Thread Benjamin Fradet
Hi, I was wondering why the IndexToString label transformer was not documented in ml-features.md . If it's not i

Re: Grid search with Random Forest

2015-12-01 Thread Benjamin Fradet
> Hi Benjamin, > > Thanks, the documentation you sent is clear. > Is there any other way to perform a Grid Search with GBT? > > > Ndjido > On Tue, 1 Dec 2015 at 08:32, Benjamin Fradet > wrote: > >> Hi Ndjido, >> >> This is because GBTClassifier do

Re: Grid search with Random Forest

2015-11-30 Thread Benjamin Fradet
Hi Ndjido, This is because GBTClassifier doesn't yet have a rawPredictionCol like the. RandomForestClassifier has. Cf: http://spark.apache.org/docs/latest/ml-ensembles.html#output-columns-predictions-1 On 1 Dec 2015 3:57 a.m., "Ndjido Ardo BAR" wrote: > Hi Joseph, > > Yes Random Forest support G

Re: Unhandled case in VectorAssembler

2015-11-21 Thread Benjamin Fradet
Will do, thanks for your input. On 21 Nov 2015 2:42 a.m., "Joseph Bradley" wrote: > Yes, please, could you send a JIRA (and PR)? A custom error message would > be better. > Thank you! > Joseph > > On Fri, Nov 20, 2015 at 2:39 PM, BenFradet > wrote: > >> Hey there, >> >> I noticed that there is