Re: Python UDAFs

Cool, filed here: https://issues.apache.org/jira/browse/SPARK-10915 On Fri, Oct 2, 2015 at 3:21 PM Reynold Xin wrote: > No, not yet. > > > On Fri, Oct 2, 2015 at 12:20 PM, Justin Uang > wrote: > >> Hi, >> >> Is there a Python API for UDAFs? >> >> Thanks! >> >> Justin >> > >

Re: Python UDAFs

No, not yet. On Fri, Oct 2, 2015 at 12:20 PM, Justin Uang wrote: > Hi, > > Is there a Python API for UDAFs? > > Thanks! > > Justin >

Python UDAFs

Hi, Is there a Python API for UDAFs? Thanks! Justin

Re: RowMatrix tallSkinnyQR - ERROR: Second call to constructor of static parser

Is this specific to tallSkinnyQR, or can you trigger it with other operations? It would be helpful to see enough of the trace to know where the parser is being used. On Tue, Sep 22, 2015 at 8:27 AM, wrote: > Hi all, > > wondering if any could make the new 1.5.0 stallSkinnyQR to work. > Follows

RE: GraphX PageRank keeps 3 copies of graph in memory

Hi Robin, Sounds interesting. I am running 1.5.0. Could you copy-paste your Storage tab? I’ve just double checked on another cluster with 1 master and 5 workers. It still has 3 pairs of VertexRDD and EdgeRDD at the end of benchmark’s execution: RDD Name Storage Level Cached Partiti

Re: [Build] repo1.maven.org: spark libs 1.5.0 for scala 2.10 poms are broken (404)

sure thing, I'll do it today I was just talking about the page thanks btw Le ven. 2 oct. 2015 20:26, Ted Yu a écrit : > Andy: > 1.5.1 has many critical bug fixes on top of 1.5.0 > > http://search-hadoop.com/m/q3RTtGrXP31BVt4l1 > > Please consider using 1.5.1 > > Cheers > > On Fri, Oct 2, 2015 at

Re: [Build] repo1.maven.org: spark libs 1.5.0 for scala 2.10 poms are broken (404)

Andy: 1.5.1 has many critical bug fixes on top of 1.5.0 http://search-hadoop.com/m/q3RTtGrXP31BVt4l1 Please consider using 1.5.1 Cheers On Fri, Oct 2, 2015 at 11:19 AM, andy petrella wrote: > it's an option but not a solution, indeed > > Le ven. 2 oct. 2015 20:08, Ted Yu a écrit : > >> Andy:

Re: [Build] repo1.maven.org: spark libs 1.5.0 for scala 2.10 poms are broken (404)

it's an option but not a solution, indeed Le ven. 2 oct. 2015 20:08, Ted Yu a écrit : > Andy: > 1.5.1 has been released. > > Maybe you can use this: > > https://repo1.maven.org/maven2/org/apache/spark/spark-streaming_2.10/1.5.1/spark-streaming_2.10-1.5.1.pom > > I can access the above. > > On Fr

Re: [Build] repo1.maven.org: spark libs 1.5.0 for scala 2.10 poms are broken (404)

yup looks like it's funky they may have scalability issues ^^ Le ven. 2 oct. 2015 20:11, Reynold Xin a écrit : > Both work for me. It's possible maven.org is having problems with some > servers. > > > On Fri, Oct 2, 2015 at 11:08 AM, Ted Yu wrote: > >> Andy: >> 1.5.1 has been released. >> >> M

Re: [Build] repo1.maven.org: spark libs 1.5.0 for scala 2.10 poms are broken (404)

Both work for me. It's possible maven.org is having problems with some servers. On Fri, Oct 2, 2015 at 11:08 AM, Ted Yu wrote: > Andy: > 1.5.1 has been released. > > Maybe you can use this: > > https://repo1.maven.org/maven2/org/apache/spark/spark-streaming_2.10/1.5.1/spark-streaming_2.10-1.5.1

Re: [Build] repo1.maven.org: spark libs 1.5.0 for scala 2.10 poms are broken (404)

Andy: 1.5.1 has been released. Maybe you can use this: https://repo1.maven.org/maven2/org/apache/spark/spark-streaming_2.10/1.5.1/spark-streaming_2.10-1.5.1.pom I can access the above. On Fri, Oct 2, 2015 at 11:06 AM, Marcelo Vanzin wrote: > Hmm, now I get that too (did not get it before). May

Re: [Build] repo1.maven.org: spark libs 1.5.0 for scala 2.10 poms are broken (404)

Hmm, now I get that too (did not get it before). Maybe the servers are having issues. On Fri, Oct 2, 2015 at 11:05 AM, Ted Yu wrote: > I tried to access > https://repo1.maven.org/maven2/org/apache/spark/spark-streaming_2.10/1.5.0/spark-streaming_2.10-1.5.0.pom > on Chrome and Firefox (on Mac) > I

Re: [Build] repo1.maven.org: spark libs 1.5.0 for scala 2.10 poms are broken (404)

I tried to access https://repo1.maven.org/maven2/org/apache/spark/spark-streaming_2.10/1.5.0/spark-streaming_2.10-1.5.0.pom on Chrome and Firefox (on Mac) I got 404 FYI On Fri, Oct 2, 2015 at 10:49 AM, andy petrella wrote: > Yup folks, > > I've been reported by someone building the Spark-Notebo

SparkR dataframe UDF

Hi Shiva, Is Dataframe UDF implemented in SparkR yet? - I could not find it in below URL https://github.com/hlin09/spark/tree/SparkR-streaming/R/pkg/R Thanks, Renyi.

Re: [Build] repo1.maven.org: spark libs 1.5.0 for scala 2.10 poms are broken (404)

What is broken? Looks fine to me. On Fri, Oct 2, 2015 at 10:49 AM, andy petrella wrote: > Yup folks, > > I've been reported by someone building the Spark-Notebook that repo1 is > apparently broken for scala 2.10 and spark 1.5.0. > > Check this > https://repo1.maven.org/maven2/org/apache/spark/spa

[Build] repo1.maven.org: spark libs 1.5.0 for scala 2.10 poms are broken (404)

Yup folks, I've been reported by someone building the Spark-Notebook that repo1 is apparently broken for scala 2.10 and spark 1.5.0. Check this https://repo1.maven.org/maven2/org/apache/spark/spark-streaming_2.10/1.5.0/spark-streaming_2.10-1.5.0.pom The URL is correct since https://repo1.maven.o