Re: FYI -- javax.servlet dependency issue workaround

Also just for sake of completeness, sometimes the desired dependency might just be an older version in that case even if you include it like above it may get evicted (Sbt's default strategy for conflict manager is to choose the latest version). So to further ensure that it does include it. We can

FYI -- javax.servlet dependency issue workaround

Hi all, I had some trouble compiling an application (Shark) against Spark 1.0, where Shark had a runtime exception (at the bottom of this message) because it couldn't find the javax.servlet classes. SBT seemed to have trouble downloading the servlet APIs that are dependencies of Jetty (used by th

RE: About JIRA SPARK-1825

Sent a pull request. (https://github.com/apache/spark/pull/899) Thanks. -Original Message- From: Reynold Xin [mailto:r...@databricks.com] Sent: Wednesday, May 28, 2014 10:12 AM To: dev@spark.apache.org Subject: Re: About JIRA SPARK-1825 It is actually pretty simple. You will first need t

Re: About JIRA SPARK-1825

It is actually pretty simple. You will first need to fork Spark on github, and then push your changes to it, and then follow: https://help.github.com/articles/using-pull-requests On Tue, May 27, 2014 at 6:10 PM, innowireless TaeYun Kim < taeyun@innowireless.co.kr> wrote: > I'm afraid I don'

RE: About JIRA SPARK-1825

I'm afraid I don't know how to send a 'pull request'. (Sorry for my ignorance) I've modified the source code on my PC. I can learn how to send a pull request, or I can attach the modified source code on the mail right now(only 2 scala files). Which way is preferable? -Original Message- Fr

Re: About JIRA SPARK-1825

Hei Taeyun, have you sent a pull request for this fix? We can review it there. It’s too late to merge anything but blockers for 1.0.0 but we can do it for 1.0.1 or 1.1, depending how big the patch is. Matei On May 27, 2014, at 5:25 PM, innowireless TaeYun Kim wrote: > Could somebody please r

About JIRA SPARK-1825

Could somebody please review and fix https://issues.apache.org/jira/browse/SPARK-1825 ? It's a cross-platform issue. I've fixed the Spark source code based on rc5 and it's working for me now. but totally not sure whether I've done correctly, since I'm almost new to Spark and don't know much about

Re: Clearspring Analytics Version

Posted a question on streamlib user group about API compatibility: https://groups.google.com/forum/#!topic/stream-lib-user/4VDeKcPiTJU On Tue, May 27, 2014 at 3:36 PM, Surendranauth Hiraman < suren.hira...@velos.io> wrote: > Reynold, > > My environment is not quite set up to build Spark core pr

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

+1 (I did some very basic testing with PySpark & Pandas on rc11) On Tue, May 27, 2014 at 3:53 PM, Mark Hamstra wrote: > +1 > > > On Tue, May 27, 2014 at 9:26 AM, Ankur Dave wrote: > > > 0 > > > > OK, I withdraw my downvote. > > > > Ankur > > > -- Cell : 425-233-8

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

+1 On Tue, May 27, 2014 at 9:26 AM, Ankur Dave wrote: > 0 > > OK, I withdraw my downvote. > > Ankur >

Re: Clearspring Analytics Version

Reynold, My environment is not quite set up to build Spark core properly and I'm having various dependency issues running sbt/sbt assembly. Any change you could go ahead and submit a pull request for this if it's easy for you? :-) -Suren On Tue, May 27, 2014 at 6:13 PM, Reynold Xin wrote: >

Re: Clearspring Analytics Version

2.7 sounds good. I was actually waiting for 2.7 to come out to post a JIRA (mainly for the serializable HyperLogLogPlus class). On Tue, May 27, 2014 at 3:11 PM, Surendranauth Hiraman < suren.hira...@velos.io> wrote: > Great, I will submit the pull request. > > Any objection to version 2.7? > > -

Re: Clearspring Analytics Version

Great, I will submit the pull request. Any objection to version 2.7? -Suren On Tue, May 27, 2014 at 6:02 PM, Reynold Xin wrote: > Would you like to submit a pull request to update it? > > Also in the latest version HyperLogLog is serializable. That means we can > get rid of the SerializableH

Re: Clearspring Analytics Version

Would you like to submit a pull request to update it? Also in the latest version HyperLogLog is serializable. That means we can get rid of the SerializableHyperLogLog class. (and move to use HyperLogLogPlus). On Tue, May 27, 2014 at 3:01 PM, Surendranauth Hiraman < suren.hira...@velos.io> wr

Clearspring Analytics Version

Hi, It looks like the version of Clearspring's stream analytics class in 1.0 branch and master is 2.5 There were some significant bug fixes in 2.6 and version 2.7 is just out now as well. Are there any plans to upgrade? The QDigest deserialization code in 2.5 seems to have bugs that are fixed i

Kafka + Spark Streaming and NoSuchMethodError, related to Manifest / reflection?

I'd like to resurrect this thread: http://mail-archives.apache.org/mod_mbox/spark-user/201403.mbox/%3c6d657d19-1ecf-4e92-bf15-cc4762ef9...@thekratos.com%3E Basically when you call this particular Java-flavored overloading of KafkaUtils.createStream: https://github.com/apache/spark/blob/master/exte

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

0 OK, I withdraw my downvote. Ankur