IMO SPARK-10335 should be tagged with "Bug"? If so, I think we should not
close it and fix in future.
// maropu
On Fri, Jan 20, 2017 at 1:27 PM, Michael Allman
wrote:
> That sounds fine to me. I think that in closing the issues, we should
> mention that we're closing them because these algorith
Thanks Kai,
I am getting the message and its stuck when I run sbt any idea:-
"Set current project to spark-parent (in build file:/home/cloudera/spark/)"
Details attached.
Regards,
Deepu Raj
+61 414 707 319
On Fri, 20 Jan 2017 10:27:16 +1100, Kai Jiang wrote:
Hi Deepu,
Hope this page can
Hi ,
Is it possible for an executor (or slave) to know when an actual job ends?
I'm running spark on a cluster (with yarn) and my workers create some
temporary files that I would like to clean up once the job ends. Is there a
way for the worker to detect that a job has finished? I tried doing it i
That sounds fine to me. I think that in closing the issues, we should mention
that we're closing them because these algorithms can be implemented using the
existing API.
Michael
> On Jan 19, 2017, at 5:34 PM, Dongjin Lee wrote:
>
> Thanks for your comments. Then, How about change following i
Hi ,
Is it possible for an executor (or slave) to know when an actual job ends?
I'm running spark on a cluster (with yarn) and my workers create some
temporary files that I would like to clean up once the job ends. Is there a
way for the worker to detect that a job has finished? I tried doing it i
Thanks for your comments. Then, How about change following issues (see
below) into 'won't fix'? After Implementing & uploading them as Spark
Packages, commenting on those issues would be a reasonable solution. It
would also be better for the potential users of those graph algorithms.
- SPARK-15880
Hi Deepu,
Hope this page can give you some help.
http://spark.apache.org/developer-tools.html
Best,
Kai
On Thu, Jan 19, 2017, 14:51 Deepu Raj wrote:
> Hi,
>
> Is there any article/Docs/support to set up Apache Spark source code on
> Eclipse/InteliJ.
>
> I have tried setting up the source code,
Hi,
Is there any article/Docs/support to set up Apache Spark source code on
Eclipse/InteliJ.
I have tried setting up the source code, by importing into Git & using
maven. I am getting lot of compilation errors.
#suggestions
Regards,
Deepu Raj
+61 414 707 319
---
Hi Seth
Re: "The most important thing we can do, given that MLlib currently has a very
limited committer review bandwidth, is to make clear issues that, if worked on,
will definitely get reviewed. "
We are adopting a Shepherd model, as described in the JIRA Joseph has, in
which, when assigned,
Thanks Sean!
On Thu, Jan 19, 2017 at 6:09 AM, Sean Owen wrote:
> Yes, confirmed that fixing it unfortunately causes trouble in Java 8. See
> https://issues.apache.org/jira/browse/SPARK-19287 for further discussion.
>
> On Wed, Jan 18, 2017 at 9:00 PM Sean Owen wrote:
>
>> Hm. Unless I am also t
+1 general abstractions like distributed linear algebra.
On Thu, Jan 19, 2017 at 8:54 AM, Seth Hendrickson <
seth.hendrickso...@gmail.com> wrote:
> I think the proposal laid out in SPARK-18813 is well done, and I do think
> it is going to improve the process going forward. I also really like the
Regarding new GraphX algorithms, I am in agreement with the idea of publishing
algorithms which are implemented using the existing API as outside packages.
Regarding SPARK-10335, we have a PR for SPARK-5484 which should address the
problem described in that ticket. I've reviewed that PR, but bec
I think the proposal laid out in SPARK-18813 is well done, and I do think
it is going to improve the process going forward. I also really like the
idea of getting the community to vote on JIRAs to give some of them
priority - provided that we listen to those votes, of course. The biggest
problem I
Thanks for your comment, Dongjin!
I have a pretty basic and also important question; why do you implement
these features as a third-party library (and then upload them to the spark
packages https://spark-packages.org/)? ISTM graphx has already necessary
and sufficient APIs for these third-party on
Can you just cancel the `ScheduledFuture` returned by `scheduleAtFixedRate`
when catching the exception in the main thread of the spark driver?
John Fang wrote
> My spark main thread create some daemon threads which maybe timer thread.
> Then the spark application throw some exceptions, and the
Yes, confirmed that fixing it unfortunately causes trouble in Java 8. See
https://issues.apache.org/jira/browse/SPARK-19287 for further discussion.
On Wed, Jan 18, 2017 at 9:00 PM Sean Owen wrote:
> Hm. Unless I am also totally missing or forgetting something, I think
> you're right. The equival
16 matches
Mail list logo
