+1
From: Cody Koeninger
Sent: Tuesday, September 5, 2017 8:12:07 AM
To: Sean Owen
Cc: dev
Subject: Re: Putting Kafka 0.8 behind an (opt-in) profile
+1 to going ahead and giving a deprecation warning now
On Tue, Sep 5, 2017 at 6:39 AM, Sean Owen wrote:
> On the
+1 on the design and proposed API.
One detail I'd like to discuss is the 0-parameter UDF, how we can specify
the size hint. This can be done in the PR review though.
On Sat, Sep 2, 2017 at 2:07 AM, Felix Cheung
wrote:
> +1 on this and like the suggestion of type in string form.
>
> Would it be
Hello community,
I would like to start a discussion about adding support for images in
Spark. We will follow up with a formal vote in two weeks. Please feel free
to comment on the JIRA ticket too.
JIRA ticket: https://issues.apache.org/jira/browse/SPARK-21866
PDF version:
https://issues.apache.or
+1 to going ahead and giving a deprecation warning now
On Tue, Sep 5, 2017 at 6:39 AM, Sean Owen wrote:
> On the road to Scala 2.12, we'll need to make Kafka 0.8 support optional in
> the build, because it is not available for Scala 2.12.
>
> https://github.com/apache/spark/pull/19134 adds that
Here's the jira for upgrading to a 0.10.x point release, which is
effectively the discussion of upgrading to 0.11 now
https://issues.apache.org/jira/browse/SPARK-18057
On Tue, Sep 5, 2017 at 1:27 AM, matus.cimerman wrote:
> Hi guys,
>
> is there any plans to support Kafka 0.11 integration for Sp
On the road to Scala 2.12, we'll need to make Kafka 0.8 support optional in
the build, because it is not available for Scala 2.12.
https://github.com/apache/spark/pull/19134 adds that profile. I mention it
because this means that Kafka 0.8 becomes "opt-in" and has to be explicitly
enabled, and th
Hi All,
I've been working on a pull request [1] to allow Spark read from a specific
timestamp from Kinesis. I have iterated the patch with the help of other
contributors and we think that its in a good state now.
This patch would save hours of crash recovery time for Spark while reading
off Kinesi
