JDK 9
support.
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Tue, Nov 28, 2017 at 9:20 AM, Zhang, Liyun wrote:
> Hi all:
>
> Does anyone know how to build spark with scala12.4? I want to test
> whether spark can wor
I hope that helps, it strengthens your point!
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Fri, Dec 22, 2017 at 1:11 PM, Marco Gaido wrote:
> Hi Xiao, hi all,
>
> I checked the DB2 documentation for which you provided me a link i
BTW - "signalling ahead of time" is called deprecating, not dropping
support...
(personally I only use JDK 8 / Scala 2.11 so I'm for it)
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Sun, Jul 24, 2016 at 1:50 AM, Koert K
t;old" Spark Streaming Programming Guide, as I
think many users will look for them. I had a "deep link" to that page so I
haven't noticed that it is very hard to find until now. I'm referring to
this page:
http://spark.apache.org/docs/latest/structured-streaming-programmin
Kafka full-time contributors work at a single company,
but they manage as a community to have a very transparent design and
development process, which seems to work great.
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Mon, Aug 29, 2016 at
take one of the open issues and write a sample
proposal? A concrete example might make it clearer for those who see this
for the first time. Maybe the Kafka offset discussion or some other
Kafka/Structured Streaming open issue? Will that be helpful?
Ofir Manor
Co-Founder & CTO | Equalum
Mob
challenge to troubleshoot cases where submit fails,
especially when users tries our app on their own spark environment. He
hoped to get a more decent / specific exception if submit failed, or be
able to debug it in an IDE (the actual calling to the master, its response
etc).
Ofir Manor
Co-Founder
rting about now.
Any visibility / sharing will be highly appreciated!
thanks in advance,
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
dedicated owner? lack of commiters
focusing on it?) and just fix it (recruit new commiters to work on it?) to
have a competitive streaming offering in a few quarters.
Just my two cents,
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On
2.11 on JDK8.
Cody - Scala 2.12 will likely be released before Spark 2.1, maybe even
later this week: http://scala-lang.org/news/2.12.0-RC2
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Tue, Oct 25, 2016 at 7:28 PM, Cody Koeninger wrote:
>
as the app may want to access very old windows, unless it would
explicitly say otherwise.
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Thu, Oct 27, 2016 at 9:46 AM, assaf.mendelson
wrote:
> Hi,
>
> Should comments come here or
discussion is whether Scala 2.10 should also be marked as deprecated
(no one is objecting that), and more importantly, when to actually move
from deprecation to actually dropping support for any combination of JDK /
Scala / Hadoop / Python.
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +97
Assaf, I think what you are describing is actually sessionizing, by user,
where a session is ended by a successful login event.
On each session, you want to count number of failed login events.
If so, this is tracked by https://issues.apache.org/jira/browse/SPARK-10816
(didn't start yet)
I agree with you, I think that once we will have sessionization, we could
aim for richer processing capabilities per session. As far as I image it, a
session is an ordered sequence of data, that we could apply computation on
it (like CEP).
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +97
Looking good...
one small things - the documentation on the web site is still 2.1.0
Specifically, the home page has a link (under Documentation menu) labeled
Latest Release (Spark 2.1.1), but when I click it, I get the 2.1.0
documentation.
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +97
ase cycle - but it seems SPARK-18350
was just introduced a couple of weeks ago. Maybe it should be reverted to
unblock the 2.2 release, and a more proper solution could be implemented
for the next release after a more comprehensive discussion?
Just my two cents,
Ofir Manor
Co-Founder & CT
://equalum.atlassian.net/wiki/display/EQ/Kafka+performance+test+tool
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
incompatibilities.
Regarding the current behaviour, if I remember correctly I had to force our
spark O/S user into UTC so Spark wont change my timestamps.
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Thu, May 25, 2017 at 1:33 PM, Reynold Xin w
-list localhost:9092 --date-format
HH:mm:ss:SSS
start.time, end.time, data.consumed.in.MB, MB.sec,
data.consumed.in.nMsg, nMsg.sec
19:32:53:408, 19:33:35:523, 9765.6250, 231.8800, 1000, 237445.0908
If you / someone has followup questions, might be best to do it off
Spark dev list...
Ofir Mano
Spark 2.0, so I think any backlash won't be dramatic
or lasting.
Just my two cents,
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Mon, Apr 4, 2016 at 6:48 PM, Luciano Resende
wrote:
> Reynold,
>
> Considering the performance i
ok similar to hdfs or JDBC *stream("path")*,
where the path will be some sort of Kafka URI (maybe protocol + broker list
+ topic list). Is that the current thinking?
Thanks,
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
A related question - what is the expected release cadence? At least for the
next 12-18 months?
Since this is a new subproject, I am personally hoping it would have a faster
cadence at first, maybe one a month or once every couple of months... If so,
that would affect versioning.
Also, if it uses
Hi,
Regarding the external shuffle service on K8S and especially the push-based
variant that was merged in 3.2:
1.
Are there plans to make it supported and work out-of-the-box in 4.0?
2.
Did anyone make it work for themselves in 3.5 or earlier? If so, can you share
your experience and what w
re[1]. I recommend you
to try it out, and the community is happy to help :)
Regards,
Keyong Zhou
[1]
https://news.apache.org/foundation/entry/apache-software-foundation-announces-new-top-level-project-apache-celeborn
On 2024/06/06 09:08:31 Ofir Manor wrote:
> Hi,
> Regarding the externa
24 matches
Mail list logo
