If I can add one thing to this list I would say stateless aggregations
using Raw SQL.
For example: As I read micro-batches from Kafka I want to do say a count of
that micro batch and spit it out using Raw SQL . (No Count aggregation
across batches.)
On Tue, Oct 30, 2018 at 4:55 PM Jungtaek Lim
Thanks for being this up and much appreciate with keeping on top of this at
all times.
Can upgrading R able to fix the issue. Is this perhaps not necessarily
malform but some new format for new versions perhaps? Anyway we should
consider upgrading R version if that fixes the problem.
As an optio
Hi all,
I want to raise the CRAN failure issue because it started to block Spark
PRs time to time. Since the number
of PRs grows hugely in Spark community, this is critical to not block other
PRs.
There has been a problem at CRAN (See
https://github.com/apache/spark/pull/20005 for analysis).
To c
Just FYI, not to block the release. We found an issue with PySpark barrier
execution mode: https://issues.apache.org/jira/browse/SPARK-25921. We
should list it as a known issues in the release notes and get it fixed in
2.4.1. -Xiangrui
On Thu, Nov 1, 2018 at 12:19 AM Wenchen Fan wrote:
> This vo
Thanks to everyone that attended the sync! We had some good discussions.
Here are my notes for anyone that missed it or couldn’t join the live
stream. If anyone wants to add to this, please send additional thoughts or
corrections.
*Attendees:*
- Ryan Blue - Netflix - Using v2 to integrate Iceb
I took a pass at removing most of the older deprecated items in Spark.
For discussion:
https://github.com/apache/spark/pull/22921
-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
This vote passes! I'll follow up with a formal release announcement soon.
+1:
Xiao Li (binding)
Sean Owen (binding)
Gengliang Wang
Hyukjin Kwon
Wenchen Fan (binding)
Ryan Blue
Bryan Cutler
Marcelo Vanzin (binding)
Reynold Xin (binding)
Chitral Verma
Dilip Biswal
Denny Lee
Felix Cheung (binding)
Do
