+1 for ultra-low latency Thanks & Regards Noman
Get Outlook for Android<https://aka.ms/ghei36> From: Reynold Xin Sent: Wednesday, 1 November, 21:07 Subject: [Vote] SPIP: Continuous Processing Mode for Structured Streaming To: dev@spark.apache.org Earlier I sent out a discussion thread for CP in Structured Streaming: https://issues.apache.org/jira/browse/SPARK-20928 It is meant to be a very small, surgical change to Structured Streaming to enable ultra-low latency. This is great timing because we are also designing and implementing data source API v2. If designed properly, we can have the same data source API working for both streaming and batch. Following the SPIP process, I'm putting this SPIP up for a vote. +1: Let's go ahead and design / implement the SPIP. +0: Don't really care. -1: I do not think this is a good idea for the following reasons.
