Re: Plan on Structured Streaming in next major/minor release?

2018-11-02 Thread Jungtaek Lim
My 2 cents, "micro-batch" is the way how Spark handles stream, not a semantic we are considering. Semantically and ideally, same SQL query should provide same result between batch and streaming except late events once the operations in query are supported. 2018년 11월 2일 (금) 오후 3:54, kant kodali 님이

start spark code without applicatio.jar and submit

2018-11-02 Thread 数据与人工智能产品开发部
Hi,we want to execute spark code with out submit application.jar,like this code:public static void main(String args[]) throws Exception{        SparkSession spark = SparkSession                .builder()                .master("lo

spark history server no application found

2018-11-02 Thread 数据与人工智能产品开发部
Hi, I successful start the spark history server ,but there is no application to display , this is the config: spark.eventLog.enabled            true spark.

Continuous task retry support

2018-11-02 Thread Basil Hariri
Hi all, I found that task retries are currently not supported in continuous processing mode. Is there anot