[SS] number of output rows metric for streaming aggregation (StateStoreSaveExec) in Append output mode not measured?

2019-10-12 Thread Jacek Laskowski
Hi, I use Spark 2.4.4 I've just noticed that the number of output rows metric of StateStoreSaveExec physical operator does not seem to be measured for Append output mode. In other words, whatever happens before or after StateStoreSaveExec operator the metric is always 0. It is measured for the o

[VOTE][RESULT][SPARK-28885] Follow ANSI store assignment rules in table insertion by default

2019-10-12 Thread Gengliang Wang
Hi, All. The vote passes. Thanks to everyone who participated in the discussions and votes! I will create a PR to change the default store assignment policy as "ANSI" for both V1 and V2. +1 (* = binding): Alessandro Solimando Wenchen Fan* Russell Spitzer Takeshi Yamamuro Hyukjin Kwon* Xiao Li* Ry