Re: My curation of pending structured streaming PRs to review

2019-08-18 Thread Jungtaek Lim
As a reminder, the list contains two correctness bugs: stream-stream outer join, and multiple stateful operations with watermark. Regarding common theme, yes that's somewhat I'd rather avoid to say, but honestly I feel there's shortage on active committers on 'structured streaming'. Many of them

Re: My curation of pending structured streaming PRs to review

2019-08-13 Thread Sean Owen
General tips: - dev@ is not usually the right place to discuss _specific_ changes except once in a while to call attention - Ping the authors of the code being changed directly - Tighten the change if possible - Tests, reproductions, docs, etc help prove the change - Bugs are more important than n

Re: My curation of pending structured streaming PRs to review

2019-08-13 Thread vikram agrawal
Thanks, Jungtaek for curating this list. It covers a lot of important fixes and performance improvements in structured streaming. Hi Devs What is missing from process perspective from getting these PRs merged? Apart from this list, is there any other forum where we can request attention to such i