Re: [PROPOSAL] Contribute Stateful Functions to Apache Flink

2019-10-12 Thread Hequn Cheng
Hi Stephan, Big +1 for adding this to Apache Flink! As for the problem of whether this should be added to the Flink main repository, from my side, I prefer to put it in the main repository. Not only Stateful Functions shares very close relations with the current Flink, but also other libs or modu

??flink sql??table in subquery join temporal table raise java.lang.NullPointerException

2019-10-12 Thread hzp
Hi all, I'm using flink sql to join a temporal table in a subquery, but it raises java.lang.NullPointerException when execute. Orders is a table source, and Rates is a temporal table Here are my sqls: // works SELECT o_amount * r_amount AS amount FROM Orders, LATERAL TABLE (Rates(o_procti

[flink sql] table in subquery join temporal table raise java.lang.NullPointerException

2019-10-12 Thread hzp
Hi all, I'm using flink sql to join a temporal table in a subquery, but it raises java.lang.NullPointerException when execute. Orders is a table source, and Rates is a temporal table Here are my sqls: // works SELECT o_amount * r_amount AS amount FROM Orders, LATERAL TABLE (Rates(o_procti

Re: Discard message on deserialization errors.

2019-10-12 Thread Zhu Zhu
I mean the Kafka source provided in Flink can correctly ignores null deserialized values. isEndOfStream allows you to control when to end the input stream. If it is used for running infinite stream jobs, you can simply return false. Thanks, Zhu Zhu John Smith 于2019年10月12日周六 下午8:40写道: > The Kaf

Re: [PROPOSAL] Contribute Stateful Functions to Apache Flink

2019-10-12 Thread Biao Liu
Hi Stehpan, +1 for having Stateful Functions in Flink. Before discussing which repository it should belong, I was wondering if we have reached an agreement of "splitting flink repository" as Piotr mentioned or not. It seems that it's just no more further discussion. It's OK for me to add it to co

Re: Discard message on deserialization errors.

2019-10-12 Thread John Smith
The Kafka Fetcher you mean the flink JSON schemas? They throw IOExceptions? Also what's the purpose of isEndOfStream most schemas I looked at don't do anything but just return false? On Fri., Oct. 11, 2019, 11:44 p.m. Zhu Zhu, wrote: > Hi John, > > It should work with a *null* return value. > I

Re: [PROPOSAL] Contribute Stateful Functions to Apache Flink

2019-10-12 Thread Yu Li
Hi Stephan, Big +1 for adding stateful functions to Flink. I believe a lot of user would be interested to try this out and I could imagine how this could contribute to reduce the TCO for business requiring both streaming processing and stateful functions. And my 2 cents is to put it into flink co

Re: [PROPOSAL] Contribute Stateful Functions to Apache Flink

2019-10-12 Thread jincheng sun
Hi Stephan, bit +1 for adding this great features to Apache Flink. Regarding where we should place it, put it into Flink core repository or create a separate repository? I prefer put it into main repository and looking forward the more detail discussion for this decision. Best, Jincheng Jingso

Re: Batch Job in a Flink 1.9 Standalone Cluster

2019-10-12 Thread Timothy Victor
This part about the GC not cleaning up after the job finishes makes sense. However, I o served that even after I run a "jcmd GC.run" on the task manager process ID the memory is still not released. This is what concerns me. Tim On Sat, Oct 12, 2019, 2:53 AM Xintong Song wrote: > Generally y