Re: Netty channel closed at AKKA gated status

2019-04-21 Thread zhijiang
Hi Wenrui, I think you could trace the log of node manager which contains the lifecycle of this task executor. Maybe this task executor is killed by node manager because of memory overuse. Best, Zhijiang -- From:Wenrui Meng Send T

Json manipulating in flink

2019-04-21 Thread Andy Hoang
Hi guys, I’m just curious what json lib you’re doing for data transformation between operations. I’m trying to pick one so I’m looking for experiences about personal choices, pro, cons of them. From what I read, it is spray, argonaut, circe, upickle. I’m trying upickle, its easy indeed but I’m

Re: assignTimestampsAndWatermarks not work after KeyedStream.process

2019-04-21 Thread Guowei Ma
HI, BoundedOutOfOrdernessTimestampExtractors can send a WM at least after it receives an element. For after Keyby: Flink uses the HashCode of key and the parallelism of down stream to decide which subtask would receive the element. This means if your key is always same, all the sources will only

Re: PatternFlatSelectAdapter - Serialization issue after 1.8 upgrade

2019-04-21 Thread Guowei Ma
I think you could try StreamExecutionEnvironment.clean(pendingProjectsTag). Oytun Tez 于2019年4月19日 周五下午9:58写道: > Forgot to answer one of your points: the parent class compiles well > without this CEP selector (with timeout signature)... > > > --- > Oytun Tez > > *M O T A W O R D* > The World's Fa

Create Custom Sink for DataSet

2019-04-21 Thread Soheil Pourbafrani
Hi, Using the DataStream API I could create a Custom Sink like classRichMySqlSink extends RichSinkFunction and define my desire behavior in inserting data into mysql table. But using the DataSet API I just can find the output method for sinking data and it accept just OutputFormat data type. In add

Re: Error restoring from checkpoint on Flink 1.8

2019-04-21 Thread Congxian Qiu
Hi, >From the given error message, this seems flink can't open RocksDB because of the number of column family mismatch, do you mind sharing a minimum job which can reproduce this problem? Best, Congxian Ning Shi 于2019年4月21日周日 上午10:56写道: > For clarification, one of the operators in the chain me