Re: why operator not chained?

2019-11-23 Thread Guowei Ma
Hi, Steven 1. The `icebergsink-writer` operator does not chain with the first operator is because the "icebergsink-writer" operator 's ChainingStrategy is NULL or HEAD. You could verify it by printing writer.getChainingStrategy. 2. The two operators use the FORWARD partition if the parallelism of

DataSet API: HBase ScannerTimeoutException and double Result processing

2019-11-23 Thread Mark Davis
Hello, I am reading Results from an HBase table and process them with Batch API. Everything works fine until I receive a ScannerTimeoutException from HBase. Maybe my transformations get stuck or a GC pause happen - hard to tell. The HBase Client restarts the scan and the processing continues. Ex

Re: [DISCUSS] Support configure remote flink jar

2019-11-23 Thread Rong Rong
Thanks @Tison for starting the discussion and sorry for joining so late. Yes, I think this is a very good idea. we already tweak the flink-yarn package internally to support something similar to what @Thomas mentioned: to support registering a Jar that has already uploaded to some DFS (needless to

Re: Apache Flink - Troubleshooting exception while starting the job from savepoint

2019-11-23 Thread M Singh
Hey Folks:    Please let me know how to resolve this issue since using  --allowNonRestoredState without knowing if any state will be lost seems risky. ThanksOn Friday, November 22, 2019, 02:55:09 PM EST, M Singh wrote: Hi: I have a flink application in which some of the operators have