Re: Question over Incremental Snapshot vs Full Snapshot in rocksDb state backend

2018-10-28 Thread chandan prakash
Thanks a lot Andrey . Your answer to 1st question clarifies well for both the questions. Appreciate your help in clearing doubt Regards, Chandan On Thu, Oct 25, 2018 at 6:10 PM Andrey Zagrebin wrote: > Hi Chandan, > > > 1. Why did we took 2 different approaches using different RocksDB apis ? >

Re: Queryable state when key is UUID - getting Kyro Exception

2018-10-28 Thread Jayant Ameta
Hi Jiayi, Any further help on this? Jayant Ameta On Fri, Oct 26, 2018 at 9:22 AM Jayant Ameta wrote: > MapStateDescriptor descriptor = new > MapStateDescriptor<>("rulePatterns", UUID.class, > String.class); > > Jayant Ameta > > > On Fri, Oct 26, 2018 at 8:19 AM bupt_ljy wrote: > >> Hi, >

Flink Task Allocation on Yarn

2018-10-28 Thread Marvin777
Hi all, In the mode of on yarn, a node may contain more than one container, is there a scheme for assigning tasks to different nodes. the version is 1.4.2 Thanks for your assistance.

Re: Flink Kafka to BucketingSink to S3 - S3Exception

2018-10-28 Thread Rafi Aroch
Hi, I'm also experiencing this with Flink 1.5.2. This is probably related to BucketingSink not working properly with S3 as filesystem because of the eventual-consistency of S3. I see that https://issues.apache.org/jira/browse/FLINK-9752 will be part of 1.6.2 release. It might help, if you use the

Re: InterruptedException when async function is cancelled

2018-10-28 Thread Anil
I do see the same error but in case different situation. I'm not cancelling the job. Below is my error stack trace. SwiglobeZoneFromLatLong is my UDF name. Is this error something ignorable. I'm using flink 1.4.2. Thanks in advance. ``` {"debug_level":"ERROR","debug_timestamp":"2018-10-28 06:40