Re: Query regarding state backend for Custom Map Function

2016-12-02 Thread Stefan Richter
? > > From: Stefan Richter > Reply-To: "user@flink.apache.org <mailto:user@flink.apache.org>" > Date: Thursday, December 1, 2016 at 2:53 AM > To: "user@flink.apache.org <mailto:user@flink.apache.org>" > Subject: Re: Query regarding state backend for Cust

Re: Query regarding state backend for Custom Map Function

2016-12-01 Thread Anirudh Mallem
pache.org<mailto:user@flink.apache.org>" Subject: Re: Query regarding state backend for Custom Map Function Hi, using the ValueState and RocksDB to store a map inside the value state means that you will have a different map for each key, which is automatically swapped on a per record basis, d

Re: Query regarding state backend for Custom Map Function

2016-12-01 Thread Stefan Richter
Hi, using the ValueState and RocksDB to store a map inside the value state means that you will have a different map for each key, which is automatically swapped on a per record basis, depending on the record’s key. If you are using a map and Checkpointed, there is only one map and your code is

Query regarding state backend for Custom Map Function

2016-12-01 Thread Anirudh Mallem
Hi Everyone, I am trying to understand the Working With State feature page of the Flink documentation. My question is in case I am using a ValueState in my CustomMap class to store my states with the RocksDb as my state backend then it is clear that every state value is stored in RocksDb. Now i