Re: state schema evolution for case classes

2020-03-17 Thread Apoorv Upadhyay
tom serializers for your state. > Please refer to > https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/stream/state/custom_serialization.html > > Regards, > Roman > > > On Wed, Feb 26, 2020 at 6:53 AM Apoorv Upadhyay < > apoorv.upadh...@razorpay.com>

Re: state schema evolution for case classes

2020-03-20 Thread Apoorv Upadhyay
t me know. > > Cheers, > Gordon > > [1] https://issues.apache.org/jira/browse/FLINK-10896 > [2] > https://ci.apache.org/projects/flink/flink-docs-stable/dev/libs/state_processor_api.html > > On Wed, Mar 18, 2020 at 1:04 PM Apoorv Upadhyay < > apoorv.upadh...@razorpay.com

Re: state schema evolution for case classes

2020-04-02 Thread Apoorv Upadhyay
th backlog items the past > days. > > On Fri, Mar 20, 2020 at 4:37 PM Apoorv Upadhyay < > apoorv.upadh...@razorpay.com> wrote: > >> Thanks Gordon for the suggestion, >> >> I am going by this repo : >> https://github.com/mrooding/flink-avro-state-seri

Re: Flink Elasticsearch upsert document in ES

2020-02-10 Thread Apoorv Upadhyay
I have tried by providing opType to elasticsearch builder, I am getting an error message "document already exists" on my console, but it still updates the value in elasticsearch val jsonString = write(record) val rqst: IndexRequest = Requests.indexRequest .index(parameter.get("esIndexName")) .

Re: rocksdb max open file descriptor issue crashed application

2020-02-11 Thread Apoorv Upadhyay
Hi, Below is the error I am getting : 2020-02-08 05:40:24,543 INFO org.apache.flink.runtime.taskmanager.Task - order-steamBy-api-order-ip (3/6) (34c7b05d5a75dbbcc5718acf6b18) switched from RUNNING to CANCELING. 2020-02-08 05:40:24,543 INFO org.apache.flink.runtime.taskmanager

Re: state schema evolution for case classes

2020-02-25 Thread Apoorv Upadhyay
Hi Roman, I have successfully migrated to flink 1.8.2 with the savepoint created by flink 1.6.2. Now I have to modify few case classes due to new requirement I have created a savepoint and when I run the app with modified class from the savepoint it throws error "state not compatible" Previously t