Re: Problem with overridden hashCode/equals in keys in Flink 1.11.3 when checkpointing with RocksDB

2021-01-25 Thread David Haglund
Hi Robert and Yun Tang, Robert: Sounds good. Yun: Thanks for the info about the custom serializer. I ended up hard coding the fields which we did not want in to use in the keyBy. Thanks, /David From: Yun Tang Date: Friday, 22 January 2021 at 04:52 To: Robert Metzger , David Haglund Cc

Re: Problem with overridden hashCode/equals in keys in Flink 1.11.3 when checkpointing with RocksDB

2021-01-21 Thread David Haglund
guess it is a known issue then, but it would at least to include that kind of fundamental information on the state backend page as well. Best regards, /David Haglund [2] https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/schema_evolution.html#avro-types From: David Haglund

Re: Problem with overridden hashCode/equals in keys in Flink 1.11.3 when checkpointing with RocksDB

2021-01-20 Thread David Haglund
counted with RockDB. In Flink 1.10.x and later all events are counted but with separate keys when all/both events should be counted using the same key. The main branch in my sample project is using Flink 1.11.3, then there are branches for Flink 1.9.1, 1.10.3 and 1.12.1. Best regards, /David Haglund

Problem with overridden hashCode/equals in keys in Flink 1.11.3 when checkpointing with RocksDB

2021-01-20 Thread David Haglund
indow Aggregation with AggregateFunction" [1], but a colleague of mine reported he had seen the same issue with KeyedProcessFunction too. We are using Scala version 2.11.12 and Java 8. This looks like a bug to me. Is it a known issue or a new one? Best regards, /David Haglund [1] Incremen