[DISCUSS] Support KeyedSortedMapState in DataStream API

2020-10-14 Thread Sean Z
Hi devs, Current DataStream API doesn't have SortedMapState supported. There are lots of use cases based on sorted time-series data like range-query or higher/lower key fetch, and ordered data seems like a nature of time-series stream processing. Therefore, we propose to support the KeyedSortedMap

Re: [DISCUSS] Support KeyedSortedMapState in DataStream API

2020-10-14 Thread Sean Z
mporalState in our prototype. > > I look forward to sharing what we learned, and to discussing this further, > but I am completely overwhelmed with Flink Forward preparations at the > moment. > > Best, > David > > On Wed, Oct 14, 2020 at 9:30 AM Sean Z wrote: > > &g

Re: [DISCUSS] Support KeyedSortedMapState in DataStream API

2020-10-15 Thread Sean Z
https://github.com/apache/flink/tree/blink/flink-libraries/flink-table/src/main/java/org/apache/flink/table/typeutils/ordered > > Best, > Jark > > On Thu, 15 Oct 2020 at 06:46, Sean Z wrote: > > > Thanks for the reply! Look forward to learning more about this prototype. &

[Discuss] Questions about SortedMapState in Stream API

2020-07-23 Thread Sean Z
Hi Flink Community, I'm new to this community but have been using Flink for a year or so. As a user, my team built stuff upon Flink stateful stream processing. We used to have a use case that we need a sorted map data structure to store our state, something like TreeMap in Java, to query higher/lo

Re: [Discuss] Questions about SortedMapState in Stream API

2020-07-29 Thread Sean Z
ntly, there was an > issue FLINK-6219 about sorted mapstate before. I think you can reach to > this issue if you want sorted mapstate. > Sorted MapState for RocksDB can be challenging for Java-based comparator, > RocksDB supports the bytes-comparator only. > > Best, > Congxian

[jira] [Created] (FLINK-19708) Support KeyedSortedMapState in DataStream API

2020-10-19 Thread Sean Z (Jira)
Sean Z created FLINK-19708: -- Summary: Support KeyedSortedMapState in DataStream API Key: FLINK-19708 URL: https://issues.apache.org/jira/browse/FLINK-19708 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-19709) Support KeyedSortedMapState in DataStream API

2020-10-19 Thread Sean Z (Jira)
Sean Z created FLINK-19709: -- Summary: Support KeyedSortedMapState in DataStream API Key: FLINK-19709 URL: https://issues.apache.org/jira/browse/FLINK-19709 Project: Flink Issue Type: New Feature