Re: Prefix Seek RocksDB

2021-03-16 Thread Yun Tang
:02 To: Yun Tang Cc: user ; Brad Davis Subject: Re: Prefix Seek RocksDB Thanks for the input, I'll look more into that. Does your answer then imply that Joins and Aggs do not inherently always use prefix seeks? I'd imagine that the join key on join and groupby key on aggs would alwa

Re: Prefix Seek RocksDB

2021-03-16 Thread Rex Fenley
Thanks for the input, I'll look more into that. Does your answer then imply that Joins and Aggs do not inherently always use prefix seeks? I'd imagine that the join key on join and groupby key on aggs would always be used as prefix keys. Is this not the case? Also, is there good information on wh

Re: Prefix Seek RocksDB

2021-03-15 Thread Yun Tang
Hi Rex, You could configure prefix seek via RocksDB's column family options [1]. Be careful to use correct prefix extractor. [1] https://ci.apache.org/projects/flink/flink-docs-stable/ops/state/state_backends.html#passing-options-factory-to-rocksdb Best Fro