Thank you for the idea, I'll keep that in mind if I run into limitations of
my current approach.
> On Jun 6, 2017, at 5:50 PM, Guozhang Wang wrote:
>
> Thanks Steven, interesting use case.
>
> The current streams state store metadata discovery is assuming the
> `DefaultStreamPartitioner` is use
Thanks Steven, interesting use case.
The current streams state store metadata discovery is assuming the
`DefaultStreamPartitioner` is used, which is a limitation for such cases.
Another workaround that I can think of is, that you can first partition on
D in the first stage to let the workers to t
Happy to hear you found a working solution, Steven!
-Michael
On Sat, Jun 3, 2017 at 12:53 AM, Steven Schlansker <
sschlans...@opentable.com> wrote:
> >
> > On Jun 2, 2017, at 3:32 PM, Matthias J. Sax
> wrote:
> >
> > Thanks. That helps to understand the use case better.
> >
> > Rephrase to ma
>
> On Jun 2, 2017, at 3:32 PM, Matthias J. Sax wrote:
>
> Thanks. That helps to understand the use case better.
>
> Rephrase to make sure I understood it correctly:
>
> 1) you are providing a custom partitioner to Streams that is base on one
> field in your value (that's fine with regard to f
Thanks. That helps to understand the use case better.
Rephrase to make sure I understood it correctly:
1) you are providing a custom partitioner to Streams that is base on one
field in your value (that's fine with regard to fault-tolerance :))
2) you want to use interactive queries to query the s
> On Jun 2, 2017, at 2:11 PM, Matthias J. Sax wrote:
>
> I am not sure if I understand the use case correctly. Could you give
> some more context?
Happily, thanks for thinking about this!
>
>> backing store whose partitioning is value dependent
>
> In infer that you are using a custom store
I am not sure if I understand the use case correctly. Could you give
some more context?
> backing store whose partitioning is value dependent
In infer that you are using a custom store and not default RocksDB? If
yes, what do you use? What does "value dependent" mean in this context?
Right now,
