ng it {StreamsAppID}-{StateStoreName}-changelog is a good name. Is
there any way I can choose the topic name that Streams is going to use for
a given StateStore?
Thanks in advance,
Vincent Bernardi
I can partition by hand, but it would be much easier if I could just
declare a max disk space to the partitioner one way or the other.
Thanks in advance,
Vincent Bernardi
Hi,
I'm running an experimental Kafka Stream Processor which accumulates lots
of data in a StateStoreSupplier during transform() and forwards lots of
data during punctuate (and deletes it form the StateStoreSupplier). I'm
currently using a persistent StateStore, meaning that Kafka Streams
provides
I forgot to add that I'm using Kafka and Kafka-streams 10.1.1.
V.
On 2017-05-16 15:58 (+0200), Vincent Bernardi wrote:
> Hi,
> I'm running an experimental Kafka Stream Processor which accumulates lots
> of data in a StateStoreSupplier during transform() and forwards lo
cs.confluent.io/current/streams/developer-
> guide.html#streams-developer-guide-rocksdb-config>) by calling
> "options.setIncreaseParallelism(/*
> number of threads for compaction, e.g., 5 */)"
>
> Eno
>
> > On 16 May 2017, at 14:58, Vincent Bernardi
>
Just tried setting compaction threads to 5, but I have the exact same
problem: the rocksdb files get bigger and bigger, while my application
never stores more than 200k K/V pairs.
V.
On Tue, May 16, 2017 at 5:22 PM, Vincent Bernardi
wrote:
> Hi Eno,
> Thanks for your answer. I tried sen
> > On 16 May 2017, at 16:43, Vincent Bernardi
> wrote:
> >
> > Just tried setting compaction threads to 5, but I have the exact same
> > problem: the rocksdb files get bigger and bigger, while my application
> > never stores more than 200k K/V pairs.
> >
amount of data I store in it (~1GB).
V.
On Tue, May 16, 2017 at 10:13 PM, Eno Thereska
wrote:
> 0.10.2.1 is compatible with Kafka 0.10.1.
>
> Eno
> > On 16 May 2017, at 20:45, Vincent Bernardi
> wrote:
> >
> > The LOG files stay small. The SST files are growing but no
here you write to the state store and
> then delete. I'm wondering if you have iterators in your code that need to
> be closed().
>
> Eno
> > On 16 May 2017, at 16:22, Vincent Bernardi
> wrote:
> >
> > Hi Eno,
> > Thanks for your answer. I tried sending a
