My apologies, the append log behavior was due to the repartion logs not
being cleaned up. Still the log compation has none influence on the
aggregated records in the procedure mentioned above. Are there any other
tricks one could use? Exactly once does not seem to have effect in this
particular cas
hm, strange. It keeps appending records, even in the state store. The
number of records grows for each run.
/Artur
On Thu, Dec 14, 2017 at 8:18 PM, Artur Mrozowski wrote:
> Ok I see, what was the default value before I've changed it?
>
> On Thu, Dec 14, 2017 at 7:47 PM, Artur Mrozowski wrote:
Ok I see, what was the default value before I've changed it?
On Thu, Dec 14, 2017 at 7:47 PM, Artur Mrozowski wrote:
> Hi Gouzhang,
> thank you for the answer. Indeed the value is being populated now, however
> the application behaves oddly and not how it used to. I suspect that
> disabling cach
Hi Gouzhang,
thank you for the answer. Indeed the value is being populated now, however
the application behaves oddly and not how it used to. I suspect that
disabling caching by setting CACHE_MAX_BYTES_BUFFERING_CONFIG to 0 has been
persisited somehow.
It seems as log compaction has been disabled
StreamsConfig does accept the LONG type, hence it is accepting the
properties as `Map` and do casting internally based on the specified
type.
Note that in the code snippet, StreamsConfig is not used actually, it is
only using Properties which has string constraints.
If you run the slightly modifi
In StreamsConfig.java , CACHE_MAX_BYTES_BUFFERING_CONFIG is defined as:
.define(CACHE_MAX_BYTES_BUFFERING_CONFIG,
Type.LONG,
10 * 1024 * 1024L,
I think using numeral should be accepted (as shown by the Demo.java
classes).
On Thu, Dec 14, 201
Artur,
This is because Properties#getProperty() is expecting a String value, and
hence 10 * 1024 * 1024L is not recognized; you can try "10485760".
Guozhang
On Wed, Dec 13, 2017 at 10:51 PM, Artur Mrozowski wrote:
> Sure.
>
> Another observation I've made is that before I started modifying th
Hi Bill,
I've pinged you directly with the debug file attached. Not able to attach
it here, not sure why.
Best Regards
Artur
On Wed, Dec 13, 2017 at 4:58 PM, Bill Bejeck wrote:
> Just some DEBUG level logging from when you start up your Streams
> application would be great.
>
> Thanks,
> Bill
Sure.
Another observation I've made is that before I started modifying these
properties I could spot quite a few duplicates in the state store. Then I
applied exactly once semantics which removed most of the duplicates.
Finally I disabled cache by setting CACHE_MAX_BYTES_BUFFERING_CONFIG to 0
whic
Could you show us the testing code snippet that shows how you set the
configs and how you read from it for verification?
Guozhang
On Wed, Dec 13, 2017 at 1:07 PM, Artur Mrozowski wrote:
> Hello Guozhang,
>
> I print out some values that I assign to StreamsConfig in the console, but
> the CACH
Hello Guozhang,
I print out some values that I assign to StreamsConfig in the console, but
the CACHE_MAX_BYTES_BUFFERING_CONFIG is always null. I disabled caching by
setting it to 0 today, and it seems to have the expected effect.
But after this I am not able to assign any value to it, it is alway
Just some DEBUG level logging from when you start up your Streams
application would be great.
Thanks,
Bill
On Wed, Dec 13, 2017 at 11:02 AM, Artur Mrozowski wrote:
> Hi Bill,
> No, but I'll be happy to generate it. How do I generate logs for
> StreamsConfig?
>
> Thanks,
> Artur
>
> On Wed, Dec
Hello Artur,
What do you mean exactly by "It simply returns null no matter what value I
provide."?
Guozhang
On Wed, Dec 13, 2017 at 8:02 AM, Artur Mrozowski wrote:
> Hi Bill,
> No, but I'll be happy to generate it. How do I generate logs for
> StreamsConfig?
>
> Thanks,
> Artur
>
> On Wed, D
Hi Bill,
No, but I'll be happy to generate it. How do I generate logs for
StreamsConfig?
Thanks,
Artur
On Wed, Dec 13, 2017 at 3:44 PM, Bill Bejeck wrote:
> H Artur,
>
> Do you have any log files you can share for this issue?
>
> Thanks,
> Bill
>
> On Wed, Dec 13, 2017 at 8:15 AM, Artur Mrozows
H Artur,
Do you have any log files you can share for this issue?
Thanks,
Bill
On Wed, Dec 13, 2017 at 8:15 AM, Artur Mrozowski wrote:
> Actually I can see all other properties being set, except for
> CACHE_MAX_BYTES_BUFFERING_CONFIG that is null.
> I use 0.11.0.2 Kafka Streams.
> Has anyone en
Actually I can see all other properties being set, except for
CACHE_MAX_BYTES_BUFFERING_CONFIG that is null.
I use 0.11.0.2 Kafka Streams.
Has anyone encountered this issue?
/Artur
On Wed, Dec 13, 2017 at 1:11 PM, Artur Mrozowski wrote:
> Hi,
> I played around with caching on Confluent platform
16 matches
Mail list logo
