Re: Stream caching

Hello Guozhang! I’m talking about disk usage, about /tmp/kafka-streams. My application merges 3 topics, one of them has 120 partitions. As i understood from documentation(https://docs.confluent.io/current/streams/sizing.html), disk usage depends on partition count. And I really want to decreas

Re: Stream caching

Hello Kohut, Is your issue about disk usage, or memory? The first email seems to indicate disks (there's no direct way for bounding the disk usage of state stores, though you can set e.g. retention period to indirectly control disk usage via specifying how long do you want to retain windowed store

Re: Stream caching

And I have a lot of warning that describe in this lira https://issues.apache.org/jira/browse/KAFKA-5998?attachmentOrder=asc Thanks. Kohut Yaroslav > On Apr 12, 2019, at 10:59 AM, Ярослав Когут wrote: > > Hello, yes I know

Re: Stream caching

Hello, yes I know it, I read about rocks db. But do we have ability to make some size limitation for this db? Because we have alerts in grafana, that application is using more then 80% of full app memory. I’ll be very grateful for the help. Thanks. Kohut Yaroslav > On Apr 12, 2019, at 4:02 A

Re: Stream caching

Hello Kohut, Streams's default state.dir location is /tmp/kafka-streams, that may explained it. For more info about state management of Kafka Streams, you can read https://kafka.apache.org/21/documentation/streams/architecture#streams_architecture_state Guozhang On Thu, Apr 11, 2019 at 1:09 AM

Stream caching

Hi guys. I’ve deployed spring cloud application using docker, service is using KStream functionality, and I have problems with /tmp folder. On some instances of application /tmp folder is from 3 to 6 GB. Maybe I missed some property? I will be very grateful for the help. Thanks, best regards.