Hi,
As suggested this is how I am starting my stream
D:\kafka_2.10-0.10.1.1>bin\windows\kafka-run-class.bat -Dlog4j.debug
-Dlog4j.configurationFile=file:///D:/kafka_2.10-0.10.1.1/log4js.properties
TestKafkaWindowStream
log4j: Using URL
[file:D:/kafka_2.10-0.10.1.1/config/tools-log4j.properties] fo
Hi,
We ran a few tests with apache kafka 0.10.1.1.
We use a Topology with only one processor and a KVStore configured as
persistent backed by rocksdb 4.9.0. Each events received are stored using
the method put(key, value) and in the punctuate method, we iterate over all
entries with all(), process
Hi Pierre,
When you are iterating over the entries do you close the iterator once you
are finished? If you don't then that will cause a memory leak.
Thanks,
Damian
On Sat, 4 Feb 2017 at 16:18 Pierre Coquentin
wrote:
> Hi,
>
> We ran a few tests with apache kafka 0.10.1.1.
> We use a Topology w
The iterator is inside a try-with-resources. And if the memory leak was
inside our code, we will see it using visualvm or jmap, and that's not the
case. This is not a memory leak in the heap. That's why my guess goes
directly to rocksdb.
On Sat, Feb 4, 2017 at 5:31 PM, Damian Guy wrote:
> Hi Pie
Keeping the rocksdb iterator wouldn't cause a memory leak in the heap. That
is why i asked.
On Sat, 4 Feb 2017 at 16:36 Pierre Coquentin
wrote:
> The iterator is inside a try-with-resources. And if the memory leak was
> inside our code, we will see it using visualvm or jmap, and that's not the
>
Oh ok, this is a snippet of the code we use :
List> keyValues = new ArrayList<>();
try (KeyValueIterator iterator = kvStore.all()) {
iterator.forEachRemaining(keyValues::add);
}
// process all entries at once
try {
cc'ed from dev
Forwarded Message
Subject: Re: [DISCUSS] KIP-120: Cleanup Kafka Streams builder API
Date: Sat, 4 Feb 2017 11:30:46 -0800
From: Matthias J. Sax
Organization: Confluent Inc
To: d...@kafka.apache.org
I think the right pattern should be to use TopologyBuilder as a c
Looks fine
On Sat, 4 Feb 2017 at 19:27, Pierre Coquentin
wrote:
Oh ok, this is a snippet of the code we use :
List> keyValues = new ArrayList<>();
try (KeyValueIterator iterator = kvStore.all()) {
iterator.forEachRemaining(keyValues::add);
}
The first Apache IoT mini-con is happening this year at ApacheCon, Miami!!
http://us.apacheiot.org/
The following is a snipped from Roman Shaponshnik on the dev@community
list, perfectly describes the spirit of the mini-con:
"The whole premise of the track will be "Not your gramps IoT" which mea
Hi Sachin,
If you check kafka-run-class.bat you can see that when environment variable
KAFKA_LOG4J_OPTS is not provided, a default log4j configuration under
"tools" will be loaded. So setting the environment variable to something
like
"-Dlog4j.configurationFile=file:///D:/kafka_2.10-0.10.1.1/log4
10 matches
Mail list logo
