Hi,
I have a single node Kafka broker and 3-node Zookeeper cluster.
When I create a new topic with 24 partitions using the command:
kafka-topics.sh --zookeeper zoo3:2181 --create --topic test_topic
--replication-factor 1 --partitions 24
It results in 481M data in the log-dir!? Actually, every p
Hi,
the polls method works with an internal buffer, on a timeout it will
return records in the internal buffers, not necessary from the
topic/partition in the broker.
Missatge de Mark Anderson del dia dl., 4 de febr.
2019 a les 19:57:
> I'm sure I initially made this assumption when trying to r
Hi Manu,
if we take master of the connector, I forgot to ask you witch version are
you using, your error looks to me coming from:
https://github.com/confluentinc/kafka-connect-storage-cloud/blob/master/kafka-connect-s3/src/main/java/io/confluent/connect/s3/S3SinkTask.java#L193
This line is basi
I'm sure I initially made this assumption when trying to read all records
from a compacted topic on application startup and it was incorrect.
Due to latency, threading GC pauses etc it would return 0 when there were
still records on the topic.
Mark
On Mon, 4 Feb 2019, 18:02 Pere Urbón Bayes Hi,
Hi,
see from the javadocs:
> timeout - The time, in milliseconds, spent waiting in poll if data is not
available in the buffer. If 0, returns immediately with any records that
are available currently in the buffer, else returns empty. Must not be
negative.
for a network problem it will return a
This is a theoretical question. I have not seen this behavior but
wanted to know if it was possible.
If consumer.poll() returns EMPTY, does that always mean no records are
currently available? In other words, let's say there are some records
in a partition. Could poll() return EMPTY if there was a
Correct
On Sat, Feb 2, 2019, 10:09 AM Amitav Mohanty Hi
>
> I am trying to measure incoming bytes over time. I am trying collect the
> following metric and apply integral function over a set of data points on a
> time series.
>
> kafka.server:type=BrokerTopicMetrics,name=BytesInPerSec,topic=my_to
Thanks for the explanation. Can you help me understand what this metric
signify then?
Also, count would be the number of messages is what I thought.
-Amitav
On Sat, Feb 2, 2019 at 11:45 PM Kamal Chandraprakash <
kamal.chandraprak...@gmail.com> wrote:
> In Yammer metrics, the 15MinuteRate provid
