Hi Manu,
Just realized you have a question in the previous email that I missed.
Sorry!
The local log offset is actually only used for shortening the recovery time
upon resuming: it acts as an indicator that the task was cleanly shutdown
previously, and hence the state stores are in consistent sta
Also including kafka user mailing list.
Has anybody seen this error? Any idea to fix it?
Thanks
Subhash Agrawal.
From: Subhash Agrawal
Sent: Wednesday, July 06, 2016 5:12 PM
To: 'd...@kafka.apache.org'
Subject: Error after restarting kafka broker
Hi All,
I am running kafka broker (0.10.0 version
Hello,
I was hoping someone might know this off the top of their head. I haven't
been able to find any documentation on it so I was curious if it was still
available. We're upgrading to Kafka 8.2 from 8.1 (ya, we're a bit behind)
and we used to have the following in jmxtrans that would give us mon
I would imagine the JIRA is the best place:
https://issues.apache.org/jira/browse/KAFKA/
On Thu, Jul 7, 2016 at 2:11 PM, Fumo, Vincent
wrote:
> I've found what I think are 2 bugs in the code. I'm not sure where I can
> report them. I tried the dev list but my emails never got acknowledged.
> Whe
KafkaConsumer v0.9::
I have a consumer set up with session.timeout.ms set to 30s. I make a call like
consumer.poll(1)
but if the kafka broker is down, that call will hang indefinitely.
Digging into the code it seems that the timeout isn't respected:
KafkaConsumer calls out to pollOnce() as
I've found what I think are 2 bugs in the code. I'm not sure where I can report
them. I tried the dev list but my emails never got acknowledged. Where can I
report issues?
I just resolved the fix I needed before having time to see your reply. I
took all references to JsonPOJO and Jackson JSON dependencies and am using
for VALUE_SERDE_CONFIG SpecificAvroSerde and it works well. Indeed I had
not planned to embed the schema info in each message as this would be
tedious
Hi Srikanth, Clive,
Today we just added some example code usage in the KIP after feedback from the
community. There is code that shows how to access a WindowStore (in read-only
mode).
Thanks
Eno
> On 7 Jul 2016, at 15:57, Srikanth wrote:
>
> Eno,
>
> I was also looking for something simil
I find this tuning guide in RocksDB quite useful, regarding your write /
space amplifications.
https://github.com/facebook/rocksdb/wiki/RocksDB-Tuning-Guide
Guozhang
On Thu, Jun 30, 2016 at 8:36 AM, Avi Flax wrote:
> On Jun 29, 2016, at 22:44, Guozhang Wang wrote:
> >
> > One way to mentally
The examples code in AK repo uses JSON as the serde, whereas the examples
in CP repo used Avro, with the embedded schema. These two are different
serde schemes.
Using a schema registry for Avro / etc would be a better approach to you,
since it does not require each message to embed the schema info
Thats right Ismael, I am looking for work arounds either on 0.9.0.1
Producer side or on the Kafka Streams side so that I can process messages
produced by 0.9.0.1 producer using Kafka Streams Library.
Thanks,
Vivek
On Thu, Jul 7, 2016 at 9:05 AM, Ismael Juma wrote:
> Hi,
>
> Matthias, I think Vi
Hi Tom,
if you need a commercially proven lag monitoring solution (and all other
Kafka and ZK metrics) take a look at our SPM.
Hope you don't mind me plugging this one in :)
[image: Inline image 1]
Marko Bonaći
Monitoring | Alerting | Anomaly Detection | Centralized Log Management
Solr & Elastics
Hi,
Matthias, I think Vivek's question is not whether Kafka Streams can be used
with a Kafka 0.9 broker (which it cannot). The question is whether Kafka
Streams can process messages produced with a 0.9.0.1 producer into a
0.10.0.0 broker. Is that right? If so, would a custom TimestampExtractor
wor
No — the number of partitions is specified when you create the topic, and you
can subsequently modify it using the command-line tool, but if you try to write
to a nonexistent partition you’ll get an exception.
Ian.
---
Ian Wrigley
Director, Education Services
Confluent, Inc
> On Jul 7, 2016, a
Hi
Is there a way to send message to broker to a new partition with the
assumption that the broker will create new partition automatically? (almost
like auto.create.topics.enable property)
thanks
Eno,
I was also looking for something similar. To output aggregate value once
the window is "complete".
I'm not sure getting individual update for an aggregate operator is that
useful.
With KIP-67, will we have access to Windowed[key]( key + timestamp) and
value?
Does until() clear this store whe
One thing I can think of is Kafka likes lots of OS page cache. Dockerizing
from the standpoint of packaging configs is a good idea, just make sure if
you're running many brokers together on the same host, they've got enough
resources (CPU/Mem) so they don't starve each other.
On Thu, Jul 7, 2016 a
Hi Vivek,
Kafka Streams works only with Kafka 0.10 (but not with 0.9).
I am not aware of any work around to allow for 0.9 usage.
-Matthias
On 07/07/2016 05:37 AM, vivek thakre wrote:
> Can kafka streams library work with the messages produced by 0.9.0.1
> producer?
> I guess not since the old
Hi, __consumer_offsets ’s partition 7 and partition 27 leader is -1, and isr
is null，who can tell me how to recover it，thank you.
Topic: __consumer_offsets Partition: 0Leader: 3 Replicas: 3,4,5
Isr: 4,5,3
Topic: __consumer_offsets Partition: 1Leader: 4
19 matches
Mail list logo
