Hi,
We tried to produce and consume a AVRO message (zookeeper, broker and schema
registry have been launched), error "Unknown magic byte" occurred while
deserializing Avro message, if I missed anything? Thanks!
>From producer:
# bin/kafka-avro-console-producer --broker-list localhost:9092 --t
Hi All,
We try to upgrade Kafka from 0.8.0 to 0.10.0.0, and there are two brokers in
our Kafka cluster.
We need to restart each broker one by one during the upgrade procedure, when we
shut down the leader broker, seems the follower broker could take the leader
role immediately, but the produce
etail.
Thank you,
Amit
On Tuesday, November 15, 2016, ZHU Hua B
wrote:
> Hi All,
>
>
> Anyone knows if zookeeper upgrade should be executed before broker
> upgrade? Thanks!
>
>
>
>
>
>
> Best Regards
>
> Johnny
>
>
> -Original Message-
here.May be some one else from the
> group can explain this in more detail.
>
> Thank you,
> Amit
>
> On Tuesday, November 15, 2016, ZHU Hua B
>
> wrote:
>
>> Hi All,
>>
>>
>> Anyone knows if zookeeper upgrade should be executed
g here.May be some one else from the
> group can explain this in more detail.
>
> Thank you,
> Amit
>
> On Tuesday, November 15, 2016, ZHU Hua B
>
> wrote:
>
>> Hi All,
>>
>>
>> Anyone knows if zookeeper upgrade should be executed before broker
&g
Hi All,
I have three zookeepers, two Kafka brokers and some clients (consumer and
producer) with current version 0.8.0, according to Kafka document, I do a
rolling upgrade to 0.10.0.0 following below procedure:
1) Upgrade zookeeper one by one (shut down, update the code with
0.10.0.0,
Hi All,
Anyone knows if zookeeper upgrade should be executed before broker upgrade?
Thanks!
Best Regards
Johnny
-Original Message-
From: ZHU Hua B
Sent: 2016年11月14日 15:07
To: users@kafka.apache.org
Subject: RE: Kafka upgrade from 0.8.0 to 0.10.0.0
Hi,
Thanks for your answer
08:54, ZHU Hua B wrote:
> Hi,
>
>
> Thanks for your explanation!
>
> Do you mean I just need to write a number "1" in the file myid on
> 192.168.210.5, not "server.1" or other content? Thanks!
>
>
>
>
>
>
> Best Regards
>
.5:2888:3888
> server.2=192.168.210.6:2888:3888
> server.3=192.168.210.8:2888:3888
So on 192.168.210.5 myid file would say 1, on 192.168.210.6 it would say 2, and
so on.
On 2016.11.15 08:04, ZHU Hua B wrote:
> Hi,
>
>
> Many thanks for your info!
>
> As you said, I think
mber of servers. If you
> only have two servers, then you are in a situation where if one of
> them fails, there are not enough machines to form a majority quorum.
> Two servers is inherently *less* stable than a single server, because
> there are two single points of failure.
On
Hi All,
I want to create a topic with command "bin/kafka-topics.sh --create --zookeeper
HOST:PORT --replication-factor 1 --partitions 1 --topic test", if the option
"--zookeeper" could point to multi-zookeeper URLs such as
"HOST1:PORT1,HOST2:PORT2"?
I tried it as below seems the topic only be
: Kafka upgrade from 0.8.0 to 0.10.0.0
Hi,
I am not an expert but from what read and understood from HDFS documentation,
If you want to upgrade zookeeper, you can not avoid downtime.
Thank you,
Amit
On Thursday, November 10, 2016, ZHU Hua B
wrote:
> Hi,
>
>
> For a rolling upgrade, K
from HDFS documentation,
If you want to upgrade zookeeper, you can not avoid downtime.
Thank you,
Amit
On Thursday, November 10, 2016, ZHU Hua B
wrote:
> Hi,
>
>
> For a rolling upgrade, Kafka suggest upgrade the brokers one at a time
> (shut down the broker, update the code,
Hi,
For a rolling upgrade, Kafka suggest upgrade the brokers one at a time (shut
down the broker, update the code, and restart it) to avoid downtime during the
upgrade.
Usually, there is one zookeeper point to some brokers in a Kafka cluster, if
the zookeeper should be upgraded also? If so, ho
Hi,
If there is a method to send a Avro payloads within Kafka messages using script
"kafka-console-producer.sh"? Thanks!
Best Regards
Johnny
Hi,
Anybody could help to answer below question? If compression type could be
modified through command " bin/kafka-console-producer.sh --producer.config
"? Thanks!
Best Regards
Johnny
-Original Message-----
From: ZHU Hua B
Sent: 2016年10月17日 14:52
To: users@kafka.
ffect only when there is no offset committed
prior or offset being requested is out of range. I believe your mirror maker
has committed offset therefore auto.offset.reset=smallest wont take effect. You
can create a new consumer group and try again
On Mon, 24 Oct 2016 at 17:25 ZHU Hua B wrote
from beginning
On Mon, 24 Oct 2016 at 17:07 ZHU Hua B wrote:
> Hi,
>
>
> Thanks for your info!
>
>
> Before I launch mirror maker first time, there is a topic include some
> messages, which have been produced and consumed on source Kafka cluster.
> Then I launch mirror ma
12:39 PM, ZHU Hua B
wrote:
> Hi,
>
>
> Many thanks for your confirm!
>
> I have another question, if I deleted a mirrored topic on the target
> Kafka cluster, if Kafka mirror maker could mirror the same topic again
> from source cluster when I launch mirror maker next tim
This config will be applicable
for all the consumer threads/instances.
On Mon, Oct 24, 2016 at 11:43 AM, ZHU Hua B
wrote:
> Hi,
>
>
> Because from some Kafka wiki I saw "At minimum, the mirror maker takes
> one or more consumer configurations, a producer configuration and
Hi,
Anybody could help to answer below question? If compression type could be
modified through command " bin/kafka-console-producer.sh --producer.config
"? Thanks!
Best Regards
Johnny
-Original Message-----
From: ZHU Hua B
Sent: 2016年10月17日 14:52
To: users@kafka.
Oct 24, 2016 at 11:07 AM, ZHU Hua B
wrote:
> Hi,
>
>
> The version of Kafka I used is 0.10.0.0. Thanks!
>
>
>
>
>
>
> Best Regards
>
> Johnny
>
> -Original Message-
> From: Guozhang Wang [mailto:wangg...@gmail.com]
> Sent: 2016年10
using for the MM?
Guozhang
On Thu, Oct 20, 2016 at 10:13 PM, ZHU Hua B
wrote:
> Hi,
>
>
> Anybody could help to answer below question? Thanks!
>
>
>
>
>
> Best Regards
>
> Johnny
>
> From: ZHU Hua B
> Sent: 2016年10月19日 16:22
> To: 'users@kaf
Hi,
Anybody could help to answer below question? Thanks!
Best Regards
Johnny
From: ZHU Hua B
Sent: 2016年10月19日 16:22
To: 'users@kafka.apache.org'
Subject: Mirror multi-embedded consumer's configuration
Hi,
I launch Kafka mirror maker with multi-embedded consumer'
Hi,
Anybody could help to answer below question? Thanks!
Best Regards
Johnny
From: ZHU Hua B
Sent: 2016年10月19日 16:22
To: 'users@kafka.apache.org'
Subject: Mirror multi-embedded consumer's configuration
Hi,
I launch Kafka mirror maker with multi-embedded consumer'
Hi,
I launch Kafka mirror maker with multi-embedded consumer's configuration but
failed as below, what's the mean of "you asked for only one", is there an
option control it? Thanks!
# bin/kafka-mirror-maker.sh --consumer.config config/consumer-1.properties
--consumer.config config/consumer-2.
Hi,
If I deleted a topic on the target Kafka cluster, if Kafka mirror maker could
mirror the same topic again from source cluster? Thanks!
Best Regards
Johnny
Hi,
Anybody could help to answer below question? If compression type could be
modified through command " bin/kafka-console-producer.sh --producer.config
"? Thanks!
Best Regards
Johnny
-Original Message-----
From: ZHU Hua B
Sent: 2016年10月17日 14:52
To: users@kafka.
he producer-property option is used to set other properties that are
not compression type.
//h...@confluent.io
Original message ----From: ZHU Hua B
Date: 10/16/16 11:20 PM (GMT-08:00) To:
Radoslaw Gruchalski , users@kafka.apache.org Subject: RE:
A question about kafka Hi,
Thanks
:03
To: users@kafka.apache.org
Subject: Re: A question about kafka
This is known issue in some of the command line tools.
JIRA is here :
https://issues.apache.org/jira/browse/KAFKA-2619
On Mon, Oct 17, 2016 at 11:16 AM, ZHU Hua B
wrote:
> Hi,
>
>
> Anybody could help to answer t
custom configuration for a user-
defined message reader.
Best Regards
Johnny
From: Radoslaw Gruchalski [mailto:ra...@gruchalski.com]
Sent: 2016年10月17日 14:02
To: ZHU Hua B; users@kafka.apache.org
Subject: RE: A question about kafka
Hi,
I believe the answ
Hi,
Anybody could help to answer this question? Thanks!
Best Regards
Johnny
-Original Message-
From: ZHU Hua B
Sent: 2016年10月14日 16:41
To: users@kafka.apache.org
Subject: [COMMERCIAL] A question about kafka
Hi,
I have a question about kafka, could you please help to have a
Hi,
I have a question about kafka, could you please help to have a look?
I want to send a message from producer with snappy compression codec. So I run
the command "bin/kafka-console-producer.sh --compression-codec snappy
--broker-list localhost:9092 --topic test", after that I checked the dat
33 matches
Mail list logo
