lable at https://github.com/stealthly/kafka/tree/v0.8.2_KAFKA-1477.
>
> Thanks,
> Raja.
>
>
> On Tue, Jul 29, 2014 at 10:54 PM, Calvin Lei wrote:
>
> > Raja,
> >Which Kafka version is your security enhancement based on?
> >
> > thanks,
> > C
Raja,
Which Kafka version is your security enhancement based on?
thanks,
Cal
On Wed, Jul 23, 2014 at 5:01 PM, Chris Neal wrote:
> Pramod,
>
> I got that same error when following the configuration from Raja's
> presentation earlier in this thread. If you'll notice the usage for the
> conso
Hi,
My cluster has 5 topics and each has 1 partition. Each topic has 4
replicas. For some reasons, the broker leaders of all topics are pointing
the same box. Is there a way for me to shuffle the leaders a bit to avoid
all pointing to the same box?
thanks in advance,
Cal
Source Security LLC
> > http://www.stealth.ly
> > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > /
> >
> >
> > On Tue, Jan 7, 2014 at 11:31 AM, Calvin Lei wrote:
> >
> > > Does it support an long timestamp? Tried it and the resulting offset
> > > response contains an empty long array.
> > >
> > >
> > >
> > >
> > >
> > > --
> > > Sent from Gmail Mobile
> > >
> >
>
a log
> segment file whose last modified time is less than the provided timestamp.
>
> Thanks,
>
> Jun
>
>
> On Tue, Jan 7, 2014 at 8:31 AM, Calvin Lei >
> wrote:
>
> > Does it support an long timestamp? Tried it and the resulting off
Does it support an long timestamp? Tried it and the resulting offset
response contains an empty long array.
--
Sent from Gmail Mobile
t; option for details).
>
> Thanks,
>
> Jun
>
>
> On Sun, Oct 13, 2013 at 8:02 AM, Calvin Lei wrote:
>
> > Yes.
> >
> > Partitions reassignment failed due to None.get
> > java.util.NoSuchElementException: None.get
> >at scala.None$.get
s,
> Neha
> On Oct 12, 2013 1:56 PM, "Calvin Lei" wrote:
>
> > Checked the json file and everything seems normal. When I run the script
> > and I got the error:
> >
> > Partitions reassignment failed due to None.get
> > java.util.NoSuchElementExcep
Checked the json file and everything seems normal. When I run the script
and I got the error:
Partitions reassignment failed due to None.get
java.util.NoSuchElementException: None.get
at scala.None$.get (Option.scala:185)
my json file:
{partitions":
[{"topic": "topicA", "partition": 0}]
}
t; On Sep 26, 2013 12:48 PM, "Calvin Lei" wrote:
>>
>> Is restarting the broker the only way to put a broker back to the isr?
>>
>> Thanks
>> Cal
Is restarting the broker the only way to put a broker back to the isr?
Thanks
Cal
; We don't have any application-level security at this time so the answer
> > is
> > > whatever you can do at the network/system level.
> > >
> > > -Jay
> > >
> > >
> > > On Thu, Aug 29, 2013 at 10:09 AM, Benjamin Black wrote:
&g
Is there a way to stop a malicious user to connect directly to a kafka
broker and send any messages? Could we have the brokers to accept a message
to a list of know IPs?
Thanks for the confirmation Jun.
On Jul 23, 2013 12:54 AM, "Jun Rao" wrote:
> Yes, the kafka-request log logs every request (in TRACE). It's mostly for
> debugging purpose. Other than that, there is no harm to turn it off.
>
> Thanks,
>
> Jun
>
>
> O
erbose?
>
> -Jay
>
>
> On Mon, Jul 22, 2013 at 6:43 PM, Calvin Lei wrote:
>
>> The beta release comes with mostly trace level logging. Is this
>> recommended? I notice our cluster produce way too many logs. I set all the
>> level to info currently.
>>
The beta release comes with mostly trace level logging. Is this
recommended? I notice our cluster produce way too many logs. I set all the
level to info currently.
required? Would you mind pasting the full stack
> trace that you saw?
>
> Thanks,
>
> Joel
>
>
>
>
> On Wed, Jul 10, 2013 at 11:10 PM, Joel Koshy wrote:
> > Ok thanks - I'll go through this tomorrow.
> >
> > Joel
> >
> > On Wed,
:
> Calvin,
>
> For (1) can you clarify what you mean by "multiplied" consumer configs?
> For (2) the mirror-maker actually uses the high level consumer.
>
> Thanks,
>
> Joel
>
> On Sun, Jul 14, 2013 at 7:43 AM, Calvin Lei wrote:
> > Hi all,
> > I
Hi all,
I have two questions regarding setting up mirror maker for our cross
cluster replication (DC1 to DC2, for instance)
1. In what use case you would want to specify multiplied consumer configs?
2. It seems like the consumer inside the mirror is a SimpleConsumer. Is it
possible t
t;
> On Wed, Jul 10, 2013 at 6:57 AM, Calvin Lei wrote:
>
> > Thanks Jay. I thought of using the worldview architecture you suggested.
> > But since our consumers are also globally deployed, which means any new
> > messages arrive the worldview needs to be replicated
hen the other assigned replica will be
>> elected as the new leader. The producer would then look up metadata,
>> find the new leader and send requests to it. What do you see in the
>> logs?
>>
>> Joel
>>
>> On Tue, Jul 9, 2013 at 1:44 PM, Calvin Lei wrot
done anything to
> attempt to optimize partition placement by colo so you would not actually
> have redundancy between colos because we would often place all replicas in
> a single colo.
>
> -Jay
>
>
> On Tue, Jul 9, 2013 at 9:34 PM, Calvin Lei wrote:
>
> > Folks,
Folks,
Our application has multiple producers globally (region1, region2,
region3). If we group all the brokers together into one cluster, we notice
an obvious network latency if a broker replicates regionally with the
request.required.acks = -1.
Is there any best practice for combating the
oducer would then look up metadata,
> find the new leader and send requests to it. What do you see in the
> logs?
>
> Joel
>
> On Tue, Jul 9, 2013 at 1:44 PM, Calvin Lei wrote:
> > Thanks you have me enough pointers to dig deeper. And I tested the fault
> > tolerance by sh
although the admin command for adding more
> > partitions to a topic is currently being developed.
> >
> >
> > On Mon, Jul 8, 2013 at 11:02 PM, Calvin Lei wrote:
> > > Hi,
> > > I have two questions regarding the kafka broker setup.
> > >
Hi,
I have two questions regarding the kafka broker setup.
1. Assuming i have a 4-broker and 2-zookeeper (running in quorum mode)
setup, if topicA-partition0 has the leader set to broker4, can I change the
leader to other broker without killing the current leader?
2. What is the latency of sw
e to partition -1 for a given
> topic, meaning they never care about the partition count, and need no
> changes in circumstances like this.
>
> Philip
>
> On Thu, Jul 4, 2013 at 11:11 AM, Calvin Lei wrote:
>> Hi I have a few topics created with 1 partition. After running th
Hi, is there any documents for exceptions thrown by Kafka? I am trying to
capture errors coming from Kafka. For example, when a producer fails to
connects to zookeeper because it is down.
Regards,
Cal
Hi I have a few topics created with 1 partition. After running the cluster
for a few days, I want to increase the partition to 10 to improve the
consumer throughput. I learnt that it is not supported in 0.8.
What is the recommendation of improving consumer throughput after a topic
is created and t
29 matches
Mail list logo
