Partition and Replica assignment for a Topic

I¹d like to be able to see a little more detail for a topic. What is the best way to get this information? Topic Partition Replica Broker topic1 1 1 3 topic1 1 2 4 topic1 1 3 1 topic1 2 1 1 topic1 2

Re: Partition and Replica assignment for a Topic

cs.sh --describe --zookeeper localhost:2181 >? > >On Tue, Oct 21, 2014 at 4:29 PM, Jonathan Creasy > wrote: >> I¹d like to be able to see a little more detail for a topic. >> >> What is the best way to get this information? >> >> Topic Partition Replic

Re: Quick question regarding kafka broker security

system throughput? > > Thanks > Subhash A. > -- ** *Jonathan Creasy* | Sr. Ops Engineer e: j...@box.com | t: 314.580.8909

Re: Linux Packages

We have EL6 packages. On Fri, Mar 29, 2013 at 2:01 PM, mrevilgnome wrote: > Has anyone gone through the effort of packaging Kafka for Ubuntu, Debian, > or CentOS? I'm partially through the process for Ubuntu, and I figured I > should ask. Thanks. > > --Matt > -- **

Re: How to create the initial zookeeper chroot path for zk.connect?

I made the patch to create the chroot and it doesn't handle multiple zk addresses. We fixed it but I guess that patch didn't get submitted. I will make a ticket here to get that done. On Apr 18, 2013 10:47 PM, "Ryan Chan" wrote: > Yes, using the latest Kafka 0.7.2, just tried to reproduce again

Re: Using Stunnel to encrypt/authenticate Kafka producers and consumers...

our ability to use > existing > >> kafka producer/consumers that people have written. > >> > >> My concern is that the Kafka clients (producers or consumers?) would > >> connect once through the ELB, then get the list of servers via the API, > and > >> finally try to connect directly to one of those Kafka servers rather > than > >> just leveraging the existing connection through the ELB. > >> > >> Thoughts? > >> > >> --Matt > > -- ** *Jonathan Creasy* | Sr. Ops Engineer e: j...@box.com | t: 314.580.8909

Re: large amount of disk space freed on restart

It isn't uncommon if a process has an open file handle on a file that is deleted, the space is not freed until the handle is closed. So restarting the process that has a handle on the file would cause the space to be freed also. You can troubleshoot that with lsof. Normally, I see 2-4 log segments

Re: large amount of disk space freed on restart

phantom deleted files? > > Jason > > > On Wed, May 22, 2013 at 9:50 PM, Jonathan Creasy wrote: > >> It isn't uncommon if a process has an open file handle on a file that is >> deleted, the space is not freed until the handle is closed. So restarting >> the p

Re: Kafka Messages

y you think this, or how to distinguish between a 'log' > > message and some other kind. > > > > Messages = data, annotated with metadata. The latter is typically a > > protocol-specific envelope. Kafka and Rabbit certainly have different > > envelopes, eg for mapping data to subscribers/queries. > > > > alexis > > -- ** *Jonathan Creasy* | Sr. Ops Engineer e: j...@box.com | t: 314.580.8909

Re: Kafka Messages

tly to > Kafka you instead have a separate process running that will tail log files > and ship them over to Kafka. Is that correct? > > On Jun 7, 2013, at 5:33 PM, Jonathan Creasy wrote: > > > I recommend Kafka or Flume-NG for this. > > > > Our Analytics team is usin

Re: Kafka Messages

g files or do they also > contain some event data.. i.e. Product A was purchased or User A just > signed in, etc? > > On Jun 7, 2013, at 6:53 PM, Jonathan Creasy wrote: > > Correct, we essentially use the logs as an additional buffer in case of > outage in the pipeline. Typicall

RE: Kafka partitions unbalanced

I have a similar issue, let me know how it goes. :) -Original Message- From: Andrew Otto [mailto:ao...@wikimedia.org] Sent: Wednesday, May 27, 2015 3:12 PM To: users@kafka.apache.org Subject: Kafka partitions unbalanced Hi all, I’ve recently noticed that our broker log.dirs are using up