actually i take that back. it reads from where the last offset left off. On Thu, Feb 19, 2015 at 4:20 PM, Karts <kartad...@gmail.com> wrote:
> yes i did. > > On Thu, Feb 19, 2015 at 2:42 PM, Jun Rao <j...@confluent.io> wrote: > >> Did you consume the messages from the beginning of the log? >> >> Thanks, >> >> Jun >> >> On Thu, Feb 19, 2015 at 12:18 PM, Karts <kartad...@gmail.com> wrote: >> >> > but they have always been up. I mean when i was testing, all the >> zookeepers >> > were up. and all the kafka nodes were up. its just that I changed the >> > number of zookeeper nodes in my first test iteration. second and third >> were >> > still the same. not sure why the topics were losing some messages. >> > >> > On Thu, Feb 19, 2015 at 11:39 AM, Jun Rao <j...@confluent.io> wrote: >> > >> > > Zookeeper requires a majority of the nodes to be up for the service >> to be >> > > available. Kafka relies on Zookeeper to be always available. >> > > >> > > Thanks, >> > > >> > > Jun >> > > >> > > On Thu, Feb 19, 2015 at 11:15 AM, Karts <kartad...@gmail.com> wrote: >> > > >> > > > I have noticed some strange patterns when testing with the 0.8.1 >> build >> > > and >> > > > the 0.8.2 builds, and are listed below. >> > > > 1. So I setup a brand new cluster [3 kafka nodes with 3 zookeepers], >> > > > created 2 topics via the API calls, everything went fine and was >> > > > successfully able to view my messages in my consumers. There were no >> > > > messages lost. All is happy. Now, I change my setup to just have 1 >> > > > zookeeper. and do my test again, i lose some messages. I have >> checked >> > > that >> > > > all my configs are pointing to just 1 zookeeper and there was no >> > mention >> > > of >> > > > the other 2 offline zookeepers. any idea why ? >> > > > 2. I revert back my settings to the original config, all 3 nodes are >> > > > online, no errors, send messages to same old topic, and i am still >> > > loosing >> > > > some messages. I deleted all the old topic files [to follow the >> > 'cleanup' >> > > > process], create a new topic, and i am successfully able to receive >> all >> > > > messages. no loss whatsoever. >> > > > 3. Now in this state, i upgrade to 0.8.2, and try sending messages >> to >> > the >> > > > topic that was made after the above cleanup, and i am losing >> messages >> > > > again. >> > > > >> > > > Am i making sense? I mean this is a very strange behavior, and if >> > anyone >> > > > can comment on this [please correct me if i have done something >> 'very' >> > > > wrong].. >> > > > >> > > > Thanks.. >> > > > >> > > >> > >> > >
