We are using version 2.3.1. Two more pieces are information wrt Luke's answer. Assume that retention of the data is Y and you turn on the node 3 after time Y so the data on node 3 is old and would be deleted regardless, so there is no point in doing another partition reassignment because the data is completely stale.
I would think the data should be deleted, but we are seeing that it is not. On Tue, Sep 15, 2020 at 8:04 PM <manoj.agraw...@cognizant.com> wrote: > It should delete the old data log based on retention of topic. > What kafka version you are using ? > > On 9/15/20, 7:48 PM, "Dima Brodsky" <dbrod...@salesforce.com.INVALID> > wrote: > > [External] > > > Hi, > > I have a question, when you start kafka on a node, if there is a random > replica log should it delete it on startup? Here is an example: > Assume > you have a 4 node cluster. Topic X has 3 replicas and it is > replicated on > nodes 1, 2, and 3. Now you shutdown node 3 and you place the replica > that > was on node 3 on node 4. Then once everything is in-sync you start up > node > 3 again. What should happen to the replica X on node 3. Should kafka > delete it or will it stick around forever. > > Given the above scenario we are seeing the replica stick around > forever. > Is this working as designed, or is this a bug? > > Thanks! > ttyl > Dima > > -- > dbrod...@salesforce.com > > "The price of reliability is the pursuit of the utmost simplicity. > It is the price which the very rich find most hard to pay." (Sir Antony > Hoare, 1980) > > > This e-mail and any files transmitted with it are for the sole use of the > intended recipient(s) and may contain confidential and privileged > information. If you are not the intended recipient(s), please reply to the > sender and destroy all copies of the original message. Any unauthorized > review, use, disclosure, dissemination, forwarding, printing or copying of > this email, and/or any action taken in reliance on the contents of this > e-mail is strictly prohibited and may be unlawful. Where permitted by > applicable law, this e-mail and other e-mail communications sent to and > from Cognizant e-mail addresses may be monitored. > This e-mail and any files transmitted with it are for the sole use of the > intended recipient(s) and may contain confidential and privileged > information. If you are not the intended recipient(s), please reply to the > sender and destroy all copies of the original message. Any unauthorized > review, use, disclosure, dissemination, forwarding, printing or copying of > this email, and/or any action taken in reliance on the contents of this > e-mail is strictly prohibited and may be unlawful. Where permitted by > applicable law, this e-mail and other e-mail communications sent to and > from Cognizant e-mail addresses may be monitored. > -- dbrod...@salesforce.com "The price of reliability is the pursuit of the utmost simplicity. It is the price which the very rich find most hard to pay." (Sir Antony Hoare, 1980)
