Look like this is bug ..
You can clean the data log on this node 3 and start the kafka process on node
3 . This should resolve the issue
On 9/15/20, 8:09 PM, "Dima Brodsky" <dbrod...@salesforce.com.INVALID> wrote:
[External]
We are using version 2.3.1.
Two more pieces are information wrt Luke's answer. Assume that retention
of the data is Y and you turn on the node 3 after time Y so the data on
node 3 is old and would be deleted regardless, so there is no point in
doing another partition reassignment because the data is completely stale.
I would think the data should be deleted, but we are seeing that it is not.
On Tue, Sep 15, 2020 at 8:04 PM <manoj.agraw...@cognizant.com> wrote:
> It should delete the old data log based on retention of topic.
> What kafka version you are using ?
>
> On 9/15/20, 7:48 PM, "Dima Brodsky" <dbrod...@salesforce.com.INVALID>
> wrote:
>
> [External]
>
>
> Hi,
>
> I have a question, when you start kafka on a node, if there is a
random
> replica log should it delete it on startup? Here is an example:
> Assume
> you have a 4 node cluster. Topic X has 3 replicas and it is
> replicated on
> nodes 1, 2, and 3. Now you shutdown node 3 and you place the replica
> that
> was on node 3 on node 4. Then once everything is in-sync you start up
> node
> 3 again. What should happen to the replica X on node 3. Should kafka
> delete it or will it stick around forever.
>
> Given the above scenario we are seeing the replica stick around
> forever.
> Is this working as designed, or is this a bug?
>
> Thanks!
> ttyl
> Dima
>
> --
> dbrod...@salesforce.com
>
> "The price of reliability is the pursuit of the utmost simplicity.
> It is the price which the very rich find most hard to pay." (Sir
Antony
> Hoare, 1980)
>
>
> This e-mail and any files transmitted with it are for the sole use of the
> intended recipient(s) and may contain confidential and privileged
> information. If you are not the intended recipient(s), please reply to the
> sender and destroy all copies of the original message. Any unauthorized
> review, use, disclosure, dissemination, forwarding, printing or copying of
> this email, and/or any action taken in reliance on the contents of this
> e-mail is strictly prohibited and may be unlawful. Where permitted by
> applicable law, this e-mail and other e-mail communications sent to and
> from Cognizant e-mail addresses may be monitored.
> This e-mail and any files transmitted with it are for the sole use of the
> intended recipient(s) and may contain confidential and privileged
> information. If you are not the intended recipient(s), please reply to the
> sender and destroy all copies of the original message. Any unauthorized
> review, use, disclosure, dissemination, forwarding, printing or copying of
> this email, and/or any action taken in reliance on the contents of this
> e-mail is strictly prohibited and may be unlawful. Where permitted by
> applicable law, this e-mail and other e-mail communications sent to and
> from Cognizant e-mail addresses may be monitored.
>
--
dbrod...@salesforce.com
"The price of reliability is the pursuit of the utmost simplicity.
It is the price which the very rich find most hard to pay." (Sir Antony
Hoare, 1980)
This e-mail and any files transmitted with it are for the sole use of the
intended recipient(s) and may contain confidential and privileged information.
If you are not the intended recipient(s), please reply to the sender and
destroy all copies of the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email,
and/or any action taken in reliance on the contents of this e-mail is strictly
prohibited and may be unlawful. Where permitted by applicable law, this e-mail
and other e-mail communications sent to and from Cognizant e-mail addresses may
be monitored.
This e-mail and any files transmitted with it are for the sole use of the
intended recipient(s) and may contain confidential and privileged information.
If you are not the intended recipient(s), please reply to the sender and
destroy all copies of the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email,
and/or any action taken in reliance on the contents of this e-mail is strictly
prohibited and may be unlawful. Where permitted by applicable law, this e-mail
and other e-mail communications sent to and from Cognizant e-mail addresses may
be monitored.
