RE: EXTERNAL: Re: Backup Apache KAFKA

Hi, We love Kafka but I would pretty strongly disagree with that statement. Backups are not really about recovering from local failures and lots of systems that are resilient and redundant have backups as well (e.g. CockroachDB). Uses of backups in a system like Kafka would include: 1) Recover

Re: Kafka Streams: Unexpected data loss

Hi John, Thank you for your swift response and the advice. Your answers confirm our expectations. As you suggested we'll keep monitoring the application to see whether a similar issue occurs. For now every analysis points towards the behaviour being an effect of circumstance rather than a problem

RE: Global State Restore Listener

Thank you for your message ,Matthias J. I understand the concept of server and cluster, but we need to backup the entire kafka service (topic, configurations in cloudera) I have read 3 options 1.Kafka Backup 2.Snapshots of the file system 3.Mirror Maker2 but there is not much information. _

RE: Backup Apache KAFKA

Thank you for your message ,Matthias J. I understand the concept of server and cluster, but we need to backup the entire kafka service (topic, configurations in cloudera) I have read 3 options 1.Kafka Backup 2.Snapshots of the file system 3.Mirror Maker2 but there is not much information. _

Re: Global State Restore Listener

Not sure why you need to put a copy of the data into a cache to begin with? The global store can actually be used like a cache directly. But yes, you can set a restore listener via `KafkaStreams#setGlobalStateRestoreListener` -Matthias On 11/17/20 7:40 PM, Navneeth Krishnan wrote: > Hi All, >

Re: Backup Apache KAFKA

Kafka is a highly available and fault-tolerant system, that replicates data internally. Thus, doing backups seems not to be necessary. Backups are usually used for single server system that may loose data if for example a disk goes bad, because those systems don't replicate data themselves, and th

Backup Apache KAFKA

Good Morning I need to subscribe to the kafka community to make a query how to backup topics and in general the kafka service thanks Name: Wilson Barbosa Correo warbar...@hotmail.com Country : Colombia Enviado desde Correo

Backup Apache KAFKA

Good Morning I need to subscribe to the kafka community to make a query how to backup topics and in general the kafka service thanks Name: Wilson Barbosa Correo warbar...@hotmail.com Country : Colombia

Re: Unable to list Kafka topics

Hi, You can refer to the documentation for logging levels. https://zookeeper.apache.org/doc/r3.4.11/zookeeperAdmin.html#Debug+Log+Cleanup+%28log4j%29 By clearing current logs will help you to read and understand new logs. Old logs wont get mixed up with the new one and you can read and debug ev

Re: Unable to list Kafka topics

Hi Sunil, Thanks for your reply. You mean to say to empty kafka.log file? (I don't see zookeeper.log file in server), but not sure how clearing the log file itself will help. I will search for debug switch for zookeeper start command but I was talking about in which zookeeper config file I can

Re: Unable to list Kafka topics

Hi I am talking about the Error : 18:16:08,027] ERROR Invalid configuration, only one server specified > > (ignoring) (org.apache.zookeeper.server.quorum.QuorumPeerConfig) This seems to be the problem of whole cluster. Clear all logs means, clear existing server logs. Not data. You can see hel

Re: Unable to list Kafka topics

Hi Sunil, Thanks for reply. Q. Are you pointing to below line from point 6 to be similar with url you have given (in Troubleshooting, under section: Server not coming up because of file corruption)? ov 19 18:16:08 zookeeper-server-start.sh: java.io.EOFException Q. `Clear all logs` - you mean