Re: Kafka

2020-10-01 Thread Akhilesh Pathodia
Hi, You can use kafka connect to export topic data to external systems. https://docs.confluent.io/3.1.1/connect/connect-jdbc/docs/sink_connector.html Thanks, Akhilesh Pathodia On Thu, Oct 1, 2020 at 7:29 AM Spectrum lib wrote: > Hi All, > I am using the Kafka version kafka_2.12-2.4.0.

Re: Kafka producer drops large messages

2017-04-11 Thread Akhilesh Pathodia
Hi Smirit, You will have to change some of broker configuration like message.max.bytes to a larger value. The default value is 1 MB guess. Please check below configs: Broker Configuration

Re: Topic deletion

2017-04-07 Thread Akhilesh Pathodia
pics tool, out > of interest? > > Thanks > Adrian > > -Original Message- > From: Akhilesh Pathodia [mailto:pathodia.akhil...@gmail.com] > Sent: 07 April 2017 09:37 > To: users@kafka.apache.org > Subject: Re: Topic deletion > > Hi Adrian, > > You will

Re: Topic deletion

2017-04-07 Thread Akhilesh Pathodia
Hi Adrian, You will have to delete the broker directory from zookeeper. This can be done from zookeeper cli. Connect to zookeeper cli using below command: zookeeper-client -server Then run below command : rmr /brokers/topics/ Thanks, AKhilesh On Thu, Apr 6, 2017 at 11:03 PM, Adrian McCague

Re: log.retention.hours

2017-02-06 Thread Akhilesh Pathodia
Rebooting is not required for this config. After changing the configuration wait for the time as set for log.retention.check.interval.ms and then messages older than 1 hour should get deleted. Thanks, Akhilesh On Mon, Feb 6, 2017 at 12:16 PM, Алексей Федосов wrote: > Hello, > I've just started

Re: how to reset kafka offset in zookeeper

2015-12-19 Thread Akhilesh Pathodia
On Saturday, December 19, 2015, Akhilesh Pathodia < > pathodia.akhil...@gmail.com> wrote: > > > What is the process for deleting the consumer group from zookeeper? > Should > > I export offset, delete and then import? > > > > Thanks, > > Akhilesh >

Re: how to reset kafka offset in zookeeper

2015-12-19 Thread Akhilesh Pathodia
upport > > > > Sematext <http://sematext.com/> | Contact > > > > <http://sematext.com/about/contact.html> > > > > > > > > On Fri, Dec 18, 2015 at 4:06 PM, Jens Rantil > > > wrote: > > > > > > > > > Hi,

how to reset kafka offset in zookeeper

2015-12-18 Thread Akhilesh Pathodia
Hi, I want to reset the kafka offset in zookeeper so that the consumer will start reading messages from first offset. I am using flume as a consumer to kafka. I have set the kafka property kafka.auto.offset.reset to "smallest", but it does not reset the offset in zookeeper and that's why flume wil