Re: error reading ‘kafka-logs’: Is a directory

David, There should be log files in the "/tmp/kafka-logs" folder. Guozhang On Tue, Dec 29, 2015 at 2:49 AM, David Montgomery wrote: > Hi, > > Why do I get this error in the logs for v8.x? > > ==> kafka-logs <== > tail: error reading ‘kafka-logs’: Is a directory > tail: kafka-logs: cannot follo

Re: Consumer - Failed to find leader

Prabhu, When using SASL/kerberos always make sure you give FQDN of the hostname . In your command you are using --zookeeper localhost:2181 and make sure you change that hostname. "avax.security.auth.login.LoginException: No key to store Will continue > connection

RE: Server Logs

Dear Ewen, Where do i run the separate application? Is it IIS server side or Hadoop Cluster side (kafka)? Thanks & Regards Sekar > Date: Mon, 28 Dec 2015 13:06:22 -0800 > Subject: Re: Server Logs > From: e...@confluent.io > To: users@kafka.apache.org > > Chandra, > > If you're just serving f

Re: Pulling data from remote server

We don't have a built-in functionality for this, but I know few places that implemented the following architecture. 1. Install a small (1-3 nodes) Kafka cluster on the remote environments (AWS, Rackspace, etc) 2. Use KafkaConnect or similar to pull logs into the local Kafka 3. Install Kafka + Mirr

MD5 checksum on release

The current md5 checksums of the release downloads all seem to be returning in an atypical format. Anyone know what's going on there? Example: https://dist.apache.org/repos/dist/release/kafka/0.9.0.0/kafka_2.11-0.9.0.0.tgz.md5 I see: kafka_2.11-0.9.0.0.tgz: 08 4F B8 0C DC

Pulling data from remote server

Hi there, I have several different production servers running in different cloud providers, like AWS, Rackspace, ..etc. And I have one central big data environment inside company's network. I need to build a NRT(near real time) monitoring system which I need to stream and archive all the logs from

Re: How to reset a consumer-group's offset in kafka 0.9?

I was refering to Dana Powers's answer in the link I posted (to use a client API). You can find an example here: http://kafka.apache.org/090/javadoc/org/apache/kafka/clients/consumer/KafkaConsumer.html Marko Bonaći Monitoring | Alerting | Anomaly Detection | Centralized Log Management Solr & Elast

Re: How to reset a consumer-group's offset in kafka 0.9?

Hi, If you want to reset the consumer offset (I am not sure about the group's offset) you can use this property in 0.9.0 props.put(ConsumerConfig.AUTO_OFFSET_RESET_CONFIG, "earliest"); 2015-12-29 16:35 GMT+01:00 Han JU : > Hi Stevo, > > But by deleting and recreating the topic, do I remove also

Re: How to reset a consumer-group's offset in kafka 0.9?

Then I guess @Before test, explicitly commit offset of 0. There doesn't seem to be a tool for committing offset, only for checking/fetching current offset (see http://kafka.apache.org/documentation.html#operations ) On Tue, Dec 29, 2015 at 4:35 PM, Han JU wrote: > Hi Stevo, > > But by deleting

Re: How to reset a consumer-group's offset in kafka 0.9?

Hi Stevo, But by deleting and recreating the topic, do I remove also the messages ingested? My use case is that I ingest prepared messages once and run consumer tests multiple times, between each test run I reset the consumer group's offset so that each run starts from the beginning and consumers

Re: How to reset a consumer-group's offset in kafka 0.9?

Have you considered deleting and recreating topic used in test? Once topic is clean, read/poll once - any committed offset should be outside of the range, and consumer should reset offset. On Tue, Dec 29, 2015 at 4:11 PM, Han JU wrote: > Hello, > > For local test purpose I need to frequently res

Re: How to reset a consumer-group's offset in kafka 0.9?

We recently had the same question: http://search-hadoop.com/m/uyzND1kM7q1gElhy1 Marko Bonaći Monitoring | Alerting | Anomaly Detection | Centralized Log Management Solr & Elasticsearch Support Sematext | Contact On Tue, Dec 29, 2015

How to reset a consumer-group's offset in kafka 0.9?

Hello, For local test purpose I need to frequently reset offset for a consumer group. In 0.8 I just delete the consumer group's zk node under `/consumers`. But with the redesign of the 0.9, how could I achieve the same thing? Thanks! -- *JU Han* Software Engineer @ Teads.tv +33 061960

error reading ‘kafka-logs’: Is a directory

Hi, Why do I get this error in the logs for v8.x? ==> kafka-logs <== tail: error reading ‘kafka-logs’: Is a directory tail: kafka-logs: cannot follow end of this type of file; giving up on this name Here is what I have in the config file log.dirs=/tmp/kafka-logs Is this a major issue? Thanks