Re: integrate Camus and Hive?

I'm not sure what you are looking for but in case that can help you, We are persisting the data from our kafka cluster in camus and map it in hive with Camus2Hive, you can look at it here if you want to! https://github.com/mate1/camus2hive François Langelier Étudiant en génie Logiciel -

Re: Partition key not working properly

Hi haoming, As far as I know, svante is right. Maybe you modified your default partitioner? or are you sure the same key go to different partitions? maybe its just 2 keys that are going to the same partition? Because it's possible that you have something like that - key "1" -> partition 3 - key

Re: Disactivating Yammer Metrics Monitoring

Good to know! Thanks Jason, I'll look at it ASAP! :) François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Membre Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org> 2014 Jeux de Génie

Re: subscribe kafka mail list

http://kafka.apache.org/contact.html François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org> 2014 Jeux de Génie <http://www.jdg

Re: Disactivating Yammer Metrics Monitoring

isable the kafka monitoring to our Graphite server. We are using the code in the tag 0.8.1.1 on github, so if the kafka-ganglia isn't in the tag, we aren't using it :) François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capita

Disactivating Yammer Metrics Monitoring

of our kafka producers? François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org> 2014 Jeux de Génie <http://www.jdgets.com/> 2011 à 2

Re: Subscription

You should follow those instructions http://kafka.apache.org/contact.html François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org>

Re: Kafka Mirroring Issue

partition) And if you don't, it will change the partition every " topic.metadata.refresh.interval.ms" François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Com

How retention is working

ntion check 6 day of retention will be deleted? Thanks! François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org> 2014 Jeux de Génie

Re: Kafka Mirroring Issue

What is your partitioning function? François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org> 2014 Jeux de Génie <http://www.jdg

Re: Kafka build for Scala 2.11

Balaji, look in the tags François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org> 2014 Jeux de Génie <http://www.jdgets.com/&g

Re: kafka 0.8.1.1 log.retention.minutes NOT being honored

html#configuration if not, there is a example using "log.retention.hours" http://kafka.apache.org/documentation.html#config and also in the example of the server.properties on github. François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.et

Re: kafka 0.8.1.1 log.retention.minutes NOT being honored

up? François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org> 2014 Jeux de Génie <http://www.jdgets.com/> 2011 à 2014 Magistr

Re: Subscribe me

Neha, I think you just reply to the mailing, so i guess Nishit didn't received your instructions. Problem should be fixed now ;) François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.

Re: kafka 0.8.1.1 log.retention.minutes NOT being honored

UP! Can someone add the log.retention.hours in the documentation? And is the retention.hours or retention.minutes available for the by-topic configuration? François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra

Re: Data is been written in only 1 partition

Thanks guys! I found my problem :) I'm using the DefaultPartitioner and I was using the topic name as key... I though it was doing a round-robin like in kafka 0.7 and not a hash of the key... Thank you for your help, it's really appreciate!:) François Langelier Étudiant en géni

Data is been written in only 1 partition

partition?? Thanks! François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org> 2014 Jeux de Génie <http://www.jdgets.com/> 2011 à 20

Re: Join the list

Guozhang, I'm not sure he was your message since you just reply to the mailing list... François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http

Re: Consumers offset tracking

Thank you for your answer :) Is someone planning to update the doc? François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org> 2014 J

Consumers offset tracking

that was for kafka 0.7 ? If so, where is the tracking of the brokers-partition? Thanks! François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames

Re: Too Many Open Files Broker Error

ping/connect to the value of the key "host" from your other brokers? François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org>

Re: How recover leader when broker restart

n broker 1... François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org> 2014 Jeux de Génie <http://www.jdgets.com/> 2011 à 2014 Arg

Re: Could you pls add my email to the mailing list

contact.html François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org> 2014 Jeux de Génie <http://www.jdgets.com/> 2011 à 2014 A

Re: spam of [kafka-processor-9092-0] INFO kafka.network.Processor - Closing socket connection to /172.23.44.4.

thing that the broker should take his hostname from the /etc/hosts file, no? Maybe this is cause by my OS (I'm not an expert of Debian) but I don't think so... and I don't think that this is the behaviour that you guys want to have too... Can someone reproduce the bug? Is that behav

Re: spam of [kafka-processor-9092-0] INFO kafka.network.Processor - Closing socket connection to /172.23.44.4.

is not consume - I saw nothing on the brokers logs (for every broker) - the .log file of the topic in my log.dirs is empty on every brokers - I don't even have a logs file in my ./logs of my console producer and consumer... Anyone have any idea??? Thank! François Langelier Étu

spam of [kafka-processor-9092-0] INFO kafka.network.Processor - Closing socket connection to /172.23.44.4.

ka-processor-9092-0] INFO > kafka.network.Processor - Closing socket connection to /172.23.44.4. > [2014-06-10 18:53:01,165] 1155783 [kafka-processor-9092-1] INFO > kafka.network.Processor - Closing socket connection to /172.23.44.4. > [2014-06-10 18:53:01,325] 1155943 [kafka-processor-9092-0] INFO &g

Re: How to upgrade Kafka 0.8.1 to 0.8.1.1

No, it's the same procedure for 0.8.0 to 0.8.1 and 0.8.1 to 0.8.1.1 Bring down broker one by one and upgrade the code then restart it https://kafka.apache.org/documentation.html#upgrade François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.e

Re: How to delete Topic in kafka 0.8.1 ?

https://issues.apache.org/jira/browse/KAFKA-1397 François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org> 2014 Jeux de Génie <http://www.jdgets.c

Re: How to delete Topic in kafka 0.8.1 ?

The delete topic isn't working ATM I think it will be available in the next release https://issues.apache.org/jira/browse/KAFKA-1397 François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.

Re: How to delete Topic ?

The delete topic isn't working ATM I think it will be available in the next release https://issues.apache.org/jira/browse/KAFKA-1397 François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure <http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.

Re: Make kafka storage engine pluggable and provide a HDFS plugin?

Take a look at Camus <https://github.com/linkedin/camus/> François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure<http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org>

Re: Service kafka 8

ernité du Piranhas <http://fraternitedupiranha.com/> 2012-2014 Comité Organisateur Olympiades ÉTS 2012 Compétition Québécoise d'Ingénierie 2012 - Compétition Senior On Thu, Feb 13, 2014 at 10:17 AM, François Langelier wrote: > Hi, > > I looked over Internet to find a service for kafka 8, but I f

Re: Puppet module for deploying Kafka released

Andrew, It's will be great to add a link to your prebuilt deb patch on your repo! ;) What should I do if I am to build the debian package my self? François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure<http://www.etsmtl.ca/> Capitaine Club

Service kafka 8

mething like that! Thank for your help! François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure<http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.org> 2014 Jeux de Génies <http://www.jd

Re: 0.7 -> 0.8 Protocol Upgrade in production environments

re incompatible between 0.7 and 0.8... c) yes if you use the migration tool François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure<http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http://csgames.

Re: Killing broker leader

retries 10 and --request-required-acks -1 but have you tried both together? Thank for your help guys! François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure<http://www.etsmtl.ca/> Capitaine Club Capra <http://capra.etsmtl.ca/> VP-Communication - CS Games <http:

Re: Killing broker leader

Nope, it's the "3 tries" messages... maybe I did something wrong... i put message.send.max.retries=10 retry.backoff.ms=1000 in my server.properties of each broker I'm checking it right now! François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure&