Re: Need some clarification of Kafka and MQTT

No, you needs something that can speak mqtt and sent that data to kafka (and possibly the other way around). There are many such alternatives but kafka knows nothing about mqtt Den tis 8 okt. 2019 kl 18:01 skrev Sarvesh Gupta : > Hi, > > We are building some IoT driven solution for industries, I

Re: server-side message filter

The other problem would be that kafka has no idea of the serdes you use in your messages ie it only sees the key and value as bytes so it would be difficult to implement generic filtering in the broker. for your second problem it seems that creating separate topics for respective destinations solv

Re: Backup and Restore of kafka broker with zookeeper

You have to get a consistent zookeeper cluster before adding your Kafka nodes - they will "mirror" the state in zookeeper. So restore all the files before starting anything. Then start zookeepers and wait for for it to stabilize. Finally start Kafka nodes. - ( with the data in place of course.)

Re: Regarding : Store stream for infinite time

Yes, it will store the last value for each key 2018-01-23 18:30 GMT+01:00 Aman Rastogi : > Hi All, > > We have a use case to store stream for infinite time (given we have enough > storage). > > We are planning to solve this by Log Compaction. If each message key is > unique and Log compaction is

Re: Using JMXMP to access Kafka metrics

I've used jolokia which gets JMX metrics without RMI (actually json over http) https://jolokia.org/ Integrates nicely with telegraf (and influxdb) 2017-07-19 20:47 GMT+02:00 Vijay Prakash < vijay.prak...@microsoft.com.invalid>: > Hey, > > Is there a way to use JMXMP instead of RMI to access Kafk

Re: zookeeper usage in kafka offset commit / fetch requests

Just to close this, I found out that the broker handles the request different depending on whether you specify api version 0 or 1. If using V1 the broker commits the offsets to internal topic. /svante

Re: C++ Client Library -- libkafka-asio

tarted to add csi-kafka, but couldn't find a license? > > > On Sun, Mar 22, 2015 at 8:29 AM, svante karlsson wrote: > > > Cool, Looks nice. I was looking for something similar a year ago. We also > > ended up rolling our own. https://github.com/bitbouncer/csi-kafka > >

zookeeper usage in kafka offset commit / fetch requests

I'm using kafka 0.8.2.0 I'm working on a C++ client library and I'm adding consumer offset management to the client. (https://github.com/bitbouncer/csi-kafka) I know that the creation of zookeeper "paths" is not handled by kafkabroker so I've manually created /consumers/consumer_offset_sample/of

Re: C++ Client Library -- libkafka-asio

Cool, Looks nice. I was looking for something similar a year ago. We also ended up rolling our own. https://github.com/bitbouncer/csi-kafka Have you got any performance figures? /svante 2015-03-22 14:29 GMT+01:00 Daniel Joos : > Hello there, > > I'm currently working on a C++ client library, i

Re: decoding of responses with error_codes

5-12 17:25 GMT+02:00 Guozhang Wang : > Hi Svante, > > This is indeed an issue with the protocol definition of > ConsumerMetadataResponse. Do you think this issue is fixed in the following > JIRA? > > https://issues.apache.org/jira/browse/KAFKA-1437 > > Guozhang > &g

decoding of responses with error_codes

I'm writing (yet another) C++ binding for kafka and I'm curious on the encoding in relation to error-code != 0 There seems to be a discrepancy as to how to decode messages in presence of errors. ConsumerMetadataResponse error_code !=0 -> no more data should be decoded. in all others we continue