Cluster of two nodes?

2016-01-19 Thread Tech Bolek
Hello, is there any value in running zookeeper and kafka in a cluster of two nodes? I.e. one instance of zookeeper and kafka on each node?

kafka “stops working” after a large message is enqueued

2016-02-02 Thread Tech Bolek
I'm running kafka_2.11-0.9.0.0 and a java-based producer/consumer. With messages ~70 KB everything works fine. However, after the producer enqueues a larger, 70 MB  message, kafka appears to stop delivering the messages to the consumer. I.e. not only is the large message not delivered but also s

unable to delete a topic

2016-02-03 Thread Tech Bolek
Try as I might I've found it impossible to delete a topic in kafka 0.9.0. I set delete.topic.enable in config.properties. I tried kafka-topics.sh with the delete command .I responds with: "topic marked for deletetion" but after a 30 minute wait the topic was till there. Then I stopped kafka and wi

Re: unable to delete a topic

2016-02-03 Thread Tech Bolek
x27;m wondering if I have a rogue service in my environment publishing to the topic in question. On Wed, Feb 3, 2016 at 12:30 PM Tech Bolek wrote: > Try as I might I've found it impossible to delete a topic in kafka 0.9.0. > I set delete.topic.enable in config.properties. > I tried k

Re: kafka “stops working” after a large message is enqueued

2016-02-03 Thread Tech Bolek
, "Tech Bolek" wrote: > I'm running kafka_2.11-0.9.0.0 and a java-based producer/consumer. With > messages ~70 KB everything works fine. However, after the producer enqueues > a larger, 70 MB  message, kafka appears to stop delivering the messages to > the consumer. I.e. no

Kafka consumer becomes deaf after an hour or so

2016-02-23 Thread Tech Bolek
I got a consumer using high-level API based on the example from here:  https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Group+ExampleWorks fine but after an hour or so of inactivity it stops responding to new messages. All I see the log is: INFO  [2016-02-23 17:06:10,070] org.apache.zo

kafka zookeeper: no route to host exception on connect. Strange address format?

2016-08-29 Thread Tech Bolek
Here is the scenario: - My kafka server and the zookeeper are running and working fine on the remote server as long as I launch the process on the same remote server. - I don't have any connectivity issues between my local machine and the server. I can ssh and access all other applicat

Re: kafka zookeeper: no route to host exception on connect. Strange address format?

2016-08-29 Thread Tech Bolek
Found the issue. The zookeeper listen port was not open to firewall. On Monday, August 29, 2016 8:55 AM, Tech Bolek wrote: Here is the scenario:     - My kafka server and the zookeeper are running and working fine on the remote server as long as I launch the process on the same