how to Update message content kafka

2015-05-15 Thread Snehalata Nagaje
Hi , I want to update message content posted in kafka at particular offset? is there any API available for it? Thanks, Snehalata

Re: Log end offset

2015-05-15 Thread Achanta Vamsi Subhash
Hi, The broker is healthy with no exceptions but the OffsetRequest in getOffsetsBefore method fails with ClosedChannelException. This usually happens after 2-3 hours of the app restart. I have looked at the code of ConsumerOffsetChecker and I use the same logic. I do connect to the leader to issue

Re: how to Update message content kafka

2015-05-15 Thread Guozhang Wang
Hi, You cannot update message content after it has already been sent to Kafka. One workaround would be using keyed messages, and send a new message with the same key whenever you want to "update the value correspondent to the key". And turn on log compaction so that obsoleted messages with the sa

Error while moving some partitions to OnlinePartition state

2015-05-15 Thread chenlax
first,i increase some partitions for a topic,and is ok, then i do kafka-reassign-partitions.sh ,and it speed long times to replicated data, and a partition status as "partition: 68 leader: 5 replicas: 8,0,5,1 isr: 5,1" so i do kafka-preferred-replica-election.sh & kafka-reassign-par

RE: OutOfMemory error on broker when rolling logs

2015-05-15 Thread Jeff Field
Found it. SELinux was running on the box but not showing any events in the audit log, however, the kernel log is another story entirely: INFO: task java:4693 blocked for more than 120 seconds. Not tainted 2.6.32-504.8.1.el6.x86_64 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disabl