I just downloaded the Kafka binary and am trying this on my 32 bit JVM
(Java 7)? Trying to start Zookeeper or Kafka server keeps failing with
"Unrecognized VM option 'UseCompressedOops'":
./zookeeper-server-start.sh ../config/zookeeper.properties
Unrecognized VM option 'UseCompressedOops'
Error
Tousif,
Which version of kafka and zookeeper are you using and whats your
message size and jvm size that you allocated for kafka brokers.
There is only 1 zookeeper node , if its a production cluster I recommend
you to have quorum of zookeeper nodes. Both kafka & storm are heavy
users
That opt has been the default for a long while now iirc, maybe it can be
removed?
Sent from my iPhone
> On Jan 15, 2015, at 5:21 AM, Jaikiran Pai wrote:
>
> I just downloaded the Kafka binary and am trying this on my 32 bit JVM (Java
> 7)? Trying to start Zookeeper or Kafka server keeps faili
Yeah, good call on removing it.
-Jay
On Thu, Jan 15, 2015 at 6:39 AM, scott@heroku wrote:
> That opt has been the default for a long while now iirc, maybe it can be
> removed?
>
> Sent from my iPhone
>
> > On Jan 15, 2015, at 5:21 AM, Jaikiran Pai
> wrote:
> >
> > I just downloaded the Kafka b
> Is leadership rebalance a safe operation?
Yes - we use it routinely. For any partition, there should only be a
brief (order of seconds) period of rejected messages as leaders move.
When that happens the client should refresh metadata and discover the
new leader. Are you using the Java producer?
Thanks for reporting this. I will remove that option in RC2.
Jun
On Thu, Jan 15, 2015 at 5:21 AM, Jaikiran Pai
wrote:
> I just downloaded the Kafka binary and am trying this on my 32 bit JVM
> (Java 7)? Trying to start Zookeeper or Kafka server keeps failing with
> "Unrecognized VM option 'UseC
We're currently using JDK 8 update 5 with the following settings:
-server
-Xms4g
-Xmx4g
-XX:PermSize=96m
-XX:MaxPermSize=96m
-XX:+UseG1GC
-XX:MaxGCPauseMillis=20
-XX:InitiatingHeapOccupancyPercent=35
-verbose:gc
-XX:+PrintGCDetails
-XX:+PrintGCTimeStamps
-XX:+PrintGCDateStamps
-XX:+PrintTenuringDi
We are using the scala producer. From producer side, we have seen a lot of
error messages in producer during the time of incoming message drop:
Produce request with correlation id 31616255 failed due to
[trace_annotation,10]: kafka.common.NotLeaderForPartitionException
And a few (far less than th
Hi, all
We test our production kafka, and getting such error
[2015-01-15 19:03:45,057] ERROR Error in acceptor (kafka.network.Acceptor)
java.io.IOException: Too many open files
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.accep
You may find this article useful for troubleshooting and modifying TIME_WAIT:
http://www.linuxbrigade.com/reduce-time_wait-socket-connections/
The line you have for increasing file limit is fine, but you may also
need to increase the limit system wide:
insert "fs.file-max = 10" in /etc/sysctl.
Another kind of error messages is found in the kafka state change log after
leadership rebalance:
2015-01-15 00:01:39,895 WARN kafka.utils.Logging$class:83
[kafka-request-handler-0] [warn] Broker 8 received invalid
LeaderAndIsr request with correlation id 221 from controller 0 epoch
19 with an ol
Hi Sa Li,
Depending on your system that configuration entry needs to be modified. The
first parameter after the insert is the username what you use to run kafka.
It might be your own username or something else, in the following example
it is called kafkauser. On the top of that I also like to use
Liz,
Could you paste your code for calling the producer send call here? Just
realized in 0.7 there might be some calling pattern corner cases that cause
concurrent access of the serializer.
Also, I would recommend you to try out the new version of Kafka (0.8.x), in
which each producer will only h
Decrease partition is not yet supported in the latest 0.8.2 release, but we
are considering how it can be implemented in the later releases.
Could you elaborate on your requirements for partition decrease? For
example, are you OK to just delete the data on the removed partitions (e.g.
if we decrea
Thanks for the reply, I have change the configuration and running to see if
any errors come out.
SL
On Thu, Jan 15, 2015 at 3:34 PM, István wrote:
> Hi Sa Li,
>
> Depending on your system that configuration entry needs to be modified. The
> first parameter after the insert is the username what
Also can we remove "delete.topic.enable" config property and enable topic
deletion by default?
On Jan 15, 2015 10:07 PM, "Jun Rao" wrote:
> Thanks for reporting this. I will remove that option in RC2.
>
> Jun
>
> On Thu, Jan 15, 2015 at 5:21 AM, Jaikiran Pai
> wrote:
>
> > I just downloaded the
Not sure what could be going on..
What version of the client and the broker are you on?
Can you verify from the state change logs the time it took for
leadership to move to the preferred leader?
Were there long GCs in your brokers? Can you also look for zookeeper
session expirations in your bro
I think that is a change of behavior that organizations may get burned on.
Right now there is no delete data feature. If an operations teams upgrades
to 0.8.2 and someone decides to delete a topic then there will be data
loss. The organization may not have wanted that to happen. I would argue to
no
Yes, I agree it's probably better not to enable "delete.topic.enable" by
default.
Thanks,
Jun
On Thu, Jan 15, 2015 at 6:29 PM, Joe Stein wrote:
> I think that is a change of behavior that organizations may get burned on.
> Right now there is no delete data feature. If an operations teams upgra
Would make sense to enable it after we have authorization feature and
admins can control who can delete what.
On Thu, Jan 15, 2015 at 6:32 PM, Jun Rao wrote:
> Yes, I agree it's probably better not to enable "delete.topic.enable" by
> default.
>
> Thanks,
>
> Jun
>
> On Thu, Jan 15, 2015 at 6:29
i'm using kafka 2.9.2-0.8.1.1 and zookeeper 3.4.6.
i noticed that only one broker is going down.
My message size is less thn 3 kb and KAFKA_HEAP_OPTS="-Xmx512M"
and KAFKA_JVM_PERFORMANCE_OPTS="-server -XX:+UseCompressedOops
-XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled
-
21 matches
Mail list logo
