well, it's complicated to decide the num of partitons, it's up on your
application. I think 8-64 is a better practise for most application, such as
16/32 partitions with 2 or 3 replicas.
generally,
the less the num of partitions you have , the less tps you will get,
the more the num of partition
Hello,
+1
I have downloaded the release artifact from
http://home.apache.org/~lindong/kafka-2.1.0-rc1/
Executed a 3 brokers cluster. (java8 8u192b12)
Executed kafka-monitor for about 1 hour without problems.
Thanks,
--
Jonathan
On Fri, Nov 9, 2018 at 11:33 PM Dong Lin wrote:
> Hello Kafka us
Hello Sachit, I think that's the first question all of us ask our self when
facing that moment, "Ok, but, how many partitions do we need?"
I would say, according to my experience, that directly depends on your
business and the kind of problem you are trying to solve, how many
consumer and producer
My mistake in explaining the formula
N / x partitions per consumer - the ideal ratio should be 1.
On Sun, 11 Nov 2018 at 15:52, M. Manna wrote:
> If I understood your question correctly - you are looking for recommended
> guideline for #partitions / consumer.
> Kafka doesn’t hold any responsib
Sachit, there are many factors. Some to consider:
- # partitions is the max number of consumers the topic can have per group,
since each consumer will need at least one partition assigned to it.
- # partitions is usually also the max concurrency factor across a consumer
group, since consumers ofte
If I understood your question correctly - you are looking for recommended
guideline for #partitions / consumer.
Kafka doesn’t hold any responsibility for that - and I’m happy to be
corrected.
There are two partition assignment strategy - default and sticky. But you
should always aim for x/N partit
Hi,
Thanks for reply.
You have shared the command. I am looking for the formula or way to
calculate the number of partitions for my topic.
Regards,
Sachit
On Sun, 11 Nov 2018, 20:08 花儿向阳开 <2468946...@qq.com wrote:
> Hi,
> Maybe you can use the command like:
> kafka-topic.sh --create --top
Hi,
Maybe you can use the command like:
kafka-topic.sh --create --topic --partitions
--replication-factor --zookeeper
I hope it helps!
Regards!
Cathy
-- --
??: "Sachit Murarka";
: 2018??11??11??(??) 10:48
??: "users
Hello All,
I am new to kafka. Could anyone please tell how to decided number of
partitions for our topic?
Kind Regards,
Sachit Murarka