Hello All,
I am new to kafka. Could anyone please tell how to decided number of
partitions for our topic?
Kind Regards,
Sachit Murarka
Hi,
Maybe you can use the command like:
kafka-topic.sh --create --topic --partitions
--replication-factor --zookeeper
I hope it helps!
Regards!
Cathy
-- --
??: "Sachit Murarka";
: 2018??11??11??(??) 10:48
??: "users
Hi,
Thanks for reply.
You have shared the command. I am looking for the formula or way to
calculate the number of partitions for my topic.
Regards,
Sachit
On Sun, 11 Nov 2018, 20:08 花儿向阳开 <2468946...@qq.com wrote:
> Hi,
> Maybe you can use the command like:
> kafka-topic.sh --create --top
If I understood your question correctly - you are looking for recommended
guideline for #partitions / consumer.
Kafka doesn’t hold any responsibility for that - and I’m happy to be
corrected.
There are two partition assignment strategy - default and sticky. But you
should always aim for x/N partit
Sachit, there are many factors. Some to consider:
- # partitions is the max number of consumers the topic can have per group,
since each consumer will need at least one partition assigned to it.
- # partitions is usually also the max concurrency factor across a consumer
group, since consumers ofte
My mistake in explaining the formula
N / x partitions per consumer - the ideal ratio should be 1.
On Sun, 11 Nov 2018 at 15:52, M. Manna wrote:
> If I understood your question correctly - you are looking for recommended
> guideline for #partitions / consumer.
> Kafka doesn’t hold any responsib
Hello Sachit, I think that's the first question all of us ask our self when
facing that moment, "Ok, but, how many partitions do we need?"
I would say, according to my experience, that directly depends on your
business and the kind of problem you are trying to solve, how many
consumer and producer
Hello,
+1
I have downloaded the release artifact from
http://home.apache.org/~lindong/kafka-2.1.0-rc1/
Executed a 3 brokers cluster. (java8 8u192b12)
Executed kafka-monitor for about 1 hour without problems.
Thanks,
--
Jonathan
On Fri, Nov 9, 2018 at 11:33 PM Dong Lin wrote:
> Hello Kafka us
well, it's complicated to decide the num of partitons, it's up on your
application. I think 8-64 is a better practise for most application, such as
16/32 partitions with 2 or 3 replicas.
generally,
the less the num of partitions you have , the less tps you will get,
the more the num of partition
