Re: Each empty partition has 21MB by default

2019-02-19 Thread Soheil Pourbafrani
Why it happened suddenly? In about two years I didn't observe such behavior from Kafka! On Tue, Feb 19, 2019 at 4:20 PM Christopher Shannon < christopher.l.shan...@gmail.com> wrote: > Kafka preallocates the index files so this is normal. This size is > configurable using the property: segment.ind

Re: Each empty partition has 21MB by default

2019-02-19 Thread Christopher Shannon
Kafka preallocates the index files so this is normal. This size is configurable using the property: segment.index.bytes You can find more information by searching that property in the documentation: https://kafka.apache.org/documentation/ On Tue, Feb 19, 2019 at 6:39 AM Soheil Pourbafrani wrote:

Each empty partition has 21MB by default

2019-02-19 Thread Soheil Pourbafrani
Recently I noticed that when I create a new empty topic, each partition will have 21MB data! I even change the Kafka version from 0.11.3 to 2.1.0 but it shows the same behavior. For example, if I create a new topic using the command : kafka-topics.sh --zookeeper zoo1:2181 --create --topic test --r