Why it happened suddenly? In about two years I didn't observe such behavior from Kafka!
On Tue, Feb 19, 2019 at 4:20 PM Christopher Shannon < christopher.l.shan...@gmail.com> wrote: > Kafka preallocates the index files so this is normal. This size is > configurable using the property: segment.index.bytes > > You can find more information by searching that property in the > documentation: https://kafka.apache.org/documentation/ > > On Tue, Feb 19, 2019 at 6:39 AM Soheil Pourbafrani <soheil.i...@gmail.com> > wrote: > > > Recently I noticed that when I create a new empty topic, each partition > > will have 21MB data! I even change the Kafka version from 0.11.3 to 2.1.0 > > but it shows the same behavior. For example, if I create a new topic > using > > the command : > > > > kafka-topics.sh --zookeeper zoo1:2181 --create --topic test > > --replication-factor 1 --partitions 5 > > > > here is the list of files in the LOG_DIR/test-1 (Partition one of the > topic > > test) > > > > 10M test-1/00000000000000000000.index > > 0 test-1/00000000000000000000.log > > 10M test-1/00000000000000000000.timeindex > > 4.0K test-1/leader-epoch-checkpoint > > > > Is it natural behavior? > > >
