Hi everyone, I’d like to propose a KIP to change the data type of log.segment.bytes from int to long, allowing segment sizes beyond the current 2GB limit.
Rationale: Currently, the maximum segment size is constrained by the int type, capping it at 2GB. However, with modern hardware—such as large-scale deployments on machines with multiple high-capacity disks (e.g., EPYC servers with 4×15TB drives)—this limitation makes segment sizes inefficiently small. And too many handles (log, index, metadata). So Increasing the limit to 3–4GB (or more) would better align with today’s storage capabilities. Would love to hear your thoughts before drafting a formal KIP. Best, Mikhail Fesenko
