mimaison commented on code in PR #547: URL: https://github.com/apache/kafka-site/pull/547#discussion_r1345510589
########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> + <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li> + <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li> Review Comment: ```suggestion <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b>: <a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a> reduces CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li> ``` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> + <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li> + <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li> + <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li> + <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li> + <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li> + <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li> + <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li> Review Comment: ```suggestion <li><b>KIP-937: Improve Message Timestamp Validation</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a> improves Producer's record timestamp validation.</li> ``` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> + <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li> + <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li> + <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li> + <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li> + <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li> + <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li> + <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li> + <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li> Review Comment: ```suggestion <li><b>KIP-938: Add more metrics for measuring KRaft performance</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a> adds the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li> ``` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> + <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li> + <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li> + <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li> + <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li> + <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li> + <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li> + <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li> + <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li> + </ul> + <h3>Kafka Streams</h3> + <ul> + <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li> + <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li> Review Comment: ```suggestion <li><b>KIP-941: Range queries to accept null lower and upper bounds</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> updates range queries to accept lower and upper bounds as null values.</li> ``` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> + <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li> + <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li> + <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li> + <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li> + <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li> + <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li> + <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li> + <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li> + </ul> + <h3>Kafka Streams</h3> + <ul> + <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li> + <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li> + </ul> + <h3>Kafka Connect</h3> + <ul> + <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li> + <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li> + <li><b>KIP-898: Modernize Connect plugin discovery</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>.The worker will read plugin classes from ServiceLoader manifests and module info during startup.</li> Review Comment: ```suggestion <li><b>KIP-898: Modernize Connect plugin discovery</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a> updates Connect so workers discover plugin classes using ServiceLoader manifests and module info during startup.</li> ``` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> + <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li> + <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li> + <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li> + <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li> + <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li> Review Comment: ```suggestion <li><b>KIP-917: Additional custom metadata for remote log segment</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a> adds custom metadata support for remote log segments.</li> ``` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> + <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li> + <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li> + <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li> + <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li> + <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li> + <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li> + <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li> + <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li> + </ul> + <h3>Kafka Streams</h3> + <ul> + <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li> Review Comment: ```suggestion <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a> adds a grace period to Stream Table join.</li> ``` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> Review Comment: ```suggestion <li><b>KIP-405: Kafka Tiered Storage</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a> introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> ``` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> + <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li> + <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li> + <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li> + <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li> Review Comment: ```suggestion <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a> upgrades the ZooKeeper client to 3.8.2 as the current ZooKeeper dependency version 3.6.3 reached the end of life.</li> ``` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> + <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li> + <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li> + <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li> + <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li> + <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li> + <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li> + <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li> + <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li> + </ul> + <h3>Kafka Streams</h3> + <ul> + <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li> + <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li> + </ul> + <h3>Kafka Connect</h3> + <ul> + <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li> Review Comment: ```suggestion <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a> adds support for topic-mutating SMTs for async sink connectors.</li> ``` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> Review Comment: ```suggestion <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage</a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> ``` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> + <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li> Review Comment: ```suggestion <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b>: <a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a> allows brokers to be configured with listeners that have same port on different IP stack like IPv4 and IPv6.</li> ``` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> + <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li> + <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li> + <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li> + <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li> + <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li> + <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li> + <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li> + <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li> + </ul> + <h3>Kafka Streams</h3> + <ul> + <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li> + <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li> + </ul> + <h3>Kafka Connect</h3> + <ul> + <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li> + <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li> + <li><b>KIP-898: Modernize Connect plugin discovery</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery">KIP-898</a>.The worker will read plugin classes from ServiceLoader manifests and module info during startup.</li> + </ul> + <h3>Summary</h3> + <p>This was a community effort, so thank you to everyone who contributed to this release, including all our users and our 142 contributors: + A. Sophie Blee-Goldman, Aaron Ai, Abhijeet Kumar, aindriu-aiven, Akhilesh Chaganti, Alexandre Dupriez, Alexandre Garnier, Alok Thatikunta, Alyssa Huang, Aman Singh, Andras Katona, Andrew Schofield, Andrew Grant, Aneel Kumar, Anna Sophie Blee-Goldman, Anton Agestam, Artem Livshits, atu-sharm, bachmanity1, Bill Bejeck, Bo Gao, Bruno Cadonna, Calvin Liu, Chaitanya Mukka, Chase Thomas, Cheryl Simmons, Chia-Ping Tsai, Chris Egerton, Christo Lolov, Clay Johnson, Colin P. McCabe, Colin Patrick McCabe, Colt McNealy, d00791190, Damon Xie, Danica Fine, Daniel Scanteianu, Daniel Urban, David Arthur, David Jacot, David Mao, dengziming, Deqi Hu, Dimitar Dimitrov, Divij Vaidya, DL1231, Dániel Urbán, Erik van Oosten, ezio, Farooq Qaiser, Federico Valeri, flashmouse, Florin Akermann, Gabriel Oliveira, Gantigmaa Selenge, Gaurav Narula, GeunJae Jeon, Greg Harris, Guozhang Wang, Hailey Ni, Hao Li, Hector Geraldino, hudeqi, hzh0425, Iblis Lin, iit2009060, Ismael Juma, Ivan Yurchen ko, James Shaw, Jason Gustafson, Jeff Kim, Jim Galasyn, John Roesler, Joobi S B, Jorge Esteban Quilcate Otoya, Josep Prat, Joseph (Ting-Chou) Lin, José Armando García Sancio, Jun Rao, Justine Olshan, Kamal Chandraprakash, Keith Wall, Kirk True, Lianet Magrans, LinShunKang, Liu Zeyu, lixy, Lucas Bradstreet, Lucas Brutschy, Lucent-Wong, Lucia Cerchie, Luke Chen, Manikumar Reddy, Manyanda Chitimbo, Maros Orsak, Matthew de Detrich, Matthias J. Sax, maulin-vasavada, Max Riedel, Mehari Beyene, Michal Cabak (@miccab), Mickael Maison, Milind Mantri, minjian.cai, mojh7, Nikolay, Okada Haruki, Omnia G H Ibrahim, Owen Leung, Philip Nee, prasanthV, Proven Provenzano, Purshotam Chauhan, Qichao Chu, Qichao Chu (@ex172000), Rajini Sivaram, Randall Hauch, Renaldo Baur Filho, Ritika Reddy, Rittika Adhikari, Rohan, Ron Dagostino, Sagar Rao, Said Boudjelda, Sambhav Jain, Satish Duggana, sciclon2, Shekhar Rajak, Sungyun Hur, Sushant Mahajan, Tanay Karmarkar, tison, Tom Bentley, vamossagar12, Victoria Xia, Vincent Jiang, vveicc, Walker Carlson, Yash Mayya, Yi-Sheng Lien, Ziming Deng, 蓝士钦 Review Comment: There are a few duplicates: - `A. Sophie Blee-Goldman` and `Anna Sophie Blee-Goldman` - `Qichao Chu` and `Qichao Chu (@ex172000)` - `Colin P. McCabe` and `Colin Patrick McCabe` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> + <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li> + <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li> + <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li> + <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li> + <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li> + <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li> + <li><b>KIP-937: Improve Message Timestamp Validation</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation">KIP-937</a>. Improved Producer's record timestamp validation.</li> + <li><b>KIP-938: Add more metrics for measuring KRaft performance</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-938%3A+Add+more+metrics+for+measuring+KRaft+performance">KIP-938</a>. Added the targeted KRaft performance metrics mentioned in KIP-938 except ForwardingManager metrics.</li> + </ul> + <h3>Kafka Streams</h3> + <ul> + <li><b>KIP-923: Add A Grace Period to Stream Table Join</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-923%3A+Add+A+Grace+Period+to+Stream+Table+Join">KIP-923</a>Added a grace period to Stream Table join.</li> + <li><b>KIP-941: Range queries to accept null lower and upper bounds</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds">KIP-941</a> Range queries accept lower and upper bounds as null values.</li> + </ul> + <h3>Kafka Connect</h3> + <ul> + <li><b>KIP-793: Allow sink connectors to be used with topic-mutating SMTs</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs">KIP-793</a>. It supports topic-mutating SMTs for async sink connectors.</li> + <li><b>KIP-875: First-class offsets support in Kafka Connect</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a>. Kafka Connect supports offset reset.</li> Review Comment: ```suggestion <li><b>KIP-875: First-class offsets support in Kafka Connect</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect">KIP-875</a> adds support for resetting connector offsets in Connect.</li> ``` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> + <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li> + <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li> + <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li> Review Comment: ```suggestion <li><b>KIP-868: Metadata Transactions</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a> allows the controller to generate atomic transactions of records that can exceed the maximum batch size.</li> ``` ########## blog.html: ########## @@ -22,6 +22,54 @@ <!--#include virtual="includes/_nav.htm" --> <div class="right"> <h1 class="content-title">Blog</h1> + <article> + <h2 class="bullet"> + <a id="apache_kafka_360_release_announcement"></a> + <a href="#apache_kafka_360_release_announcement">Apache Kafka 3.6.0 Release Announcement</a> + </h2> + 15 Sep 2023 - Satish Duggana (<a href="https://twitter.com/0xeed">@SatishDuggana</a>) + <p>We are proud to announce the release of Apache Kafka 3.6.0. This release contains many new features and improvements. This blog post will highlight some of the more prominent features. For a full list of changes, be sure to check the <a href="https://downloads.apache.org/kafka/3.6.0/RELEASE_NOTES.html">release notes</a>.</p> + <p>See the <a href="https://kafka.apache.org/36/documentation.html#upgrade_3_6_0">Upgrading to 3.6.0 from any version 0.8.x through 3.5.x</a> section in the documentation for the list of notable changes and detailed upgrade steps.</p> + <p> + The ability to migrate Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system is + now considered stable and suitable for production environments. See the ZooKeeper to KRaft migration + <a href="https://kafka.apache.org/documentation/#kraft_zk_migration">operations documentation</a> for + details. Note that support for JBOD is still not available for KRaft clusters, therefor clusters + utilizing JBOD cannot be migrated. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-858%3A+Handle+JBOD+broker+disk+failure+in+KRaft">KIP-858</a> + for details regarding KRaft and JBOD. + </p> + <p>Support for Delegation Tokens in KRaft (<a href="https://issues.apache.org/jira/browse/KAFKA-15219">KAFKA-15219</a>) was completed in 3.6, further reducing the gap of features between ZooKeeper-based Kafka clusters and KRaft. Migration of delegation tokens from ZooKeeper to KRaft is also included in 3.6.</p> + <p><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">Tiered Storage<a> is an early access feature. It is currently only suitable for testing in non production environments. See <a href="https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes">Early Access Notes</a> for more details.</p> + + <p><i>Note: ZooKeeper is marked as deprecated since 3.5.0 release. ZooKeeper is planned to be removed in Apache Kafka 4.0. (Cf <a href="/documentation#zk_depr">ZooKeeper Deprecation</a>)</i><p> + <h3>Kafka Broker, Controller, Producer, Consumer and Admin Client</h3> + <ul> + <li><b>KIP-405: Kafka Tiered Storage</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage">KIP-405</a>. It introduces tiered storage feature in Kafka that provides separation of computation and storage in the broker.</li> + <li><b>KIP-797: Accept duplicate listener on port for IPv4/IPv6</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330">KIP-797</a>. Brokers can be configured with listeners that have same port on different ip stack like ipv4 and ipv6.</li> + <li><b>KIP-863: Reduce CompletedFetch#parseRecord() memory copy</b><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035">KIP-863</a>. Reduced CompletedFetch#parseRecord() memory copy by deserializing using byte buffers.</li> + <li><b>KIP-868: Metadata Transactions</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions">KIP-868</a>. This feature is about allowing the controller to generate atomic transactions of records that can exceed the maximum batch size.</li> + <li><b>KIP-902: Upgrade Zookeeper to 3.8.2</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.2">KIP-902</a>. Zookeeper client upgraded to 3.8.2 version as the current zookeeper dependency version 3.6.3 reached the end of life.</li> + <li><b>KIP-917: Additional custom metadata for remote log segment</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment">KIP-917</a>. Custom metedata support for remote log segments.</li> + <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b><a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a>. Renamed ambiguous tiered storage metrics.</li> Review Comment: ```suggestion <li><b>KIP-930: Rename ambiguous Tiered Storage Metrics</b>: <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics">KIP-930</a> renames ambiguous tiered storage metrics.</li> ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org