Upgrading to Kafka 4
Content
Kafka 4 has been released. To successfully upgrade, there are a few things to take into account.
Deprecated Kafka Properties
Kafka 4 has removed some topic configurations, one of which can be set through Axual governance. It needs to be removed from Kafka. Axual provides an application that can be configured to remove this topic configuration from every Kafka topic, called kafka config cleanup.
Deprecated Kafka Clients
There is a list of old Kafka clients and old Kafka API versions that have been removed from Kafka 4.
Before upgrading, it is a good idea to identify any such clients connected to the Kafka cluster so that these do not run into any issues after the upgrade. The process of identifying such clients is documented here.
Upgrade Kafka Cluster
Once the topic configs are taken care of and older clients have been identified, the actual upgrade to Kafka 4 is straightforward as explained in upgrade to Kafka 4.
Platform Manager Compatibility
After upgrading to Kafka 4, all Platform Manager operations have been verified and work correctly with the new version. This includes topic management, message production and consumption, ACL configurations, SSL authentication, SASL users, Schema Registry integration, and streaming applications.