Managing clusters
Cluster Fields
Name
A unique, human-readable identifier for the Kafka cluster. It helps differentiate between multiple Kafka clusters in environments with multiple deployments. Only letters, numbers and symbols _-. are permitted. Other special characters and spaces are not allowed.
Kafka bootstrap URL
The URL of the Kafka bootstrap server that a client uses to connect to the Kafka cluster initially. The bootstrap URL helps the client to locate the Kafka cluster.
Location
This value indicates where the cluster is deployed, such as "local" for local development environments or a region-specific identifier for different cloud environments.
Skip CA Validation
Specify if the Kafka Admin Client needs to perform CA validation of the Broker server certificate.
Publicly Trusted CA
When a Kafka cluster uses SSL/TLS encryption, certificates issued by a publicly trusted CA ensure secure communication between clients and brokers, preventing the need for manually managing custom certificates.
CA (PEM)
If Publicly Trusted CA
is unchecked, configure the private CA certificate to sign the Broker Server certificate.
Authentication method
Specify the mechanism used to authenticate platform manager when connecting to the Kafka brokers. The supported authentication methods are mTLS and SASL (PLAIN
, SCRAM_SHA_256
, SCRAM_SHA_512
). The operator can choose to use mTLS (then they pass cert and private key) or SASL (then they pass username/password).
Shared cluster
Defines the visibility of the cluster. Shared cluster can be used by multiple tenants.
Shared clusters are visible to all tenants defined in the Axual platform.
Only Private clusters are visible to only the tenant that has defined it.
|
SSL Authentication Mode
Choose between validating clients using either a simple certificate-based approach or a full principal chain. The certificate-based option verifies the client’s identity using just the Distinguished Name (DN). The full principal chain option ensures a more detailed verification by validating the entire chain of certificates, which is recommended for multi-tenant environments. The default value of the SSL authentication Mode is Certificate.
Topic pattern
This pattern is used
to determine the actual topic name in the Kafka cluster when a topic is created from Self Service.
The default value for a topic pattern is {tenant}-{instance}-{environment}-{topic}
Consumer Group pattern
This pattern is used to determine the actual consumer group name in the Kafka cluster.
The default value for a consumer group pattern is {tenant}-{instance}-{environment}-{group}
Transactional ID pattern
This pattern is used to determine the actual transactional IDs in the Kafka cluster.
The default value for a transactional ID pattern is {tenant}-{instance}-{environment}-{transactional.id}
The cluster patterns are used to decide how many instances, environments, and tenants can use this cluster. |
Advertised Listeners
These are free-form Kafka bootstrap endpoints that can be listed for each type of security protocol. It is shown in the Connectivity Information section of the Application detail page. Users can use it to configure their producers and consumers. This is also helpful if you have different advertised URLs due to networking configurations.
Creating a Cluster
These steps are used to create a Cluster in the Axual Self-Service.
We are writing the steps to add the local cluster started with the Axual Streaming Charts.
But these steps can be used as reference for any cluster
|
-
Open the
clusters
menu and press theNew Cluster
button -
Provide the Cluster Details
-
Input
local
as the Name -
Input
Local cluster
as the Description -
Input
local
as the Location -
Select
Apache Kafka
as the Provider Type
-
-
Press the
Continue
button -
Provide the Kafka Details
-
Input
platform.local:31777
as the Kafka bootstrap URL -
Enable the Skip CA Validation
-
Select
TLS
as the Authentication Method -
Upload a
super-user
certificate -
Upload a
super-user
private-key -
Press the
Verify
button to validate that the above information is valid
-
-
Toggle the Shared cluster to be
no
Shared clusters are visible to all tenants defined in the Axual Platform. Only SUPER_ADMIN can manage these clusters.
Private clusters are visible to only the tenant that has defined it. TENANT_ADMIN can manage these clusters.
-
Select the
Full Chain Certificate
as the SSL Authentication ModeThe
Full Chain Certificate
option is recommended for multi-tenant environments. -
Press the
Add listener
button-
Input
mTLS
as the Protocol -
Input
platform.local:31777
as the URL
-
-
Press the
Add Cluster
button
Editing a Cluster
Tenant Admin can Edit a cluster that they own. To update a cluster:
-
Visit the Clusters page and click on the cluster you want to edit.
-
Click on the Edit Cluster button on the bottom right.
-
Fill in or change any information you need and click the Update cluster button.
If you change any of the Kafka bootstrap credential, you will need to Verify them again before you can update.
|
Deleting a Cluster
Tenant Admin can delete a cluster that they own if there are no active instances defined for it.
-
Navigate to the edit cluster page and then click the
Delete Cluster
Button -
If there are active instance defined for the cluster, the
Delete Cluster
Button will be disabled with a hover tooltip: -
If there are no active instances defined for the cluster, the following modal will be displayed:
Once you’ve confirmed that you would like to delete the cluster, it will be removed and no longer accessible by any instance.