Step 1: Creating streams

Creating streams

In this step you will create and configure a stream. Producer and consumer applications will later connect to it.

Let’s begin by logging into the Self-Service portal. In case you requested a Trial, your credentials were supplied in an e-mail.

Once logged in, you will see the following screen:

Dashboard
Click the 3-stripes button in the top-left of the screen to display text-labels next to the menu-buttons.

Creating a stream.

  1. Click Streams

Stream overview
  1. In the top-right corner of the screen, click the New stream button.

  2. Use applicationlogevents as the Stream Name

New stream view
  1. Description: Enter a description which helps (future) colleagues understand what kind of data is available on the stream. I.e. "Logs created by various applications at 'ACME'.".

  2. Owner: Select default as the owner. Resource-access is group-based, and you currently belong to this group.

  3. Key type & Value type: Select AVRO from the drop-down, for both. This will create 2 more drop-downs, prompting you to select which schemas to use for the key and the value.

    1. Key schema: Select io.axual.client.example.schema.Application

    2. Value schema: Select io.axual.client.example.schema.ApplicationLogEvent

If you’re not using an Axual Trial environment, these schemas may not be available to you. Use other schemas that are already available, or follow the Schema Management guide to upload new schemas.

You can leave the rest of the fields as they are.

  1. Click Create stream, at the bottom-right of the screen

The stream-definition was created:

stream applicationlogevents

The stream is not yet "deployed". We’ll deploy the stream onto an environment.

Deploying the stream

Axual introduced the notion of "environments": a stream can be deployed onto one or multiple environments. This enables developers to use testing environments while setting their applications up, and later "promote" their stream to production environments.

Environments offer strict data and permission separation between stream-deployments. An application that’s connected to the "development" deployment of a stream doesn’t have access to the "production" deployment of the same stream. For all intents and purposes, you can see different stream-deployments as completely separate streams.

  1. Click the environment drop-down and select the default environment. This is the only preconfigured environment in the Axual-Trial.

  2. Click Configure stream

Config stream button
  1. Enter a retention time (e.g. 1 day)

  2. Choose 1.0.0 as the Key and Value Schema version in the dropdown (or any that is available)

  3. Enter a number of partitions (e.g. 2)

  4. Click "Save" to deploy your stream. The stream has now become active in the "default" environment.

Config stream view

Optional

Create and deploy another stream, in the same default environment. Name it example-string-stream and use String as both the Key and Value type.

Next step: Creating applications

In step 2 we’ll create application registrations in the self-service portal.