Snowflake sink Connector, version 1.8.2

You will authenticate against Snowflake using public-key encryption.
You will generate a key-pair in your terminal. There are multiple ways to get an RSA key, but only keys generated this way will work with Snowflake.
For additional information, check Snowflake Key-Pair authentication.

openssl genrsa 2048 | openssl pkcs8 -topk8 -inform PEM -out MY_SNOWFLAKE.key -nocrypt
openssl rsa -in MY_SNOWFLAKE.key -pubout -out MY_SNOWFLAKE.cert

For each file, you’ll need to remove the first and last lines, and concatenate all of their remaining contents onto a single line.
The following commands will do just that.

cat MY_SNOWFLAKE.key  | sed '1d' | sed '$d' | tr -d '\n' > MY_SNOWFLAKE_COMPACT.key
cat MY_SNOWFLAKE.cert | sed '1d' | sed '$d' | tr -d '\n' > MY_SNOWFLAKE_COMPACT.cert

Sign up with Snowflake to create a new trial account.
Select a standard account type and any cloud provider when prompted.
After activating your account by confirming your e-mail address, you should receive a second e-mail which contains your Account URL.
We’ll use this URL later, when configuring the Connector-Application, for the snowflake.url.name configuration value.

Login to your Snowflake account and click the Worksheets button on the left-side menu.
Click the + Worksheet button at the top-right of the screen to create a new worksheet.

Paste the following statements in the worksheet. Do not execute anything yet.

-- For the purposes of this demo, we'll use the admin role
USE ROLE ACCOUNTADMIN;

-- Create a warehouse which will execute insert statements prompted by kafka connect
CREATE WAREHOUSE SF_WAREHOUSE WITH
   WAREHOUSE_SIZE = 'XSMALL'
   WAREHOUSE_TYPE = 'STANDARD'
   AUTO_SUSPEND = 300
   AUTO_RESUME = TRUE
;

-- Create snowflake resources
CREATE DATABASE SF_DATABASE;
CREATE SCHEMA SF_DATABASE.SF_SCHEMA;
CREATE TABLE SF_TABLE (
   RECORD_METADATA VARIANT,
   RECORD_CONTENT  VARIANT
);

-- Create a role with permission to use the above resources
-- Required permissions for kafka connectors are listed here:
-- https://docs.snowflake.com/en/user-guide/kafka-connector-install.html#required-privileges
CREATE ROLE SF_ROLE;

GRANT USAGE ON WAREHOUSE SF_WAREHOUSE
   TO ROLE SF_ROLE;
GRANT USAGE ON DATABASE SF_DATABASE
   TO ROLE SF_ROLE;
GRANT USAGE ON SCHEMA SF_DATABASE.SF_SCHEMA
   TO ROLE SF_ROLE;
GRANT CREATE STAGE ON SCHEMA SF_DATABASE.SF_SCHEMA
   TO ROLE SF_ROLE;
GRANT CREATE PIPE ON SCHEMA SF_DATABASE.SF_SCHEMA
   TO ROLE SF_ROLE;
GRANT OWNERSHIP ON TABLE SF_DATABASE.SF_SCHEMA.SF_TABLE
   TO ROLE SF_ROLE;

Append the following statements to the same worksheet, after replacing the username and public key.
Replace YOUR_USERNAME with your Snowflake account username.
Paste the contents of the MY_SNOWFLAKE_COMPACT.cert as the public key.

GRANT ROLE SF_ROLE
   TO USER YOUR_USERNAME;
ALTER USER YOUR_USERNAME SET DEFAULT_ROLE = SF_ROLE;
ALTER USER YOUR_USERNAME SET RSA_PUBLIC_KEY='MIIBIj...IDAQAB';

Select the entirety of the worksheet contents via Right Click → Select All or Ctrl+A (Cmd+A on MacOS).
We do this because, when executing worksheet instructions, only the selected lines are actually executed.
Now, with all the lines selected, click the Play button on the top-right of the screen to execute all the commands in the worksheet.

Follow the Creating streams documentation in order to create one stream and deploy it onto an environment.
The name of the stream will be my_snowflake_stream.
The key/value types will be String/String.

Follow the Configure and install a connector documentation to set up a new Connector-Application.
Let’s call it my_snowflake_sink.
The plugin name is com.snowflake.kafka.connector.SnowflakeSinkConnector.
If a plugin isn’t available, ask a platform operator to install plugins.

Produce some String/String events to the my_snowflake_stream stream. You can follow the producer documentation and examples.

Provide the following minimal configuration in order to connect to the previously configured Snowflake instance.
For advanced configuration, see the official sink connector documentation.

Authorize the my_snowflake_sink sink Connector-Application to consume the my_snowflake_stream stream.

You can now start the sink Connector-Application.

Let’s find the events in Snowflake.