VERSION

Features

  • Use JDBC sink connector to sync data from Pulsar

Tags

Pulsar IO

JDBC

Sink

Enterprise Support

StreamNative supported

Author

ASF

JDBC Sink

The JDBC sink connector pulls messages from Pulsar topics and persists the messages to MySQL or SQlite.

Currently, INSERT, DELETE and UPDATE operations are supported.

Configuration

The configuration of the JDBC sink connector has the following properties.

Property

Name Type Required Default Description
userName String false " " (empty string) The username used to connect to the database specified by jdbcUrl.

Note: userName is case-sensitive.
password String false " " (empty string) The password used to connect to the database specified by jdbcUrl.

Note: password is case-sensitive.
jdbcUrl String true " " (empty string) The JDBC URL of the database to which the connector connects.
tableName String true " " (empty string) The name of the table to which the connector writes.
nonKey String false " " (empty string) A comma-separated list contains the fields used in updating events.
key String false " " (empty string) A comma-separated list contains the fields used in where condition of updating and deleting events.
timeoutMs int false 500 The JDBC operation timeout in milliseconds.
batchSize int false 200 The batch size of updates made to the database.

Example

Before using the JDBC sink connector, you need to create a configuration file through one of the following methods.

  • JSON

    {
        "userName": "root",
        "password": "jdbc",
        "jdbcUrl": "jdbc:mysql://127.0.0.1:3306/pulsar_mysql_jdbc_sink",
        "tableName": "pulsar_mysql_jdbc_sink"
    }
  • YAML

    configs:
        userName: "root"
        password: "jdbc"
        jdbcUrl: "jdbc:mysql://127.0.0.1:3306/pulsar_mysql_jdbc_sink"
        tableName: "pulsar_mysql_jdbc_sink"

Usage

For more information about how to use a JDBC sink connector, see connect Pulsar to MySQL.