VERSION

Features

  • Use HBase sink connector to sync data from Pulsar

Tags

Pulsar IO

HBase

Sink

Enterprise Support

StreamNative supported

Author

ASF

HBase Sink

The HBase sink connector pulls the messages from Pulsar topics and persists the messages to HBase tables.

Configuration

The configuration of the HBase sink connector has the following properties.

Property

Name Type Default Required Description
hbaseConfigResources String None false HBase system configuration hbase-site.xml file.
zookeeperQuorum String None true HBase system configuration about hbase.zookeeper.quorum value.
zookeeperClientPort String 2181 false HBase system configuration about hbase.zookeeper.property.clientPort value.
zookeeperZnodeParent String /hbase false HBase system configuration about zookeeper.znode.parent value.
tableName None String true HBase table, the value is namespace:tableName.
rowKeyName String None true HBase table rowkey name.
familyName String None true HBase table column family name.
qualifierNames String None true HBase table column qualifier names.
batchTimeMs Long 1000l false HBase table operation timeout in milliseconds.
batchSize int 200 false Batch size of updates made to the HBase table.

Example

Before using the HBase sink connector, you need to create a configuration file through one of the following methods.

  • JSON

    {
        "hbaseConfigResources": "hbase-site.xml",
        "zookeeperQuorum": "localhost",
        "zookeeperClientPort": "2181",
        "zookeeperZnodeParent": "/hbase",
        "tableName": "pulsar_hbase",
        "rowKeyName": "rowKey",
        "familyName": "info",
        "qualifierNames": [ 'name', 'address', 'age']
    }
  • YAML

    configs:
        hbaseConfigResources: "hbase-site.xml"
        zookeeperQuorum: "localhost"
        zookeeperClientPort: "2181"
        zookeeperZnodeParent: "/hbase"
        tableName: "pulsar_hbase"
        rowKeyName: "rowKey"
        familyName: "info"
        qualifierNames: [ 'name', 'address', 'age']