The HBase sink connector pulls the messages from Pulsar topics and persists the messages to HBase tables.
The configuration of the HBase sink connector has the following properties.
Name | Type | Default | Required | Description |
---|---|---|---|---|
hbaseConfigResources |
String | None | false | HBase system configuration hbase-site.xml file. |
zookeeperQuorum |
String | None | true | HBase system configuration about hbase.zookeeper.quorum value. |
zookeeperClientPort |
String | 2181 | false | HBase system configuration about hbase.zookeeper.property.clientPort value. |
zookeeperZnodeParent |
String | /hbase | false | HBase system configuration about zookeeper.znode.parent value. |
tableName |
None | String | true | HBase table, the value is namespace:tableName . |
rowKeyName |
String | None | true | HBase table rowkey name. |
familyName |
String | None | true | HBase table column family name. |
qualifierNames |
String | None | true | HBase table column qualifier names. |
batchTimeMs |
Long | 1000l | false | HBase table operation timeout in milliseconds. |
batchSize |
int | 200 | false | Batch size of updates made to the HBase table. |
Before using the HBase sink connector, you need to create a configuration file through one of the following methods.
JSON
{
"hbaseConfigResources": "hbase-site.xml",
"zookeeperQuorum": "localhost",
"zookeeperClientPort": "2181",
"zookeeperZnodeParent": "/hbase",
"tableName": "pulsar_hbase",
"rowKeyName": "rowKey",
"familyName": "info",
"qualifierNames": [ 'name', 'address', 'age']
}
YAML
configs:
hbaseConfigResources: "hbase-site.xml"
zookeeperQuorum: "localhost"
zookeeperClientPort: "2181"
zookeeperZnodeParent: "/hbase"
tableName: "pulsar_hbase"
rowKeyName: "rowKey"
familyName: "info"
qualifierNames: [ 'name', 'address', 'age']