VERSION

Features

  • Use MongoDB sink connector to sync data from Pulsar

Tags

Pulsar IO

MongoDB

Sink

Enterprise Support

StreamNative supported

Author

ASF

MongoDB Sink

The MongoDB sink connector pulls messages from Pulsar topics and persists the messages to collections.

Configuration

The configuration of the MongoDB sink connector has the following properties.

Property

Name Type Required Default Description
mongoUri String true " " (empty string) The MongoDB URI to which the connector connects.

For more information, see connection string URI format.
database String true " " (empty string) The database name to which the collection belongs.
collection String true " " (empty string) The collection name to which the connector writes messages.
batchSize int false 100 The batch size of writing messages to collections.
batchTimeMs long false 1000 The batch operation interval in milliseconds.

Example

Before using the Mongo sink connector, you need to create a configuration file through one of the following methods.

  • JSON

    {
        "mongoUri": "mongodb://localhost:27017",
        "database": "pulsar",
        "collection": "messages",
        "batchSize": "2",
        "batchTimeMs": "500"
    }
  • YAML

    {
        mongoUri: "mongodb://localhost:27017"
        database: "pulsar"
        collection: "messages"
        batchSize: 2
        batchTimeMs: 500
    }