REST/HTTP

DataCater can stream insertions and updates processed by a data pipeline to a REST/HTTP endpoint. Deletions are ignored.


Configuration

This sink connector supports the following configuration options:

URI

The URI of the REST endpoint, including the HTTP scheme, i.e., http:// or https://.

HTTP method

POST or PUT.

HTTP request header

The header for the HTTP request (default: Content-Type:application/json). Multiple header entries can be separated by a pipe (|).

Maximum number of retries

When the REST endpoint is unavailable, the sink connector automatically retries sending requests to the REST endpoint up to a given number of attempts (default: 10).

Backoff interval for retries

The sink connectors waits a given amount of time between making retry attempts (default: 10,000 ms).


Data Types

DataCater does not require schema mapping for this sink connector but passes the pipeline records as JSON objects to the REST endpoint.

Note that string values, which hold valid JSON objects or arrays, are automatically transformed into a JSON representation. This way, the sink connector allows to ingest arbitrarily complex JSON structures into REST endpoints.