DataCater can stream insertions and updates processed by a data pipeline to a REST/HTTP endpoint. Deletions are ignored.
This sink connector supports the following configuration options:
The URI of the REST endpoint, including the HTTP scheme, i.e., http:// or https://.
POST, PUT, PATCH or DELETE.
The header for the HTTP request (default: Content-Type:application/json). Multiple header entries can be separated by a pipe (|).
When the REST endpoint is unavailable, the sink connector automatically retries sending requests to the REST endpoint up to a given number of attempts (default: 10).
The sink connectors waits a given amount of time between making retry attempts (default: 10,000 ms).
DataCater does not require schema mapping for this sink connector but passes the pipeline records as JSON objects to the REST endpoint.
Note that string values, which hold valid JSON objects or arrays, are automatically transformed into a JSON representation. This way, the sink connector allows to ingest arbitrarily complex JSON structures into REST endpoints.