DataCater provides battle-tested connectors for many different data stores, ranging from database systems over flat files to search engines and data warehouses. Data connectors are technically based on the Kafka Connect framework, which prevents vendor lock-in and eases the development of custom connectors.
DataCater implements change data capture (CDC) for extracting data from data sources, which allows streaming data pipelines to consider only relevant data for processing. CDC does not only reduce the load on all involved systems but also improves the time to value in data preparation.
For all major database systems, DataCater provides log-based CDC connectors, which can extract data change events in real time.
DataCater's interactive pipeline designer allows users to build streaming data pipelines in a few minutes instead of hours to days. It ships an extensive repository of transformation and filter functions that cover most needs in data preparation for machine learning and analytics. For edge cases, DataCater supports Python UDFs.
When building data pipelines, the pipeline designer interactively previews their impact on the consumed data source, which creates full transparency on the applied transformations and helps to accelerate the development process.
DataCater compiles data pipelines to highly-optimized Kafka Streams applications, which are deployed as containers.
The container-based approach to deployment supports the automatic scaling of data pipelines depending on the current load.
DataCater continuously monitors the health of managed data connectors and running data pipelines to ensure smooth operations.
When multiple systems work together, problems may occur from time to time: A data source may go offline, a data sink may become unavailable, etc.
Our support team is here to help you in case of any issues. We make sure that you can focus on your core job instead of losing time on optimizing your data pipelines.
We offer DataCater as a cloud-based data preparation product but also support the installation of DataCater on your premises.