Filter functions can be used to restrict a data pipeline to only a subset of a data source, which resembles the WHERE clause of a SQL query. For instance, a data pipeline may need to process only records with a valid email address stored in a certain attribute and, to this end, apply the Match Regular Expression filter.
Additionally, filter functions can be used to restrict a transformation function to only a subset of all values of a certain attribute.
Selects only values that contain a given substring.
Selects only values that end with a given substring.
Selects only values that equal a given value.
Selects only values that are greater than a given value.
Selects only values that are less than a given value.
Selects only values that match a given regular expression.
By default, this filter evaluates to true if only a sub string
of a value matches the regular expression. Please use ^ as
prefix and $ as suffix for your regular expression, if you
want to select only values that completely match the
expression.
Note that this filter performs a case-sensitive matching.
Selects only NULL values.
Selects only values that do not equal a given value.
Selects only values that are not NULL.
Selects only values that start with a given substring.