top of page

Data-Quality-Processors List

​Data-Quality
Name
Description
ExpectColumnToExist
ExpectColumnValuesToBeInBetween
ExpectColumnValuesToBeInSet
ExpectColumnValuesToBeNull
ExpectColumnValuesToBeUnique
ExpectColumnValuesToMatchRegex
ExpectColumnValuesToNotBeNull
ExpectColumnValueLengthsToEqual
ExpectColumnValueLengthToBeInBetween
ExpectColumnValueToMatchStrftimeFormat
ExpectTableRowCountToBeBetween
GE Decision
This Node takes in an expression. It evaluates the expression and based on the results sends the execution to the first or the second output Node
Split Into Good And Bad Records
HasDataSize
Check the size of the dataset.
HasMax
Check for max value in selected column.
HasMin
Check for min value in selected column.
PatternMatch
IsNonNegative
Should not contain negative values
Is Not Null
IsPositive
Is Primary Key
Is Value In
NodeDataQualityCheckAndAlert
CheckOutliers
This checks if values fall between Inter Quartile Range.
ColumnValuesToBeBetween
Create CSV from GE Results
Great-Expectations
Name
Description
ExpectColumnToExist
ExpectColumnValuesToBeInBetween
ExpectColumnValuesToBeInSet
ExpectColumnValuesToBeNull
ExpectColumnValuesToBeUnique
ExpectColumnValuesToMatchRegex
ExpectColumnValuesToNotBeNull
ExpectColumnValueLengthsToEqual
ExpectColumnValueLengthToBeInBetween
ExpectColumnValueToMatchStrftimeFormat
ExpectTableRowCountToBeBetween
GE Decision
This Node takes in an expression. It evaluates the expression and based on the results sends the execution to the first or the second output Node
Split Into Good And Bad Records
HasDataSize
Check the size of the dataset.
HasMax
Check for max value in selected column.
HasMin
Check for min value in selected column.
PatternMatch
IsNonNegative
Should not contain negative values
Is Not Null
IsPositive
Is Primary Key
Is Value In
NodeDataQualityCheckAndAlert
CheckOutliers
This checks if values fall between Inter Quartile Range.
ColumnValuesToBeBetween
Create CSV from GE Results
bottom of page