top of page

Data Quality


Name

Description

HasDataSize

Check the size of the dataset.

HasMax

Check for max value in selected column.

HasMin

Check for min value in selected column.

PatternMatch


IsNonNegative

Should not contain negative values.

Is Not Null


IsPositive


Is Primary Key


Is Value In


NodeDataQualityCheckAndAlert


CheckOutliers

This checks if values fall between Inter Quartile Range.



ColumnValuesToBeBetween



Great Expectations


Name

Description

Create CSV from GE Results


ExpectColumnToExist


ExpectColumnValuesToBeInBetween


ExpectColumnValuesToBeInSet


ExpectColumnValuesToBeNull


ExpectColumnValuesToBeUnique


ExpectColumnValuesToMatchRegex


ExpectColumnValuesToNotBeNull


ExpectColumnValueLengthsToEqual


ExpectColumnValueLengthToBeInBetween


ExpectColumnValueToMatchStrftimeFormat


ExpectTableRowCountToBeBetween


GE Decision

This Node takes in an expression. It evaluates the expression and based on the results sends the execution to the first or the second output Node.

Split Into Good And Bad Records



bottom of page