In Sparkflows, we can use the following processors to compare incoming datasets :
- Compare All Columns
- Compare All Columns Single Output
- Compare Specific Columns
- Compare Specific Columns Single Output
- Compare Datasets
Post comparison multiple outgoing datasets are created as an output. One having common rows, second having rows present in first DataFrame and not in second one and third one having rows present in second one & not in first one.
Hey Chris,
In Sparkflows, we can use the following processors to compare incoming datasets :
- Compare All Columns
- Compare All Columns Single Output
- Compare Specific Columns
- Compare Specific Columns Single Output
- Compare Datasets
Post comparison multiple outgoing datasets are created as an output. One having common rows, second having rows present in first DataFrame and not in second one and third one having rows present in second one & not in first one.