PRODUCT
INTEGRATIONS
SOLUTIONS
RESOURCES
COMPANY
Ignite Discussions : Ask Questions, Find Answers, Share Expertise about Sparkflows
How to filter valid data?
Hey Nagisa, In Sparkflows, we can use the ‘Filter By String Length’ processor to select rows that meet certain length criteria.
To use the ‘Filter By String Length’ Processor:
- Select a column in the ‘Input Column Name’ list. Filter would be applied on this column.
- Select ‘Minimum Length’ and ‘Maximum Length’. These would define the range to apply filters on data.
For more information read the Sparkflows Documentation here:
https://docs.sparkflows.io/en/latest/tutorials/data-engineeringII/data-preparation.html?highlight=filter%20by%20string%20length#filter-by-string-length
Hey Nagisa, In Sparkflows, we can use the ‘Filter By String Length’ processor to select rows that meet certain length criteria.
To use the ‘Filter By String Length’ Processor:
- Select a column in the ‘Input Column Name’ list. Filter would be applied on this column.
- Select ‘Minimum Length’ and ‘Maximum Length’. These would define the range to apply filters on data.
For more information read the Sparkflows Documentation here:
https://docs.sparkflows.io/en/latest/tutorials/data-engineeringII/data-preparation.html?highlight=filter%20by%20string%20length#filter-by-string-length