Ignite Discussions : Ask Questions, Find Answers, Share Expertise about Sparkflows
Concatenation of data can be achieved using multiple ways in Sparkflows.
Using ‘Concat Columns’ processor. Following step needs to be followed :
Select the columns from the incoming DataFrame that need to be concatenated.
Specify the output column name to hold the concatenated value in the output DataFrame. Concatenated value would list under this column.
Using ‘Expression’ processor :
Input new column name.
Input the concat expression such as concat(col_a, col_b). Concatenated value would list under the new column added to the output DataFrame.