Workflow Automation Templates
A library of ready-to-use workflow templates to accelerate your data journey
SparkML Regression
Predict housing prices

Overview
This workflow builds a regression model using Spark ML to predict housing prices based on multiple features. It performs data preprocessing, encoding, outlier handling, model training, and evaluation to generate accurate price predictions.
Details
The workflow begins by importing housing data using the Read CSV node. Outliers are detected and filtered using Flag Outlier and Row Filter nodes to ensure data quality. Categorical features are converted into numeric form with String Indexer and One Hot Encoder, followed by feature assembly through Vector Assembler.
The dataset is split into training and testing sets using the Split node. A Random Forest Regression model is then trained on the prepared data to predict housing prices. The Predict node applies the model to test data, and results are evaluated using the Regression Evaluator to measure performance.
The trained model is saved with ML Model Save for future deployment, and results are displayed using Drop Columns and Print N Rows. This end-to-end workflow enables scalable, accurate housing price prediction using distributed Spark ML processing.