Sparkflows workflow designer allows users to create end-to-end workflows. These workflows can be executed as jobs from the browser or scheduled with a scheduler.
One of the most asked features by Sparkflows customers has been to interactively execute workflow steps as a workflow is being designed and defined. Our team would be releasing it in the coming week.
Each of the nodes in the workflow would have a 'Play' button which when clicked would execute the workflow till that node in the workflow, and display the results in a modal dialog.
It is essential to remember that for a superior user experience the workflow must come back with the results within 1-2 seconds. To accomplish this goal, we select only the first 100 rows of the dataset to execute the workflow steps, allowing the workflow to execute and return the results very fast.