Suppose, I have a continuous stream of data updates, and I wish to trigger workflows only when the incoming data surpasses a threshold of 1000. Can I do it?
- Load the data using an appropriate “Read” processor.
- Add a “Count” processor immediately after the Read processor and connect them. This will provide the count of records in the incoming DataFrame.
- Introduce an “Assert” processor and connect it accordingly, utilizing the provided configuration. If the expression evaluates to true, the output will be directed to the first edge of the Assert processor. If the expression evaluates to false, the output will be directed to the second edge of the Assert processor (Given Workflow and configuration might help you).
Hey Nagisa, To achieve this, follow these steps:
- Load the data using an appropriate “Read” processor.
- Add a “Count” processor immediately after the Read processor and connect them. This will provide the count of records in the incoming DataFrame.
- Introduce an “Assert” processor and connect it accordingly, utilizing the provided configuration. If the expression evaluates to true, the output will be directed to the first edge of the Assert processor. If the expression evaluates to false, the output will be directed to the second edge of the Assert processor (Given Workflow and configuration might help you).