As promised in our last Blog, we have now released Streaming Dashboards.
For our example we built out a Streaming Workflow and ran it on the Apache Spark Cluster. The workflow outputs a chart.
We added the chart to a Dashboard. In our case the mini-batch duration of the streaming job has been set to 30 seconds.
So, now the dashboard updates automatically every 30 seconds.
Below is the screenshot of the Dashboard. It automatically updates itself every 30 seconds. The architecture is also built to scale, where the messages are streamed from the Spark Driver to the Web Server into the Browser.