What is Workflow Monitoring?

Workflow monitoring is helping to monitor the execution of workflows and task assigned to the workflow.

In workflow monitoring you can:

• • See the details of execution for each workflow
  • See the history of the workflow execution
  • See data quality checks that you have applied in each workflow
  • Display the performance of each process in the workflow

How did the need for a monitoring tool came?

1. 1. The importance of the Data Quality
   2. To many workflows
   3. To many yarn applications
   4. Billions of records processed daily
   5. Overhead on Data Engineers
   6. Workflow Performance checks
   7. One Visualisation Interface

BWM is your best friend to:

1. 1. do WF performance check
   2. perform Big Data services check
   3. do Data quality check
   4. do Cluster health check
   5. Visualise the results in modern dashboards automatically
   6. Get notifications for any anomaly that is configured