Job Monitoring

Monitoring Your Dataworkz Datasets

Once you have opened a dataset in Dataworkz, you can monitor its performance and health with our built-in monitoring features. From the top-level view of your dataset, you can access the monitoring section by clicking on the "Monitoring" quick link.

Dataset Overview

The monitoring section provides an overview of your dataset, including the following information:

• Data size: The total size of your dataset.

• Owner: The user who created the dataset.

• Last Modified Date: The date and time when the dataset was last modified.

Observability Features

Dataworkz provides several observability features that give you a comprehensive view of your dataset's health and performance. These features include:

• Data Freshness: Shows the details of your dataset, including the date, size, count, quality, and file information. This helps you ensure that your data is up-to-date and fresh.

• Impact Analysis: Displays the lineage of your dataset, showing you how it was created and modified over time. This helps you understand the impact of any changes made to your dataset.

• Header Information: Provides information about specific headers in your dataset, including their semantics and distribution. This helps you understand the structure and content of your dataset.

• Schema and Volume: Displays the schema and volume of your dataset, giving you a better understanding of its size and complexity.

Anomaly Detection

Dataworkz also detects anomalies in your dataset, alerting you to any unusual patterns or behaviors. This helps you identify and address any potential issues with your data.

With these monitoring features, you can easily track and manage your dataset's performance and health, ensuring that it is always up-to-date and of high quality.