Introduction to the Data Quality page

The Data Quality page is where you can see an overview of your data monitors.

A data monitor is an automated data quality check that is performed each time you fetch data. With data monitors, you can find anomalies in your data more easily.

For more information about data monitors, see Working with universal monitors and Working with custom monitors.

You can set up email notifications for the data quality issues. For more information, see Managing user notifications.

Data Quality KPIs

The KPI boxes at the top of the Data Quality page show the summary of issues detected by the monitors in the current workspace.

Duplication: This KPI box shows the percentage of the datastreams that contain unique data out of the datastreams monitored by the universal duplication monitor.; You can also see the number of unresolved issues and the number of new unresolved issues since yesterday when relevant.
Custom monitors: This KPI box shows the percentage of the datastreams that match the validation rules defined by the custom monitors.; You can also see the number of unresolved issues and the number of new unresolved issues since yesterday when relevant.

Checking details of the data quality issues

To see the details of the data quality issues shown in the KPI boxes, click See details in the selected KPI box. The following summary is shown:

Datastreams with the most unresolved issues

List of datastreams with their number of unresolved issues in the descending order.

Click on a bar representing a datastream to filter the issues for this datastream. Only issues from selected datastreams will appear on this page. You can edit the filters in the table of issues below.

Issues by date

A bar chart for the last month showing when the data quality issues have occurred and their type.

Click on a bar to filter issues by the selected date. Only issues from this date will appear on this page. You can edit the filters in the table of issues below.

Table of issues

The issues table shows the summary of data quality issues. You can use this table to:

Filter issues to find the relevant ones
See the details of an issue

Click See details to open a pop-up with the issue details. For more information, see Viewing details of the data quality issues in your data extract.
Acknowledge the selected issues

Universal monitors

The first table in the middle of the Data Quality page contains important information about your monitors in the following columns:

Name - the name of this monitor
Status - the status of the monitor
Severity - the severity of the issues triggered by the monitor

To see the datastreams that override the default monitor behavior, click the name of the universal monitor.

For more information about universal monitors, see Working with universal monitors.

Custom monitors

To create a new custom monitor, click + Add custom monitor in the top-right corner of the Data Quality page. For more information, see Creating a custom monitor.

Use these filters to view your custom monitors according to different properties. See below for more information about these filters.
Click here to search for a custom monitor by Name.
Click here for more options. The options available here depend on your role and permissions. For more information, see Managing user permissions.

The second table in the middle of the Data Quality page contains important information about your monitors in the following columns:

Name - the name of this custom monitor
Assigned to - the number of datastreams to which this custom monitor is assigned
Workspace - the workspace in which this custom monitor was created
Severity - the severity of the issues triggered by the custom monitor

The filters above the table allow you to view specific monitors in the table. You can apply more than one filter at the same time to view specific monitors:

Severity - displays all custom monitors raising an issue of the selected severity type
Workspace - displays all custom monitors that were created in the selected workspace

You can also use the search bar to search for monitors by the Name column in the table. You can use the search function with or without filters applied.

Click Select an action in a specific monitor's row in the table to perform additional actions with this monitor. The actions you can perform are:

Delete monitor - allows you to delete this monitor

For more information about custom monitors, see Working with custom monitors.