Viewing datastream issues

This guide explains how to view datastream issues.

Introduction

There are two types of issues in Adverity:

Errors

Errors signal critical issues and stop processing the data.

Warnings

Warnings signal non-critical issues and continue processing the data.

Adverity's datastream issues inform you about potential problems with your data and datastreams. These problems include the following issues:

  • Issues that prevent your datastream from fetching data from your chosen data source, such as incorrect datastream configuration settings

  • Issues that occur while applying an enrichment to your data extract, such as incorrect configuration of an enrichment

  • Issues detected by data monitors, such as duplicate data rows in your data extracts

Viewing datastream issues

There are a number of ways to stay up-to-date with all the datastream warnings and errors in your Adverity workspace. You can find datastream issues in the following ways:

Viewing details of the data quality issues in your data extract

This feature is at the Beta stage. It is only available to Adverity customers who are participating in the Beta testing.

To view the data that does not meet your monitoring rules, follow these steps:

  1. Open the datastream overview or Activity page and find the task with data quality issues.

  2. Click the task overview for the task with the Data Quality error or warning.

  3. Above the data extract, you will see Data Quality errors and warnings for specific monitors.

    In the selected data quality issue box above the data extract, click View details. In the details window, you can see the following information:

    Duplicate data checks

    Adverity displays the duplicate rows found in your data extract and the number of times they occur.

    You can download the duplicate rows at the bottom of the window.

    Custom monitors

    Adverity displays the rows in your data extract that violate each of the defined rules and the number of times the violation occurs.