Viewing datastream issues

This guide explains how to view datastream issues.

Introduction

There are two types of issues in Adverity:

Errors

Errors signal critical issues and stop processing the data.

Warnings

Warnings signal non-critical issues and continue processing the data.

Adverity's datastream issues inform you about potential problems with your data and datastreams. These problems include the following issues:

• Issues that prevent your datastream from fetching data from your chosen data source, such as incorrect datastream configuration settings

• Issues that occur while applying a transformation to your data extract, such as incorrect configuration of a transformation

• Issues detected by data monitors, such as duplicate data rows in your data extracts

Viewing datastream issues

There are a number of ways to stay up-to-date with all the datastream warnings and errors in your Adverity workspace. You can find datastream issues in the following ways:

• Set up notifications so that Adverity will inform you about errors and warnings

• See warnings and errors relating to all datastreams in the task monitor in the Activity page

• Click the Warnings or Failed tab in the overview of a datastream (shown below) to see warnings or errors relating to this datastream

  

Viewing details of the data quality issues in your data extract

To view the data that does not meet your monitoring rules, follow these steps:

1. Open the datastream overview or Activity page and find the task with data quality issues.

2. Click the task overview for the task with the Data Quality error or warning.

3. Above the data extract, you will see Data Quality errors and warnings for specific monitors.

   In the selected data quality issue box above the data extract, click View details. In the details window, you can see the following information:

   Duplicate data checks

   Adverity displays the duplicate rows found in your data extract and the number of times they occur.

   You can download the duplicate rows at the bottom of the window.

   

   Custom monitors

   Adverity displays the rows in your data extract that violate each of the defined rules and the number of times the violation occurs.