Introduction to the Activity page

Introduction

A task is a single process that you perform using one datastream. It always starts with a fetch and can include enriching, storing, and loading the collected data. A task consists of three stages:

Fetch
(Optional) Enrich
(Optional) Load

You can see all tasks performed using a datastream in the datastream overview, or see all the tasks performed in your current workspace in the Activity page.

The Activity page displays an overview of tasks from collecting data to loading data into Adverity Data Storage and destinations. This is called the task monitor.

With the task monitor, you can achieve the following aims:

Receive a high-level overview of your account's activity.
See errors in the pipeline and retry failed tasks.
Display detailed data for each task.
Understand the status of your data batch.
See how much time each task in the pipeline took.

Viewing the task monitor

To view the task monitor, follow these steps:

Select the workspace you work with in Adverity and then, in the platform navigation menu, click Activity.

The three boxes at the top of the page are the task monitor Key Performance Indicator (KPI) boxes.

Successful tasks

The Successful tasks (today) KPI box displays the following:

The number of successful tasks today.
The number of successful tasks compared to yesterday.

This KPI box includes scheduled and manual fetches. Days are based on the user's time zone.

New failed tasks

The New failed tasks (today) KPI box displays the number of tasks that have failed today.

You can acknowledge a failed task. As a result, the task is not displayed in the Failed tab. Acknowledging a failed task does not affect the numbers in the New failed tasks (today) KPI box.

To acknowledge a failed task, follow these steps:

Select the workspace you work with in Adverity and then, in the platform navigation menu, click Activity.
(Optional) Click the Failed tab to view all failed tasks.
Click a failed task in the list.
In the top-right corner of the task box, click Acknowledge.

After you have acknowledged a failed task, you can still see it in the All Issues view. Under the Activity page heading, click All Issues to see a list of all failed tasks.

New warnings

The New warnings KPI box displays the number of tasks that have warnings associated with them. Adverity's datastream warnings inform you about potential problems with your data and datastreams. These problems include the following issues:

Issues that prevent your datastream from fetching data from your chosen data source, such as incorrect datastream configuration settings
Issues that occur while applying an enrichment to your data extract, such as incorrect configuration of the Smart Naming Convention enrichment
Duplicate data rows in your data extracts. For more information, see Finding duplicate data in a datastream.

Displaying tasks of child workspaces

You can display all child workspaces' tasks in the task monitor of the parent workspace.

To do so, follow these steps:

Select the workspace you work with in Adverity and then, in the platform navigation menu, click Administration.
Select the Show tasks of subworkspaces option.

As a result, all of the tasks from the child workspaces are displayed in the task monitor of the parent workspace.

Task Details

Task State

The label at the top explains the overall state of the task. The possible values are the following:

Failed - the task was unsuccessful
Pending - the task has not yet started
Running - the task has started but not yet finished
Completed - the task has finished successfully

Task actions

The following is a list of actions that you can perform by clicking the icons in the top right corner of the task overview.

Refetch: Click Refetch to run the fetch task again. A refetch deletes the data extract from the previous task and creates a new task at the top of the All Tasks panel with a new data extract.
View all extracts: Click View all extracts to show the list of all data extracts for this datastream.
Re-load: Click Re-load to apply enrichments to the data extract and resend the data to the destination. The relevant data in the destination is overwritten. Use Re-load if you make changes to enrichments after a fetch.
Acknowledge: Each failed task has an Acknowledge button. Acknowledged failed tasks are not displayed in the Failed tab.
Fetch: This stage displays the Connector Type, the time range for which data is collected, and the time the task took to finish.
Enrich: This stage displays the progress of data transformation. If you have not specified any enrichments for your data, this stage is skipped.
Load: This stage displays the progress of data being loaded into Adverity Data Storage or the destination. If you have not specified a destination, this stage step is skipped.
Errors & Warning: When a stage fails, errors or warnings are displayed below it. Hover over the error message for more information on the error. To run the failed stage again, click Retry.

Task stages

The three progress bars in the task overview show the status of each stage of a task - fetching data, enriching data, and loading data into Adverity Data Storage and destinations.

Fetch: This stage displays the connector used, the time range for which data is collected, and the time it took to fetch the data in this task.
Enrich: This stage displays the time it took to enrich the data in this task. If you have not assigned any enrichments to this datastream, this stage is skipped.
Load: This stage displays the time it took to load the data in this task into Adverity Data Storage and/or an external destination. If you have not enabled Adverity Data Storage or assigned a destination to this datastream, this stage step is skipped.
Error messages: If a stage fails, an error message is displayed below the progress bar for that stage. Hover over the error message for more information on the error. To run the failed stage again, click Retry.

An example of a successful task - this task involved fetching data from Google Sheets, enriching the data and storing the data in Adverity Data Storage

An example of a task that failed in the enrichment stage - an error message is displayed under the failed stage, and the Acknowledge button appears in the top right corner

Skipped fetches

The task monitor displays a fetch task as Skipped if the fetch collects an empty data extract. A data extract is considered empty if it contains no columns and rows. The fetch task may collect an empty data extract for the following reasons, among others:

The data source contains no data for the date range specified in the fetch. For more information on collecting data, see Manual and scheduled fetches.
An enrichment applied to the datastream filters out all data. For more information on enrichments, see Enriching data in Adverity.