Loading data into Adverity Data Storage

This guide explains how to load data into Adverity Data Storage to use it in Adverity.

Introduction

Adverity Data Storage contains data that you have collected using your datastreams, provided you have enabled Adverity Data Storage for your datastreams. You can work with the data that you have loaded into Adverity Data Storage in the Use Data platform area. For example, you can visualize this data in Data Explorer and Dashboards or send it to BI tools using data shares.

You do not need to load data into Adverity Data Storage in order to load it into external destinations.

Prerequisites

Before you complete the procedure in this guide, perform all of the following actions:

Make sure that all dimensions and metrics you want to load into Adverity Data Storage and use in Adverity are mapped.

Loading data into Adverity Data Storage

To load data from a datastream into Adverity Data Storage, follow these steps:

  1. Select the workspace you work with in Adverity and then, in the platform navigation menu, click Datastreams.

  2. Open the datastream that contains the data you want to use in Adverity.

  3. Enable the toggle for Adverity Data Storage.

  4. To load data extracts into Adverity Data Storage, select one of the following options:

    • Fetch new data extracts.

    • Re-load existing data extracts.

      To re-load the latest data fetch, in the All tasks tab, find the top element, and in the Load section, click Re-load.

As a result, the data you have fetched (a new data extract or a re-loaded data extract) has been loaded into Adverity Data Storage.

  1. To start using your data in Adverity, in the Adverity Data Storage section of the datastream overview:

    • Click Explore data to analyze data from this datastream in Data Explorer. For more information, see Introduction to Data Explorer.

    • Click Go to data shares to configure sending your data to BI tools using data shares.

Configuring advanced Adverity Data Storage settings

To configure your settings for loading data into Adverity Data Storage, follow these steps:

  1. Select the workspace you work with in Adverity and then, in the platform navigation menu, click Datastreams.

  2. Open the datastream that contains the data you want to analyze in Data Explorer & Dashboards.

  3. In the Adverity Data Storage section, click Actions to the right of the Adverity Data Storage toggle.

  4. Click Settings.

  5. In the drop-down menu, select a date column from the data extract to be used as the date column in Adverity Data Storage.

    The values in the date column must be in YYYY-MM-DD format. Adverity will not recognize other date formats and they will not appear in the drop-down menu.

  6. Select how you want to load your data into Adverity Data Storage. The following options are available:

    • Overwrite specific dates (default)

      Select this option to delete existing rows for the dates present in the new data extract from Adverity Data Storage and add the new rows for these dates. This option only overwrites rows for the dates in the new data extract. If a row already exists for a date that is within the data extract's date range, but there are no new rows for this date, the existing data row for this date will not be deleted.

      For example, if you have already loaded data for January 1 to January 20 into Adverity Data Storage, and now want to load data for January 15 to January 31 into Adverity Data Storage, the following changes will be made:

      • The existing data for January 1 to January 14 will stay in your data extract and will not be changed.

      • The existing data for January 15 to January 20 will be deleted and overwritten with your new data.

      • The new data for January 21 to January 31 will be loaded into Adverity Data Storage.

      As a result, you will only have one set of values for each date from January 1 to January 31.

    • Append

      Select this option to add the rows from the new data extract to the existing rows in Adverity Data Storage.

      For example, if you have already loaded data for January 1 to January 20 into Adverity Data Storage, and now want to load data for January 15 to January 31 into Adverity Data Storage, the following changes will be made:

      • The existing data for January 1 to January 20 will stay in your data extract and will not be changed.

      • The new data for January 15 to January 31 will be loaded into Adverity Data Storage.

      As a result, you will have one set of values for January 1 to January 14, and for January 21 to January 31. However, you will have two sets of values for January 15 to January 20.

    • Overwrite (truncate)

      Select this option to delete all existing rows fetched using this datastream from Adverity Data Storage and add the rows from the new data extract.

      For example, if you have already loaded data for January 1 to January 20 into Adverity Data Storage, and now want to load data for January 15 to January 31 into Adverity Data Storage, the following changes will be made:

      • The existing data for January 1 to January 20 will be deleted from Adverity Data Storage.

      • The new data for January 15 to January 31 will be loaded into Adverity Data Storage.

      As a result, you will have no values for January 1 to January 14, and one set of values for January 15 to January 31.

    Adverity Data Storage settings with visual examples of each setting

  7. Click Save.

Deleting data from Adverity Data Storage

Stored data is removed from Adverity Data Storage in the following cases:

Overwriting previously stored data

To replace previously stored data when loading new data into Adverity Data Storage, select an appropriate setting.

For more information, see Configuring advanced Adverity Data Storage settings.

Deleting a datastream

Stored data is deleted from Adverity Data Storage, when you delete a datastream from which the data was loaded.

For more information, see Deleting datastreams.

Video guide: How to load data into Adverity Data Storage or an external destination

This video guide explains how to load your data into Adverity Data Storage.

What's next?

Use data loaded into Adverity Data Storage in Data Explorer & Dashboards. For more information, see: