Loading data into Adverity Data Storage

This guide explains how to load data into Adverity Data Storage to use it in Adverity.

Introduction

Adverity Data Storage is an internal destination into which you can load data that you have collected using your datastreams. You need to load data into Adverity Data Storage in order to send it to some external destinations. This is noted in the destination guides where relevant.

This video guide explains how to load your data into Adverity Data Storage.

Prerequisites

Before you complete the procedure in this guide, perform all of the following actions:

  • Fetch data using this datastream.

Make sure that all dimensions and metrics you want to load into Adverity Data Storage and use in Adverity are mapped.

Loading data into Adverity Data Storage

To load data from a datastream into Adverity Data Storage for the first time, follow these steps:

  1. Go to the Datastreams page.

  2. Click the datastream that contains the data you want to use in Adverity.

  3. In the Load section of the datastream overview, enable the Adverity Data Storage toggle.

As a result, the data you have already fetched in this datastream will be loaded into Adverity Data Storage. From now on, the settings you selected in this process will be used every time you fetch new data and load it from this datastream into Adverity Data Storage.

Configuring Adverity Data Storage settings

To change how you load data into Adverity Data Storage, follow these steps:

  1. Go to the Datastreams page.

  2. Click the datastream that contains the data you want to use in Adverity.

  3. In the Load section of the datastream overview, next to the Adverity Data Storage toggle, click Actions, then Settings.

  4. In the dialog box that opens, select whether the datastream contains time-series data. Adverity will recommend settings based on this selection.

    Time-series data means any data that is linked to a specific date or time, e.g. the number of clicks on a specific day. Time-series data contains a date column, which is used to overwrite data for existing dates and times in Adverity Data Storage.

  5. If you selected Yes, this datastream contains time-series data, select the date column you want to use when loading data into Adverity Data Storage.

    The values in the date column must be in YYYY-MM-DD format. Adverity will not recognize other date formats and they will not appear in the drop-down menu.

  6. Select how you want to load new data from this datastream into Adverity Data Storage. For detailed explanations of the available options, see Understanding Adverity Data Storage data storage options.

    • Overwrite specific days (recommended for time-series data)

    • Append all new rows

    • Overwrite all rows (recommended for non time-series data)

  7. Click Save & re-load data.

  8. Enable the toggle for Adverity Data Storage.

  9. In the pop-up window, click Save & re-load data if you want to load your previously collected data into Adverity Data Storage. The following data extracts will be loaded:

    • All data extracts with the status collected if no other destinations are enabled for the datastream

    • All data extracts with the status loaded if the data extracts have already been sent to Adverity Data Storage or external destinations

    Alternatively, click Skip to re-load the data extracts manually. For more information, see Re-loading a data extract.

Understanding Adverity Data Storage data storage options

There are three options to choose from when you decide how to load your data into Adverity Data Storage. These are explained in the list and illustration below.

Overwrite specific days

If data for a specific date already exists in Adverity Data Storage and you load new data for this date into Adverity Data Storage, the existing data for this date is replaced with the new data. Any other existing data stays the same.

This is recommended for time-series data because you will not have more than one row of data for each date. For example, if you collect data about the number of clicks per day on an advert, this option will result in one row of the most recent data for each day in your stored data.

Append all new rows

All rows of data in your new data extract are added to the existing rows of data in Adverity Data Storage. No existing data is overwritten or deleted.

Overwrite all rows

All existing rows of data in Adverity Data Storage are deleted and replaced with your new data extract.

This is recommended for non time-series data because it avoids the possibility of loading duplicate data into Adverity Data Storage.

Deleting data from Adverity Data Storage

Stored data is removed from Adverity Data Storage in the following cases:

Overwriting previously stored data

To replace previously stored data when loading new data into Adverity Data Storage, select an appropriate setting.

For more information, see Understanding Adverity Data Storage data storage options.

Deleting a datastream

Stored data is deleted from Adverity Data Storage when you delete the datastream from which the data was loaded.

For more information, see Managing datastreams.