Loading data into Adverity Data Storage

This guide explains how to load data into Adverity Data Storage to use it in Adverity.

Introduction

Adverity Data Storage contains data that you have collected using your datastreams, provided you have enabled Adverity Data Storage for your datastreams. You can work with the data that you have loaded into Adverity Data Storage in the Use Data platform area. For example, you can visualize this data in Data Explorer and Dashboards or send it to BI tools using data shares.

You do not need to load data into Adverity Data Storage in order to load it into external destinations.

Prerequisites

Before you complete the procedure in this guide, perform all of the following actions:

Make sure that all dimensions and metrics you want to load into Adverity Data Storage and use in Adverity are mapped.

Loading data into Adverity Data Storage

To load data from a datastream into Adverity Data Storage for the first time, follow these steps:

  1. Select the workspace you work with in Adverity and then, in the platform navigation menu, click Datastreams.

  2. Open the datastream that contains the data you want to use in Adverity.

  3. Enable the toggle for Adverity Data Storage.

  4. In the dialog box that opens, select whether the datastream contains time-series data. Adverity will recommend Adverity Data Storage settings based on this information.

    Time-series data means any data that is linked to a specific date or time, e.g. the number of clicks on a specific day. Time-series data contains a date column, which is used to overwrite data for existing dates and times in Adverity Data Storage

  5. If you selected Yes, this datastream contains time-series data, select the date column you want to use when loading data into Adverity Data Storage.

    The values in the date column must be in YYYY-MM-DD format. Adverity will not recognize other date formats and they will not appear in the drop-down menu.

  6. Select how you want to load new data from this datastream into Adverity Data Storage. For detailed explanations of the available options, see Understanding Adverity Data Storage data storage options.

    • Overwrite specific days (recommended for time-series data)

    • Append all new rows

    • Overwrite all rows (recommended for non time-series data)

  7. Click Save & re-load data.

As a result, the data you have already fetched in this datastream will be loaded into Adverity Data Storage. From now on, the settings you selected in this process will be used every time you fetch new data and load it from this datastream into Adverity Data Storage.

To start using your data in Adverity, in the Adverity Data Storage section of the datastream overview:

  • Click Explore data to analyze data from this datastream in Data Explorer. For more information, see Introduction to Data Explorer.

  • Click Go to data shares to configure sending your data to BI tools using data shares.

Understanding Adverity Data Storage data storage options

There are three options to choose from when you decide how to load your data into Adverity Data Storage. These are explained in the list and illustration below.

Overwrite specific days

If data for a specific date already exists in Adverity Data Storage and you load new data for this date into Adverity Data Storage, the existing data for this date is replaced with the new data. Any other existing data stays the same.

This is recommended for time-series data because you will not have more than one row of data for each date. For example, if you collect data about the number of clicks per day on an advert, this option will result in one row of the most recent data for each day in your stored data.

Append all new rows

All rows of data in your new data extract are added to the existing rows of data in Adverity Data Storage. No existing data is overwritten or deleted.

Overwrite all rows

All existing rows of data in Adverity Data Storage are deleted and replaced with your new data extract.

This is recommended for non time-series data because it avoids the possibility of loading duplicate data into Adverity Data Storage.

Deleting data from Adverity Data Storage

Stored data is removed from Adverity Data Storage in the following cases:

Overwriting previously stored data

To replace previously stored data when loading new data into Adverity Data Storage, select an appropriate setting.

For more information, see Understanding Adverity Data Storage data storage options.

Deleting a datastream

Stored data is deleted from Adverity Data Storage when you delete the datastream from which the data was loaded.

For more information, see Managing datastreams.

Video guide: How to load data into Adverity Data Storage or an external destination

This video guide explains how to load your data into Adverity Data Storage.

What's next?

Use data loaded into Adverity Data Storage in Data Explorer & Dashboards. For more information, see: