Loading data into SAP Database Warehouse Cloud

This guide explains how to load data into SAP Database Warehouse Cloud for further analysis.

Prerequisites

Before you complete the procedure in this guide, perform all of the following actions:

  • Create a datastream whose data you want to load into SAP Database Warehouse Cloud. For more information on creating a datastream, see Creating a datastream.

  • Ensure you can log in to SAP Database Warehouse Cloud.

  • Ensure your SAP account has at least Admin privileges.

  • Determine Adverity's IP address and whitelist it in SAP Database Warehouse Cloud. To find out Adverity's IP Address, contact Adverity support. For more information on whitelisting the IP address, see the SAP documentation.

Procedure

To load data from a datastream into SAP Database Warehouse Cloud, follow these steps:

  1. Add SAP Database Warehouse Cloud as a destination to the workspace which contains the datastream or to one of its parent workspaces.

  2. Assign the SAP Database Warehouse Cloud destination to the datastream.

    You can assign as many destinations to a datastream as you want.

    Some destinations require specific Data Mapping, such as Hubspot and Facebook Offline Conversions. If these Data Mapping requirements conflict, the destinations cannot be assigned to the same datastream.

  3. Configure load settings.

Adding SAP Database Warehouse Cloud as a destination

To add Adverity as a connection within the SAP user interface, follow these steps:

  1. Log in to SAP Data Warehouse Cloud instance.

  2. Click Space Management.

  3. Click on your Adverity space.

  4. Go to the Connections section.

  5. Click to create a new connection. For more information on creating a connection, see the SAP documentation.

  6. Select Adverity from the list of connections.

  7. Enter your Adverity credentials. For more information, see the SAP documentation.

    Choose a workspace where to add the destination. If the selected workspace does not have a destination, the added SAP Data Warehouse Cloud destination is made the default destination. If the selected workspace already has destinations, the SAP Data Warehouse Cloud destination is added to the list of available destinations.

  8. Configure the connection properties. For more information, see the SAP documentation.

As a result, Adverity has been created as a connection in the SAP user interface, and an SAP Database Warehouse Cloud destination is added to your selected workspace.

Assigning SAP Database Warehouse Cloud as a destination

To assign the SAP Database Warehouse Cloud destination to a datastream, follow these steps:

  1. Go to the Datastreams page.

  2. Open the Connector Name datastream by clicking on its name.

  1. In the Load section, click + Add destination.

  1. Select the SAP Database Warehouse Cloud checkbox in the list.

  2. Click Save.

  3. For the automatically enabled destinations, in the pop-up window, click Yes, load data if you want to automatically load your previously collected data into the new destination. The following data extracts will be loaded:

    • All data extracts with the status collected if no other destinations are enabled for the datastream

    • All data extracts with the status loaded if the data extracts have already been sent to Adverity Data Storage or external destinations

    Alternatively, click Skip to continue configuring the destination settings or re-load the data extracts manually. For more information, see Re-loading a data extract.

Configuring settings for loading data into SAP Database Warehouse Cloud

To configure the settings for loading data into SAP Database Warehouse Cloud, follow these steps:

  1. Go to the Datastreams page.

  2. Open the Connector Name datastream by clicking on its name.

  1. In the Load section, find the SAP Database Warehouse Cloud destination in the list, and click Actions on the right.

  2. Click Destination settings.

  1. Fill in the following fields:

    Table name

    Specify the target table in the destination into which to load data from the datastream. The name can contain alphanumeric characters and underscores. For example, target_table. To specify a schema, use the syntax schemaName.tableName.

    The table name provided in Adverity must match the name of the table created in SAP Database Warehouse Cloud.

    By default, Adverity saves data from each datastream in a different table named {datastream_type}_{datastream_id} (for example, mailgun_83).

    You can specify the same target table for several datastreams. If a column is shared between datastreams, Adverity performs a full outer join and concatenates values. If a column is not shared between datastreams, Adverity writes null values in the relevant cells.

    • To create a new SAP Database Warehouse Cloud spreadsheet containing the data you load into SAP Database Warehouse Cloud, enter a name for the new spreadsheet into this field.

    You can use the following placeholders when creating new table names in the destination:

    Placeholder

    Description

    {datastream_id}

    The datastream ID.

    {datastream_type}

    The data source.

    {extract_id}

    The data extract ID.

    {meta[*]}

    Replace * with a metadata placeholder to use metadata in the table name. For example, {meta[datastream_URI]} uses the datastream URI as the table name. For more information on metadata and placeholders, see Using placeholders.

    {name}

    The automatically generated filename of the data extract.

    {scheduled_day}

    The day when the data fetch was scheduled to run.

    {scheduled_month}

    The month when the data fetch was scheduled to run.

    {scheduled_year}

    The year when the data fetch was scheduled to run.

    Truncate

    Select this checkbox to delete all rows from the relevant table in the destination before loading the latest data extract.

    If the Truncate checkbox is selected, the following overwrite conditions are not applied and all data will be deleted.

    If no overwrite options are selected, the loaded data is appended to the destination table.

    Datastream

    Select this checkbox to overwrite all data previously loaded into the destination from this datastream.

    Data loaded from other datastreams is not overwritten.

    Date Range

    Select a date column from your data extract to overwrite all data in the destination with a date that matches a date in this column.

    If the Datastream checkbox is selected, only the data loaded from the current datastream with matching dates will be overwritten.

    Filename

    Select this checkbox to overwrite the relevant data in the destination if a data extract with the same filename already exists in the destination.

    Key Columns

    Select this checkbox to overwrite data in the destination based on the key columns defined in the Data Mapping of the datastream. Adverity executes this overwrite option after all the other overwrite options. When you select this checkbox, the configuration to overwrite data based on dates does not have an effect.

  2. Click Save.