Collecting data from Google Search Console

This guide explains how to collect data from Google Search Console. To learn how to collect data from a different data source, go back to the Available data sources in Adverity overview.

Introduction

For a list of the fields that you can collect from Google Search Console, see Google Search Console.

Limitations

Collecting data from Google Search Console comes with the following limitations:

Google Search Console keeps data for the last 16 months. You cannot fetch older data.
Data is available in Google Search Console approximately 48 hours after it is collected by Google Search Console.

Creating a datastream to collect data from Google Search Console

The basics of creating a datastream to collect data from any data source are explained in our guide to Creating a datastream. This guide contains information about the specific steps to create a datastream to fetch data from Google Search Console.

Authorization: Allow Adverity to access Google Search Console

If you choose Access using your credentials or Access using someone else's credentials, in Set up or edit Site URLs, you or the person granting access must choose one of the following options:
- Choose Grant access to all Site URLs, including those created in the future to allow Adverity to access all existing Site URLs and all Site URLs created in the future.
- Choose Select specific Site URLs to which you want to grant access to determine the specific Site URLs that you want Adverity to access. Adverity will not automatically have access to Site URLs created in the future. You will need to grant Adverity access to any Site URLs created in the future.
If you use your credentials to grant Adverity access to Google Search Console, all the Site URLs available to you using your credentials will be visible in the Authorizations page to all Adverity users with permission to edit this authorization.

If someone else uses their credentials to grant Adverity access to Google Search Console, the same applies to the Site URLs available using their credentials.

This is important to consider if you do not want all Adverity users with permission to edit the authorization to be able to see the details of the Site URLs. For more information about user permissions, see Managing user permissions.

Configuration: Choose the data you want to collect from Google Search Console

To choose what data to collect and customize the Google Search Console datastream configuration, follow these steps:

(Optional) Rename your datastream.

In Report type, select the type of data to collect from Google Search Console.

In Site URLs, select the websites for which to collect data. If you do not select any items in a drop-down list, Adverity collects data for all items in the drop-down list.

In Dimensions, change the list of fields that you want to see in your data extract. If you select the dimension searchAppearance, you cannot select any other dimension value.

For information on configuring other Google Search Console fields, see Advanced Google Search Console tips.

What's next?

Apply Data Mapping to your collected data to harmonize data collected from different sources in Adverity.
Transform your data to meet your needs by creating and applying enrichments to your datastream.
Load your data into Adverity Data Storage to send it to BI tools using data shares
Load your data into an external destination of your choice

Advanced Google Search Console tips

Configuring data collection from Google Search Console

In the Settings tab of your Google Search Console datastream overview, you can configure a number of additional settings:

Search type

Select the Google search type for which to collect data. This option only has an effect if you select Search Analytics in the Report type field.

Aggregation type

To specify how Adverity aggregates the collected data, select one of the following options:

(Default) Select Auto (Let the service decide) to let Google Search Console decide the appropriate aggregation type.
Select Aggregate values by URI to aggregate data by page.
Select Aggregate values by property to aggregate data by property.

For more information on aggregating Google Search Console data, see the Google documentation.

Filters

To include only specific dimension values in the data extract, specify dimension filters in JSON format. You can use the operators contains, equals, notContains, notEquals. For more information, see the Google documentation.

An example is shown below.

[
    {
        "dimension": "column1",
        "operator": "notContains",
        "expression": "value1"
    },
    {
        "dimension": "column1",
        "operator": "notContains",
        "expression": "value2"
    },
    {
        "dimension": "column2",
        "operator": "contains",
        "expression": "value3"
    }
]

Include preliminary data

Select this checkbox to collect the most recent data which has not yet been confirmed. This is usually data from the last three days. For more information, see the Google documentation.

Discrepancies between totals

When you specify dimensions in your data collection from Google Search Console and later aggregate the values, the totals might be different from the totals you would see if you collected data without specifying dimensions. For more information, see the Google documentation.