Collecting data from Database

This guide explains how to collect data from Database. To learn how to collect data from a different data source, go back to the Available data sources in Adverity overview.

  • Database can collect a maximum of 1 million rows per single report. To fetch more data than this, split your fetch into smaller date ranges in the Initial Fetch step of creating a datastream.

Creating a datastream to collect data from Database

The basics of creating a datastream to collect data from any data source are explained in our guide to Creating a datastream. This guide contains information about the specific steps to create a datastream to fetch data from Database.

Configuration: Choose the data you want to collect from Database

To choose what data to collect and customize the Database datastream configuration, follow these steps:

  1. (Optional) Rename your datastream.

  1. In Engine, select the SQL engine type from the drop-down list.

  2. In Hostname, enter the hostname of the SQL Database. If you use a port other than the default setting for the selected SQL Database, enter the port in the format hostname:port.

  3. In Database, enter the name of the database from which you want to collect data.

  4. (Optional) In Incremental Fetch Column, enter the name of the column for which to perform incremental fetches. Once the fetch is completed, the field with the placeholder @dt_last_fetch_max is populated with the maximum value collected during the last fetch.

  5. In Connection args, enter the arguments to use to collect data.

  6. In Query, enter the database query to use to collect data. See the helptext beneath the Query field for a list of available placeholders.

What's next?