Running a dbt project

Running a dbt project#

Note

This feature is in beta stage. To join the beta program, please reach out to ux-research@adverity.com.

You can easily apply your dbt transformations to the selected data warehouse in Adverity. Both manual runs and scheduled jobs are supported.

Adverity executes the dbt run command when a job run is triggered.

In Adverity, dbt jobs can be executed in parallel. The initial limitation is one job per project. For organizations requiring greater concurrency, please contact your Account Manager or Support to explore options for unlocking additional parallel runs.

Prerequisites#

Note

This feature is available only to users with Administrator permissions in the root workspace of your organization.

Before you complete the procedure in this guide, perform all the following actions:

Starting a single dbt project run#

To run a dbt project in Adverity manually, follow these steps:

  1. Go to the dbt Projects page.

  2. Click on the name of the dbt project that you want to run.

  3. Click image1 Run.

As a result, the dbt project run is started and will appear in the Job runs section of the page.

Executing additional commands#

Additional commands such as dbt deps and dbt docs can be executed from Adverity.

To execute them when running a dbt project from Adverity, follow these steps:

  1. Go to the dbt Projects page.

  2. Click on the name of the dbt project that you want to configure.

  3. In the Commands section, enable the respective toggle.

As a result, the selected command will be executed with the project run.

When the dbt docs command is enabled, you can download the generated docs in the job run logs.

Creating a scheduled job#

To create a schedule for dbt runs, follow these steps:

  1. Go to the dbt Projects page.

  2. Click on the name of the dbt project that you want to schedule.

  3. In the Scheduling section, enable the toggle.

  4. Click + Add schedule.

  5. Select the schedule type:

    • Add schedule by time

    • Add schedule on datastream load

      Project’s schedule can be configured based only on one datastream load at a time.

  6. Depending on the schedule type, configure either the execution time or select the datastream.

  7. Configure advanced execution parameters from the following options:

    Run all resources

    Select this option to run the job based on the full default configuration.

    Run custom resources

    Select this option to use dbt’s selection syntax to specify the models, tags, or folders for the scheduled job runs. For more information, see the dbt documentation

  8. Click Add schedule.

As a result, the selected project will be executed on schedule.

Viewing job run logs#

To view the logs for a specific job run, follow these steps:

  1. Go to the dbt Projects page.

  2. Find the job run you are interested in one of the following ways:

    • Open the Job runs tab and find the job run using the filters.

    • Open the selected dbt project and find the runs associated with it in the Job runs section.

  3. Click the row of the specific run.

  4. (Optional) Click image2 Copy log to copy the execution log.

Contents