dbt Cloud

dbt Cloud is a cloud-based service that provides a managed environment for running dbt projects. It allows you to schedule and run dbt jobs, manage your dbt models, and collaborate with your team.

With Weld, you can set up a dbt Cloud integration to automatically sync your dbt models with your destination, handling the data transformation and loading processes for you.

Setup Guide

Prerequisites

You will need a dbt Cloud account with the following:

  • API access (only available for Team or Enterprise plans).
  • One or more transformation projects.

Step 1: Find your API server region

Depending on your API server URL, the region is either us, eu or au. You can find this information in your dbt Cloud account settings or by checking the URL:

  • us: https://cloud.getdbt.com
  • eu: https://emea.dbt.com
  • au: https://au.dbt.com

Alternatively, if you have custom dbt cloud URL, please provide it here. Leave empty if you are using the default URL. For example: if your URL is https://ti014.us1.dbt.com, then input: ti014

Step 2: Create token

You can find out more about service account tokens in the dbt Cloud documentation.

  1. Go to your dbt Cloud account settings.

  2. Click on Account settings.

  3. Click on Service tokens and select + Create service token.

  4. After clicking on + Add, enter the token name and select the following permissions:

    • Member for accounts on the Team plan
    • Developer for accounts on the Enterprise plan

  5. In the Project dropdown, choose All projects.

  6. Click on Save to generate the token and make a note of it.

Step 3: Set up the dbt Cloud integration in Weld

  1. Go to the Settings page in Weld and click on External Tools.

  2. Select dbt cloud from the list.

  3. Enter the following details:

    • Name: A name for the integration.
    • Token: The token you generated in Step 2.
    • DBT cloud region: The region of your dbt Cloud API server.
    • Account prefix: For custom dbt cloud URLs. Leave empty if you are using the default URL.

  4. Click on Save to complete the setup.

Step 4: Sync your dbt jobs

Once you have set up the dbt Cloud integration in Weld, you can sync your dbt jobs to start transforming and loading your data. To do so, follow these steps:

  1. Go to the Orchestration page in Weld.
  2. Click on + Add Orchestration
  • Orchestration Name: A name for the orchestration.
  • Frequency: The frequency at which the orchestration should run.
  1. In the Webhooks section, select Create webhook:
  • Name: A name for the webhook.
  • External system: Select DBT Cloud.
  • Select dbt job: Choose the dbt job you want to sync.
  • Select job(s) to run after: Choose the job(s) to run after the selected job.
  1. Click on Save to create the webhook.

That's it! Your dbt job will now be synced with Weld, and you can monitor its progress on the Orchestration page.

Was this page helpful?