Using dbt Core with Weld
Weld currently does not offer a direct connection to dbt Core. At the moment you can configure your workspace to reflect that dbt Core is your transformation tool of choice. This article outlines what is currently possible, what to expect in the future, and how to configure your Weld project accordingly.
Current State: No Direct Connection
As of now, dbt Core and Weld are completely disconnected.
- You cannot connect dbt Core to Weld directly.
- There is no webhook or automated communication between dbt Core and Weld.
- Weld does not trigger dbt runs or receive signals from dbt Core.
- However, both tools can still operate independently on the same data warehouse, allowing a functional and efficient data pipeline.
Even without a direct connection, here's how you can use Weld + dbt Core together:
-
Weld ingests and loads data into your data warehouse.
-
dbt Core reads from the same warehouse and handles:
- SQL transformations
- Data modeling
- Documentation
- Testing
Configuration in Weld
To reflect that you're using dbt Core select dbt Core as your Transformation Tool which will hide the Weld Transformation UI, making it clear that transformations are handled externally.
To do this, go to Settings, click Account, then choose dbt Core.
No further setup is needed within Weld to use dbt Core. All transformation logic should live in your dbt project outside Weld.
Future Updates
We plan to support webhooks or triggers in the future that will allow Weld to communicate with dbt Core. This would open possibilities such as:
- Triggering dbt runs after a Weld load completes
- Sending metadata between tools
- Better visibility into the end-to-end transformation flow
Stay tuned for updates as these features become available.