Orchestration
Weld orchestration feature makes it easier to coordinate the the extraction and transformation of data across your data platform.
By creating a workflow you can choose which ETL syncs, models and reverse ETLs should run in synchronisation with each other
Steps to set up an orchestration workflow
-
Create Workflow
Click Orchestration from the side bar
Click Add Orchestration
Choose how often you would like the orchestration to run
You have now created the workflow.
Next step is to add the data sources you would like to this workflow -
Adding data sources
Click on the data source you would like to add.
In the configure tab select scheduler drop down and choose the orchestration you would like this source to be part of. -
Adding SQL tables
In the Transform section choose the model that you would like to add to the orchestration.
Click Edit schedule, then click table and select the workflow from the scheduler dropdown list. -
Adding Reverse ETL
In the Reverse ETL page press + New to add a new connector into which you want to move your data.