Deployment options
Weld is split into two parts:
- The control plane is the Weld app, the API, scheduling, orchestration and billing. It always runs in Weld's AWS account.
- The data plane is the workers that extract data from your sources, stage it and load it into your warehouse. It's the part that touches your data.
The control plane sends jobs to the data plane and gets their status back, never your data. You can run the data plane in three ways.
| Standard | Private | Bring your own cloud | |
|---|---|---|---|
| Where the data plane runs | Weld's AWS account, shared | Weld's AWS account, dedicated to you | Your AWS account |
| Who runs it | Weld | Weld | Weld, in your account |
| Region | Europe (Frankfurt) | An AWS region you choose | Your AWS region |
| Staging of synced data | Weld's S3, encrypted | A dedicated S3 bucket | Your own S3 bucket |
| Plans | Every plan | Enterprise, on request | Enterprise, on request |
Private and bring-your-own-cloud deployments are set up for each customer on the Enterprise plan, on AWS. They're a project we plan with you, so talk to us about your requirements and timeline.
Standard
Every workspace runs on the standard deployment unless agreed otherwise.
- The data plane runs on shared workers in Weld's AWS account in Frankfurt, Germany.
- Data being synchronised is staged as encrypted files and deleted once the sync has succeeded, and at the latest seven days after it was written.
- Your data lands in your own warehouse.
- On the Enterprise plan, Weld can reach your databases over AWS PrivateLink instead of the public internet.
Private
A data plane that only runs your jobs.
- Dedicated workers and a dedicated staging bucket, used by no other customer.
- Runs in Weld's AWS account, in an AWS region you choose.
- Weld operates, updates and monitors it, as on the standard deployment.
- Combine it with AWS PrivateLink to keep traffic to your databases off the public internet.
Bring your own cloud
The data plane runs in your own AWS account and network, and Weld manages it.
- The workers run in your AWS account and VPC, and stage data in an S3 bucket you own.
- Your data moves from your sources to your warehouse inside your account. Only job status and metadata go to Weld's control plane.
- Weld deploys, updates and monitors the data plane, with access you grant and can review.
- We agree the setup, responsibilities and costs with you before we start.
What stays the same
Whichever deployment you use, you work in the same Weld app, with the same connectors, schedules, orchestrations, Ed and Weld Connect API.