Migrate to your own BigQuery
Move your workspace from Weld managed BigQuery to a BigQuery project you own. Weld copies your synced tables, views and models across and then makes your project the workspace's warehouse, so your data sources, models and syncs carry on where they left off.
You need your own BigQuery to connect BI tools, and to grow past the managed warehouse's limits.
Before you start
- Set up your BigQuery project and a service account for Weld, and download its JSON key. Follow the BigQuery setup guide.
- Choose the data location for your project. Datasets in your project that have the same name as one in Weld must be in that location.
- Rename any tables or views in your project that you want to keep and that have the same name as one Weld manages. Weld overwrites them.
Migrate
- In Weld, open Settings > Data Warehouse (1) and click Migrate Data Warehouse (2).
- Upload the service account's JSON file under Upload your Google Service Key (1). The Project ID fills in from the file.
- Choose the Data Location (2) and click Connect (3).
- Weld checks your project and shows the result in Migration Compatibility Check. Resolve anything it reports, click Re-check compatibility, then click Continue migration.
If the card shows Coming soon, migration isn't turned on for your workspace yet. Contact support and we'll help you move.
The compatibility check
Weld compares your project with what it's about to create:
| Result | What it means |
|---|---|
| No conflicts | Nothing in your project clashes. You can continue. |
| Conflicting tables or views | Your project has tables or views with the same names. Weld overwrites them. Rename them in BigQuery first if you want to keep them. |
| Dataset conflicts | A dataset with the same name exists in another location. Delete or rename it in BigQuery, or choose that location for your Weld data. You can't continue until this is resolved. |
| Imported items | Tables or views you imported into Weld can't be copied. Move them yourself in BigQuery and import them again. Models that depend on them need to be rebuilt afterwards. |
Click an item in the lists to copy its name.
While the migration runs
Weld stops your syncs, copies your tables, views and models, and then switches the workspace to your project. The workspace shows Data Warehouse migration in progress with each step, and you can't make changes until it's done.
How long it takes depends on how much data you have. When it's finished, Weld writes to your project from then on. The Data Warehouse settings page shows the result of the latest migration.
After the migration
- Connect your BI tools. See BI tools.
- Check what the warehouse costs with BigQuery usage insights.
- Partition large tables to keep queries cheap. See BigQuery partitioning.