Migrate BigQuery

Weld makes it easy to migrate your BigQuery data to a self-managed BigQuery instance. This guide will walk you through the process.

The Migration works in two steps:

  1. Re-syncing all your data-sources to your new BigQuery, in full sync mode to re-create all tables.
  2. Re-creating all models created with the Weld Modeling tool, in an order based on dependencies.

Weld does not charge for any of the row usage incoured during syncs in the migration process.

This guide assumes you have already created a self-managed BigQuery instance, and have a service account ready. View the BigQuery setup guide

How to migrate

  1. Open the Weld Workspace you want to migrate.
  2. Go to the Workspace Settings page.
  3. Click on the Data Warehouse tab.
  4. Click on the Migrate Data Warehouse button.
  5. Upload the Service account .json file for your self-managed BigQuery instance, and select a data location.
  6. Click Connect, and wait for the migration to complete.
Permission error in Weld.

Migrations may take a while to complete, depending the size and number of data sources in your workspace. Your workspace will be locked from changes during the migration process to ensure all your data is transfered corectly.

Was this page helpful?