Databases
Weld syncs tables from your databases into your data warehouse. Pick your database below for its setup guide: how to give Weld network access, the user and permissions to create, and the connection details to enter.
Change Data Capture (CDC)
Change Data Capture (CDC) continuously streams row-level inserts, updates, and deletes from your database into Weld. Instead of scanning whole tables on a schedule, CDC reads a database’s native change stream (for example, transaction logs or change streams) and applies changes to your destination with lower latency and reduced load on the source.
When to use CDC
- You want near real-time replication
- You need reliable deletes and updates
- You want to avoid frequent full-table scans on large tables
How CDC works in Weld
- Weld connects to your database using a dedicated user.
- Weld consumes the database’s change stream for the selected tables/collections.
- Changes are applied to your destination according to your latency/apply settings.
What you’ll typically configure
- Network access (so Weld can reach your database)
- A database user with the right permissions
- The tables/collections to replicate
- A destination schema/dataset and naming settings