Databases
Weld can integrate with many different of databases, providing easy to set up, no-code managed data pipelines for easy database replication.
Change Data Capture (CDC)
Change Data Capture (CDC) continuously streams row-level inserts, updates, and deletes from your database into Weld. Instead of scanning whole tables on a schedule, CDC reads a database’s native change stream (for example, transaction logs or change streams) and applies changes to your destination with lower latency and reduced load on the source.
When to use CDC
- You want near real-time replication
- You need reliable deletes and updates
- You want to avoid frequent full-table scans on large tables
How CDC works in Weld
- Weld connects to your database using a dedicated user.
- Weld consumes the database’s change stream for the selected tables/collections.
- Changes are applied to your destination according to your latency/apply settings.
What you’ll typically configure
- Network access (so Weld can reach your database)
- A database user with the right permissions
- The tables/collections to replicate
- A destination schema/dataset and naming settings