Databases

Weld can integrate with many different of databases, providing easy to set up, no-code managed data pipelines for easy database replication.


Change Data Capture (CDC)

Change Data Capture (CDC) continuously streams row-level inserts, updates, and deletes from your database into Weld. Instead of scanning whole tables on a schedule, CDC reads a database’s native change stream (for example, transaction logs or change streams) and applies changes to your destination with lower latency and reduced load on the source.

When to use CDC

  • You want near real-time replication
  • You need reliable deletes and updates
  • You want to avoid frequent full-table scans on large tables

How CDC works in Weld

  1. Weld connects to your database using a dedicated user.
  2. Weld consumes the database’s change stream for the selected tables/collections.
  3. Changes are applied to your destination according to your latency/apply settings.

What you’ll typically configure

  • Network access (so Weld can reach your database)
  • A database user with the right permissions
  • The tables/collections to replicate
  • A destination schema/dataset and naming settings

Was this page helpful?