Azure Cosmos DB (NoSQL)

Azure Cosmos DB is a fully managed NoSQL and vector database offering high availability, scalability, and low latency for modern app development.

Features

Feature name	Supported
Column Hashing	True	Column level
Blocking	True	Column level
Incremental	True
Custom data	True
History	False
ReSync	True	Table level
Templates	False

🔧 Setup Guide

Whitelist Weld's IP pool

Requests from Weld will always come from the following IP pool:

3.64.84.139
3.65.119.169
35.156.133.78

We recommend that you only allow public network access to selected networks for Azure Cosmos DB. Make sure to whitelist all three of these IP's within your network policies. If any updates to the list are ever scheduled to happen, you will be contacted by Weld via email.

Step 1 - Get credentials to setup the connection

From your Azure portal, access and paste the required fields:

Name (The name you want to refer to regarding this connection in the Weld app)
URI (The URI of your Azure Cosmos DB, found in the Azure portal)
Primary Key (The Primary Key of your Azure Cosmos DB, found in the Azure portal. Go to your Azure Cosmos DB account, select "Settings", then "Keys" to find the Primary Key)

Step 2 - Configure the data sync

Select the database you would like to sync
Weld automatically detects the available databases in your Azure Cosmos DB database. Choose the one you would like to sync data from.
Select sync mode

Unpacked Mode
Weld unpacks one layer of nested fields and infers the data types. Unpacked mode will return your table in the following format:
```
{
  "id": 1,
  "type": 2,
  "nested": {
    "name": 3
  }
}
```
is delivered to your destination as

id type nested _ts
1 2 {"name":3} 2023-10-01 12:00:00

Packed Mode
Selecting packed mode will return your table in the following format:
```
{
  "id": 1,
  "type": 2,
  "nested": {
    "name": 3
  }
}
```
is delivered to your destination as

id data _ts
1 {"id":1, "type":2, nested":{"name":3}} 2023-10-01 12:00:00

id	type	nested	_ts
1	2	`{"name":3}`	2023-10-01 12:00:00

id	data	_ts
1	`{"id":1, "type":2, nested":{"name":3}}`	2023-10-01 12:00:00

Step 3 - Data To Sync

Tables can always be updated in the configuration settings of the sync.

Select the tables you wish to include in the sync.
You can view the schema, remove columns or hash sensitive information.

Weld will automatically add the built in ts column from Azure Cosmos DB to your table. This column is used to track the last updated time of each row in the table.

Step 4 - Configure Sync

Select how often you would like the data to sync.
Provide a unique destination table name.

Weld will take over from here and commence syncing data from your Azure Cosmos DB database.