SFTP to Databricks integration

Connect SFTP to Databricks and automatically sync your file storage data.

Get started free SFTP connector

SFTP

Data source

Authenticating...

Ready to connect

CONNECTOR SOURCE

SFTP to Databricks

Connect SFTP to Databricks and automatically sync your file storage data. Weld extracts Files, Folders, and Documents from SFTP, loads them into Databricks, and lets you transform the data using SQL or dbt, no custom scripts required.

Everything you need to get started

SFTP

Setup guide Connector page

Databricks

Setup guide Connector page

Weld Connect API

Set up programmatically

Use the Weld Connect REST API to create SFTP connections, configure ELT syncs, and manage pipelines entirely through code. Built for embedding, automation, and CI/CD workflows.

Explore Weld Connect API reference

POST/elt_syncs

# Create a SFTP ELT sync
curl -X POST https://connect.weld.app/elt_syncs \
  -H "x-api-key: $API_KEY" \
  -d '{
    "connection_id": "conn_abc123",
    "integration_id": "sftp",
    "destination_schema_name": "sftp_data",
    "sync_interval": "0 * * * *"
  }'
▌

FAQs

How do I sync SFTP data to Databricks?

Sign up for Weld, connect SFTP as a source and Databricks as a destination. Weld handles the extraction, loading, and lets you transform data using SQL or dbt.

What SFTP data can I sync to Databricks?

You can sync Files, Folders, and Documents. The available objects depend on your SFTP account permissions and configuration.

How often does Weld sync data from SFTP?

Sync frequency depends on your Weld plan. Schedules range from every 5 minutes to daily intervals. Each sync processes only new and changed data.

Can I transform SFTP data before it lands in Databricks?

Yes. Weld supports SQL-based transformations in the platform and integrates with dbt Cloud. You can clean, join, and model your data before analysis.

Is the SFTP to Databricks integration secure?

Yes. Weld encrypts all data in transit and at rest, is SOC 2 Type II certified, and supports IP whitelisting. Credentials are stored encrypted and never logged.