Web Scraper Connector

Start for free View documentation

4.8 on G2

Weld · Data Sources

Web ScraperYour warehouseLive

Pick the tables to sync, and they appear here with their status.

Lands in

Queryable over MCP

How it works

Set up in minutes.
No code, no maintenance.

Web Scraper

Data source

Authenticating...

Ready to connect

Overview

Web Scraper in your warehouse.
Ready for your agents.

With Weld, you can seamlessly replicate data from a web scraper to any destination or warehouse for easy analysis and reporting. A web scraper extracts data from websites by sending HTTP requests, retrieving content, and parsing the required information. Weld then syncs this data automatically, ensuring it stays up to date and ready for use in your analytics workflows. Weld's Web Scraper connector is fully managed: it extracts data from Web Scraper, loads it into your warehouse, and keeps it in sync. The data lands in a clean, documented schema with agent context attached, so analysts can query it with SQL or dbt, and agents can query it over the Weld MCP server without guessing at tables or joins.

Weld MCP server

Ask your agent.
It can reach Web Scraper.

Connect Claude, Cursor, ChatGPT or your own agent to Weld over MCP. It finds the Web Scraper tables Weld has synced and queries your warehouse.

DiscoverSynced tables, columns and freshness
QuerySQL against your warehouse
OperateCheck, rerun and refresh syncs

Set up the MCP server

Claude CodeOpus 5

ConnectedWeld MCP

Which Web Scraper tables do we have, and which one is the largest?

Looking up what the Web Scraper connection has synced.

●weld·search_available_references

⎿raw.web_scraper.*

tables, columns and freshness

●weld·get_reference_schema

⎿columns, types and nullability

●weld·run_query

⎿select count(*) from {{raw.web_scraper.…}}

submitted

●weld·get_query_status

⎿DONE

●weld·get_query_result

⎿rows returned

✓Answered from Web Scraper data in your warehouse

>Ask about your Web Scraper dataMCP

Destinations

Load Web Scraper into any warehouse.
Set up in minutes, no code.

Resources

Everything you need.
To get started.

Documentation

Web Scraper setup guide

Step-by-step instructions to configure and start syncing.

MCP server

Connect your agents

Set up Claude, Cursor, ChatGPT or Codex against your Weld workspace.

Weld Connect API

Build custom connectors

Use the Weld Connect API to build and publish your own connector.

FAQ

Common questions

Answers to frequently asked questions about Weld connectors.

Weld Connect API

Set it up in code.
One REST API.

Use the Weld Connect REST API to create Web Scraper connections, configure ELT syncs, and manage pipelines entirely through code. Built for embedding, automation, and CI/CD workflows.

Explore Weld Connect API reference

POST/elt_syncs

# Create a Web Scraper ELT sync
curl -X POST https://connect.weld.app/elt_syncs \
  -H "x-api-key: $API_KEY" \
  -d '{
    "connection_id": "conn_abc123",
    "integration_id": "web-scraper",
    "destination_schema_name": "web-scraper_data",
    "sync_interval": "0 * * * *"
  }'
▌