App

Webcrawler API integrations

Connect Webcrawler API to any other app, or use it from your AI client over MCP. Webcrawler API is a tool that allows you to convert a webpage or a website into LLM and AI ready data.

Connects with an API keywebcrawlerapi.com
8 actions

What the catalog holds today. Ask for anything missing and your agent reads the API documentation and adds it.

Build solutions, not workarounds.

What do you want to automate with Webcrawler API?

Ask the assistant

You'll sign in before anything runs. What you typed comes with you.

Connect your AI client

Give your AI client this address.

https://mcp.apiant.ai

Any client that takes a remote MCP server. Nothing to install. Create your free account, then sign in once in your browser.

Set it up in your client
Claude Code

Run this in the directory you want to work in.

claude mcp add --transport http -s project apiant-ai https://mcp.apiant.ai

Start Claude Code there, approve the server, and sign in in the browser page it opens.

Claude Code guide (opens in a new tab)
Claude, web and desktop

Open Customize, then Connectors, then Add custom connector, and paste the address. On Team and Enterprise an owner adds it first.

Setup guide (opens in a new tab)
Cursor

Add the address to your MCP configuration as a server URL. Cursor signs you in in your browser.

Setup guide (opens in a new tab)
Zed

Open Settings, then AI, then MCP Servers, then Add Server, then Add Remote Server.

Setup guide (opens in a new tab)
Codex and the ChatGPT desktop app

Open Settings, then MCP servers, then Add server, and choose Streamable HTTP. From the terminal, Codex takes the address with its own add command and then signs you in.

Setup guide (opens in a new tab)
Any other MCP client

Paste the address where the client asks for a remote MCP server URL, and name the server apiant-ai where it lets you. APIANT's skills reach the client over the same connection.

Setup guide (opens in a new tab)

Popular

Webcrawler API with the apps people pair it with most

Pair it

Connect Webcrawler API with another app

What your agent can do with Webcrawler API

Triggers and actions 8 actions

  • Action
    Cancel job

    Cancel a running crawl job.

  • Action
    Convert page to markdown

    LLM-cleaned markdown of a page.

  • Action
    Crawl website

    Start a crawl job for a website.

  • Action
    Get balance

    Get organization credit balance. Docs /docs/api/organization/balance.

  • Action
    Get job

    Get a crawl job by id (status and results).

  • Action
    List job URLs

    List URLs crawled by a job. GET job URLs endpoint, docs /docs/api/urls.

  • Action
    Run agent

    Run a WebCrawlerAPI agent job. Docs /docs/api/agent/agent-run.

  • Action
    Scrape a Web Page

    Get the content of a web page by URL using the v2 API.

Reviews

What our customers say

Questions

Webcrawler API, answered

Is there a Webcrawler API MCP server?

APIANT's MCP server at https://mcp.apiant.ai works with Webcrawler API. Add that address to any AI client that takes a remote MCP server, sign in once in your browser, and your client can build, test and run automations that use Webcrawler API. Nothing to install.

What can your agent do in Webcrawler API?

Any of Webcrawler API's 8 actions, including Convert page to markdown, Crawl website, Get balance and Get job. Your agent maps the data both ways and tests every scenario before it ships.

Which apps can Webcrawler API connect to?

Any app in the catalog; the list on this page pairs Webcrawler API with each of them. If the other app is missing, point your agent at its API documentation and it builds the connector.

What happens when something fails?

Your agent works that out for you. It plans the failure paths along with the happy path, then tests every scenario before it ships.

Is there a free plan?

Yes. Every plan includes the agent, including free, and building from your own AI client spends no assistant credits.