--- title: "Connect Pipedream to ScrapFly - APIANT.ai" description: "When \"New account\" fires in Pipedream, your agent runs \"Scrape Page\" in ScrapFly." canonical: "https://apiant.ai/connect/pipedream-to-scrapfly" --- # Connect Pipedream to ScrapFly When **New account** fires in [Pipedream](https://apiant.ai/connections/pipedream), your agent runs **Scrape Page** in [ScrapFly](https://apiant.ai/connections/scrapfly). Describe the whole flow and it is built, tested on every scenario and kept running. Pipedream **2** triggers Pipedream **34** actions ScrapFly **7** actions What the catalog holds today. Ask for anything missing and your agent reads the API documentation and adds it. ## What do you want Pipedream and ScrapFly to do together? Give your AI client this address. `https://mcp.apiant.ai` One connection does both: ask your client to act in an app once, or have it build an automation that keeps running. Any client that takes a remote MCP server. Nothing to install. Create your free account, then sign in once in your browser. ### Set it up in your client ### Claude Code Run this in the directory you want to work in. `claude mcp add --transport http -s project apiant-ai https://mcp.apiant.ai` Start Claude Code there, approve the server, and sign in in the browser page it opens. [Claude Code guide (opens in a new tab)](https://apiant.ai/docs/mcp/claude-code) ### Claude, web and desktop Open Customize, then Connectors, then Add custom connector, and paste the address. On Team and Enterprise an owner adds it first. [Setup guide (opens in a new tab)](https://apiant.ai/docs/mcp) ### Cursor Add the address to your MCP configuration as a server URL. Cursor signs you in in your browser. [Setup guide (opens in a new tab)](https://apiant.ai/docs/mcp) ### Zed Open Settings, then AI, then MCP Servers, then Add Server, then Add Remote Server. [Setup guide (opens in a new tab)](https://apiant.ai/docs/mcp) ### Codex and the ChatGPT desktop app Open Settings, then MCP servers, then Add server, and choose Streamable HTTP. From the terminal, Codex takes the address with its own add command and then signs you in. [Setup guide (opens in a new tab)](https://apiant.ai/docs/mcp) ### Any other MCP client Paste the address where the client asks for a remote MCP server URL, and name the server apiant-ai where it lets you. APIANT's skills reach the client over the same connection. [Setup guide (opens in a new tab)](https://apiant.ai/docs/mcp) Example flows ## What Pipedream can start in ScrapFly - When **New account** in Pipedream then **Scrape Page** in ScrapFly - When **New project** in Pipedream then **Screenshot Web Page** in ScrapFly Starting points drawn from the triggers and actions in the catalog today. Describe the flow you need, at any depth, and your agent builds it and tests every scenario before it ships. Everything your agent can do with Pipedream and ScrapFly ## Triggers and actions 2 triggers · 41 actions - Trigger **New account** Fires when a new app account appears in the project. - Trigger **New project** Fires when a new project is created in the workspace. - Action **Create account** Connect an app account on behalf of an end user. - Action **Create connect token** Create a short-lived token that lets an end user connect an account. - Action **Create project** Create a new project in your Pipedream workspace. - Action **Delete account** Disconnect and remove a single connected account. - Action **Delete deployed trigger** Remove a deployed trigger so it stops emitting events. - Action **Delete project** Permanently remove a project from your workspace. - Action **Delete user** Remove an end user and all of their connected accounts. - Action **Deploy trigger** Deploy a trigger for an end user so it starts emitting events. - Action **Get account** Retrieve the details of a single connected account. - Action **Get action** Retrieve the definition of a single action. - Action **Get app** Retrieve the details of a single app in Pipedream's catalog. - Action **Get component** Retrieve the definition of a single component. - Action **Get deployed trigger** Retrieve the details of a single deployed trigger. - Action **Get project** Retrieve the details of a single project. - Action **Get trigger** Retrieve the definition of a single trigger. - Action **List accounts** List the app accounts your end users have connected in a project. - Action **List accounts for user** List the accounts a specific end user has connected. - Action **List actions** Browse the actions available to run for a project's apps. - Action **List apps** Browse the apps available in Pipedream's integration catalog. - Action **List components** Browse the components available in a project. - Action **List deployed triggers** List the triggers currently deployed in a project. - Action **List projects** List the projects in your Pipedream workspace. - Action **List trigger events** Retrieve the recent events emitted by a deployed trigger. - Action **List triggers** Browse the triggers available to deploy for a project's apps. - Action **List users** List the end users who have connected accounts in a project. - Action **Proxy GET request** Send an authenticated GET request to a connected app's API on behalf of an end user. - Action **Proxy PATCH request** Send an authenticated PATCH request to a connected app's API on behalf of an end user. - Action **Proxy POST request** Send an authenticated POST request to a connected app's API on behalf of an end user. - Action **Proxy PUT request** Send an authenticated PUT request to a connected app's API on behalf of an end user. - Action **Run action** Run an app action on behalf of an end user and return its result. - Action **Set trigger webhook** Send a deployed trigger's events to one webhook address, replacing any addresses it currently sends to. - Action **Update deployed trigger** Change the configuration of a deployed trigger. - Action **Update project** Change the name or settings of an existing project. - Action **Validate connect token** Check whether a Connect token is still valid. - Action **Add crawl** Start a recursive website crawl job. - Action **AI Data Extraction** Automatically extract structured data from any text content such as HTML, Text, Markdown using AI, LLM and custom parsing instructions. - Action **Get crawl artifact** Downloads the finished archive of a crawl: a WARC file (compressed web archive with every request and response) or a HAR file (JSON HTTP archive). The artifact is only available once the crawl has finished. - Action **Get crawl status** Retrieve the status/progress of a previously started crawl. - Action **Scrape Page** Scrapes a web page through the Scrapfly Web Scraping API and returns its content, the upstream status and scrape metadata. - Action **Screenshot Web Page** Captures a screenshot of a web page with ScrapFly's Screenshot API and returns the URL where the stored image can be downloaded. - Action **Send Web Scraping API Request** Sends a request to any web page through Scrapfly's Web Scraping API, with your choice of HTTP method, request body and custom headers, and returns the scraped content along with the scrape details. ## Each app on its own - [ **Pipedream** Pipedream is a workflow automation and integration platform.](https://apiant.ai/connections/pipedream) - [ **ScrapFly** ScrapFly is a web scraping API for extracting data from web pages through automatic proxy rotation, managed...](https://apiant.ai/connections/scrapfly) Reviews ## What our customers say ## More from Pipedream - [ **Pipedream to Scrnify** Screenshot and video capture API for rendering web pages as images, GIFs, or MP4.](https://apiant.ai/connect/pipedream-to-scrnify) - [ **Pipedream to Salesforce** Salesforce is a leading enterprise customer relationship management (CRM) platform.](https://apiant.ai/connect/pipedream-to-salesforce) - [ **Pipedream to Slack** Slack is a messaging platform for teams. Post messages, manage channels, users, reminders, and react to...](https://apiant.ai/connect/pipedream-to-slack) - [ **Pipedream to Gmail** Gmail is Google’s email service, featuring spam protection, search functions, and seamless integration with...](https://apiant.ai/connect/pipedream-to-gmail) - [ **Pipedream to Shopify** Shopify is a commerce platform for online stores and retail point-of-sale.](https://apiant.ai/connect/pipedream-to-shopify) - [ **Pipedream to QuickBooks Online** QuickBooks Online accounting — manage customers, invoices, bills, payments, vendors, expenses, and more via...](https://apiant.ai/connect/pipedream-to-quickbooks-online) ## More into ScrapFly - [ **ActiveCampaign to ScrapFly** ActiveCampaign is a marketing automation, email marketing, and CRM platform.](https://apiant.ai/connect/activecampaign-to-scrapfly) - [ **HubSpot to ScrapFly** HubSpot is your all-in-one stop for all of your marketing software needs.](https://apiant.ai/connect/hubspot-to-scrapfly) - [ **Salesforce to ScrapFly** Salesforce is a leading enterprise customer relationship management (CRM) platform.](https://apiant.ai/connect/salesforce-to-scrapfly) - [ **Slack to ScrapFly** Slack is a messaging platform for teams. Post messages, manage channels, users, reminders, and react to...](https://apiant.ai/connect/slack-to-scrapfly) - [ **Google Sheets to ScrapFly** Google Sheets is Google's online spreadsheet app for creating, editing and sharing spreadsheets.](https://apiant.ai/connect/google-sheets-to-scrapfly) - [ **Gmail to ScrapFly** Gmail is Google’s email service, featuring spam protection, search functions, and seamless integration with...](https://apiant.ai/connect/gmail-to-scrapfly) Questions ## Pipedream and ScrapFly, answered ### ### What can start an automation from Pipedream? Any of Pipedream's 2 triggers in the catalog, including New account and New project. Describe the moment in plain language and your agent picks the right one. ### ### What can your agent do in ScrapFly when something happens in Pipedream? Any of ScrapFly's 7 actions, including Send Web Scraping API Request, Add crawl, AI Data Extraction and Get crawl artifact. Your agent maps the data both ways and tests every scenario before it ships. ### ### Can it also run from ScrapFly to Pipedream? ScrapFly has no triggers in the catalog today, so automations start in Pipedream. If you need the other direction, ask: your agent reads ScrapFly's API documentation and adds it. ### ### Do I have to build a connector for Pipedream or ScrapFly? No. Both are in the catalog with their triggers and actions. You describe the automation; your agent builds it, tests every scenario and keeps it running. ### ### Can my AI client use Pipedream and ScrapFly without building an automation? Yes. With your AI client connected to APIANT, ask it to do something in either app once and it runs that action on the spot. Ask for an automation and your agent builds it, tests every scenario and keeps it running. One connection covers both. ### ### What happens when something fails? Your agent works that out for you. It plans the failure paths along with the happy path, then tests every scenario before it ships. ### ### Is there a free plan? Yes. Every plan includes the agent, including free, and building from your own AI client spends no assistant credits.