--- title: "Connect Buildkite to Scrappa - APIANT.ai" description: "When \"New build\" fires in Buildkite, your agent runs \"Scrape web page\" in Scrappa." canonical: "https://apiant.ai/connect/buildkite-to-scrappa" --- # Connect Buildkite to Scrappa When **New build** fires in [Buildkite](https://apiant.ai/connections/buildkite), your agent runs **Scrape web page** in [Scrappa](https://apiant.ai/connections/scrappa). Describe the whole flow and it is built, tested on every scenario and kept running. Buildkite **2** triggers Buildkite **12** actions Scrappa **29** actions What the catalog holds today. Ask for anything missing and your agent reads the API documentation and adds it. ## What do you want Buildkite and Scrappa to do together? Give your AI client this address. `https://mcp.apiant.ai` One connection does both: ask your client to act in an app once, or have it build an automation that keeps running. Any client that takes a remote MCP server. Nothing to install. Create your free account, then sign in once in your browser. ### Set it up in your client ### Claude Code Run this in the directory you want to work in. `claude mcp add --transport http -s project apiant-ai https://mcp.apiant.ai` Start Claude Code there, approve the server, and sign in in the browser page it opens. [Claude Code guide (opens in a new tab)](https://apiant.ai/docs/mcp/claude-code) ### Claude, web and desktop Open Customize, then Connectors, then Add custom connector, and paste the address. On Team and Enterprise an owner adds it first. [Setup guide (opens in a new tab)](https://apiant.ai/docs/mcp) ### Cursor Add the address to your MCP configuration as a server URL. Cursor signs you in in your browser. [Setup guide (opens in a new tab)](https://apiant.ai/docs/mcp) ### Zed Open Settings, then AI, then MCP Servers, then Add Server, then Add Remote Server. [Setup guide (opens in a new tab)](https://apiant.ai/docs/mcp) ### Codex and the ChatGPT desktop app Open Settings, then MCP servers, then Add server, and choose Streamable HTTP. From the terminal, Codex takes the address with its own add command and then signs you in. [Setup guide (opens in a new tab)](https://apiant.ai/docs/mcp) ### Any other MCP client Paste the address where the client asks for a remote MCP server URL, and name the server apiant-ai where it lets you. APIANT's skills reach the client over the same connection. [Setup guide (opens in a new tab)](https://apiant.ai/docs/mcp) Example flows ## What Buildkite can start in Scrappa - When **New build** in Buildkite then **Scrape web page** in Scrappa - When **Build finished** in Buildkite then **Find Reddit posts** in Scrappa Starting points drawn from the triggers and actions in the catalog today. Describe the flow you need, at any depth, and your agent builds it and tests every scenario before it ships. Everything your agent can do with Buildkite and Scrappa ## Triggers and actions 2 triggers · 41 actions - Trigger **Build finished** Triggers when a Buildkite build finishes (passed, failed, canceled or otherwise completed). - Trigger **New build** Triggers when a new build is scheduled in a Buildkite pipeline. - Action **Add annotation** Creates an annotation (a Markdown or HTML note) on a Buildkite build, optionally appending to an existing annotation with the same context. - Action **Add build** Creates (triggers) a new build on a Buildkite pipeline for a given commit and branch, and returns the new build. - Action **Add pipeline** Creates a new pipeline in a Buildkite organization from a repository and YAML steps configuration. - Action **Cancel build** Cancels a running or scheduled build in a Buildkite pipeline and returns the updated build. - Action **Delete pipeline** Permanently deletes a pipeline from your Buildkite organization. - Action **Get build** Returns a single build of a Buildkite pipeline by its build number, including its state, commit, jobs and pipeline details. - Action **Get pipeline** Returns a Buildkite pipeline's full details, including its repository, default branch, steps and build counts. - Action **List agents** Returns the connected and stopping agents in a Buildkite organization, optionally filtered by name, hostname, version or queue. - Action **List builds** Returns the builds of a Buildkite pipeline, newest first, optionally filtered by branch, commit, state, creator or date range. - Action **List pipelines** Returns the pipelines in a Buildkite organization, optionally filtered by pipeline name or repository URL. - Action **Rebuild build** Starts a new build that re-runs an existing build of a pipeline, and returns the new build. - Action **Update pipeline** Updates one or more settings of an existing Buildkite pipeline, such as its name, repository, YAML steps or branch filters. - Action **Check domain availability** Checks whether a domain name is registered or available using a registry (RDAP) lookup. - Action **Find Reddit posts** Returns Reddit posts that match the specified search query, optionally restricted to a subreddit. - Action **Find Trustpilot companies** Search Trustpilot for company/business listings matching a query. - Action **Get domain SEO overview (Semrush)** Get Semrush SEO/traffic overview for a domain. - Action **Get Google Maps business details** Fetches the full Google Maps business profile for one place: name, address, phone, website, rating, review counts, opening hours, photos and more. - Action **Get Instagram user** Get an Instagram user's profile data by username. - Action **Get LinkedIn company** Scrapes a public LinkedIn company page and returns its about text, website, industry, size, headquarters, followers, specialties, locations, employees, recent posts, similar pages and funding. - Action **Get LinkedIn profile** Scrape a public LinkedIn profile by URL or member id, including experience, education, articles, skills and more. - Action **Get Reddit post** Get a Reddit post and its metadata by post URL/id. - Action **Get TikTok video** Get metadata for a TikTok video by URL/id. - Action **Get Trustpilot company details** Get ratings, categories, and reputation details for a Trustpilot company. - Action **Get website traffic (SimilarWeb)** Returns SimilarWeb traffic analytics for a domain: global and country rank, engagement metrics, traffic sources, top countries, estimated monthly visits and top keywords. - Action **Get YouTube transcript** Get the transcript/captions for a YouTube video. - Action **Get YouTube video** Gets the details of a YouTube video, including its title, description, view and like counts, channel, chapters and keywords. - Action **List Instagram user posts** Lists the recent posts of a public Instagram account, with captions, hashtags, like and comment counts, media and location. - Action **List Trustpilot company reviews** Get customer reviews for a Trustpilot company. - Action **Scrape web page** Fetch any web page and extract structured data (title, meta, links, emails, phone numbers, images, body text) or clean markdown. - Action **Search Google** Run a Google web search and return organic results, ads, and related questions. - Action **Search Google Images** Search Google Images for a query and return the matching images. - Action **Search Google Jobs** Search Google Jobs listings by query and location. - Action **Search Google Maps places** Searches Google Maps for places matching a query and returns the matching businesses. - Action **Search Google News** Search Google News and return article results. - Action **Search Google Shopping** Search Google Shopping for product listings and pricing. - Action **Search Indeed jobs** Search Indeed job listings by query and location. - Action **Search LinkedIn** Search LinkedIn for people/company/job results matching a query. - Action **Search LinkedIn jobs** Searches LinkedIn job listing pages for the keywords you give and returns the matching job postings. - Action **Search TikTok users** Search TikTok for user accounts matching a query. - Action **Search YouTube** Searches YouTube and returns the matching videos, channels, playlists or movies for a search query. - Action **Translate text** Translates text from one language to another using Google Translate. ## Each app on its own - [ **Buildkite** Buildkite is a platform for running fast, secure, and scalable continuous integration pipelines on your own...](https://apiant.ai/connections/buildkite) - [ **Scrappa** Structured web-scraping API with 80+ JSON data endpoints for sites like Google, Amazon, LinkedIn, and YouTube.](https://apiant.ai/connections/scrappa) Reviews ## What our customers say ## More from Buildkite - [ **Buildkite to HubSpot** HubSpot is your all-in-one stop for all of your marketing software needs.](https://apiant.ai/connect/buildkite-to-hubspot) - [ **Buildkite to Salesforce** Salesforce is a leading enterprise customer relationship management (CRM) platform.](https://apiant.ai/connect/buildkite-to-salesforce) - [ **Buildkite to Slack** Slack is a messaging platform for teams. Post messages, manage channels, users, reminders, and react to...](https://apiant.ai/connect/buildkite-to-slack) - [ **Buildkite to Google Sheets** Google Sheets](https://apiant.ai/connect/buildkite-to-google-sheets) - [ **Buildkite to Gmail** Gmail is Google’s email service, featuring spam protection, search functions, and seamless integration with...](https://apiant.ai/connect/buildkite-to-gmail) - [ **Buildkite to Google Calendar** Google Calendar is a time management tool providing scheduling features, event reminders, and integration...](https://apiant.ai/connect/buildkite-to-google-calendar) ## More into Scrappa - [ **HubSpot to Scrappa** HubSpot is your all-in-one stop for all of your marketing software needs.](https://apiant.ai/connect/hubspot-to-scrappa) - [ **Salesforce to Scrappa** Salesforce is a leading enterprise customer relationship management (CRM) platform.](https://apiant.ai/connect/salesforce-to-scrappa) - [ **Slack to Scrappa** Slack is a messaging platform for teams. Post messages, manage channels, users, reminders, and react to...](https://apiant.ai/connect/slack-to-scrappa) - [ **Google Sheets to Scrappa** Google Sheets](https://apiant.ai/connect/google-sheets-to-scrappa) - [ **Gmail to Scrappa** Gmail is Google’s email service, featuring spam protection, search functions, and seamless integration with...](https://apiant.ai/connect/gmail-to-scrappa) - [ **Google Calendar to Scrappa** Google Calendar is a time management tool providing scheduling features, event reminders, and integration...](https://apiant.ai/connect/google-calendar-to-scrappa) Questions ## Buildkite and Scrappa, answered ### ### What can start an automation from Buildkite? Any of Buildkite's 2 triggers in the catalog, including New build and Build finished. Describe the moment in plain language and your agent picks the right one. ### ### What can your agent do in Scrappa when something happens in Buildkite? Any of Scrappa's 29 actions, including Check domain availability, Find Reddit posts, Find Trustpilot companies and Get domain SEO overview (Semrush). Your agent maps the data both ways and tests every scenario before it ships. ### ### Can it also run from Scrappa to Buildkite? Scrappa has no triggers in the catalog today, so automations start in Buildkite. If you need the other direction, ask: your agent reads Scrappa's API documentation and adds it. ### ### Do I have to build a connector for Buildkite or Scrappa? No. Both are in the catalog with their triggers and actions. You describe the automation; your agent builds it, tests every scenario and keeps it running. ### ### Can my AI client use Buildkite and Scrappa without building an automation? Yes. With your AI client connected to APIANT, ask it to do something in either app once and it runs that action on the spot. Ask for an automation and your agent builds it, tests every scenario and keeps it running. One connection covers both. ### ### What happens when something fails? Your agent works that out for you. It plans the failure paths along with the happy path, then tests every scenario before it ships. ### ### Is there a free plan? Yes. Every plan includes the agent, including free, and building from your own AI client spends no assistant credits.