Integration
Connect crates.io to ScrapFly
When something happens in crates.io, your agent does the next thing in ScrapFly. Describe it and it is built, tested on every scenario and kept running.
What the catalog holds today. Ask for anything missing and your agent reads the API documentation and adds it.
Build solutions, not workarounds.
What do you want crates.io and ScrapFly to do together?
Ask the assistant
Connect your AI client
Give your AI client this address.
https://mcp.apiant.aiAny client that takes a remote MCP server. Nothing to install. Create your free account, then sign in once in your browser.
Set it up in your client
Claude Code
Run this in the directory you want to work in.
claude mcp add --transport http -s project apiant-ai https://mcp.apiant.aiStart Claude Code there, approve the server, and sign in in the browser page it opens.
Claude Code guide (opens in a new tab)Claude, web and desktop
Open Customize, then Connectors, then Add custom connector, and paste the address. On Team and Enterprise an owner adds it first.
Setup guide (opens in a new tab)Cursor
Add the address to your MCP configuration as a server URL. Cursor signs you in in your browser.
Setup guide (opens in a new tab)Zed
Open Settings, then AI, then MCP Servers, then Add Server, then Add Remote Server.
Setup guide (opens in a new tab)Codex and the ChatGPT desktop app
Open Settings, then MCP servers, then Add server, and choose Streamable HTTP. From the terminal, Codex takes the address with its own add command and then signs you in.
Setup guide (opens in a new tab)Any other MCP client
Paste the address where the client asks for a remote MCP server URL, and name the server apiant-ai where it lets you. APIANT's skills reach the client over the same connection.
Setup guide (opens in a new tab)Example flows
What crates.io can start in ScrapFly
When New crate in crates.io
then Add crawl in ScrapFly
When New crate version in crates.io
then Send Web Scraping API Request in ScrapFly
Starting points drawn from the triggers and actions in the catalog today. Describe the flow you need, at any depth, and your agent builds it and tests every scenario before it ships.
Everything your agent can do with crates.io and ScrapFly
Triggers and actions 2 triggers · 15 actions
Trigger
New crateFires when a new crate is registered on crates.io.
Trigger
New crate versionFires when any crate publishes a new version.
Action
Find crates by categorySearch crates.io within a given category slug.
Action
Find crates by nameSearch crates.io for crates matching a query string.
Action
Get crateGet metadata for a single crate by name.
Action
Get crate downloadsGet download counts (daily history + totals) for a crate.
Action
Get crate versionGet metadata for one specific version of a crate.
Action
Get crate version readmeGet the rendered README HTML for a specific crate version.
Action
List categoriesList all crates.io categories with descriptions and crate counts.
Action
List crate versionsList all published versions of a crate.
Action
Add crawlStart a recursive website crawl job.
Action
AI Data ExtractionAutomatically extract structured data from any text content such as HTML, Text, Markdown using AI, LLM and custom parsing instructions.
Action
Get crawl artifactDownloads the finished archive of a crawl: a WARC file (compressed web archive with every request and response) or a HAR file (JSON HTTP archive). The artifact is only available once the crawl has finished.
Action
Get crawl statusRetrieve the status/progress of a previously started crawl.
Action
Scrape PageScrapes a web page through the Scrapfly Web Scraping API and returns its content, the upstream status and scrape metadata.
Action
Screenshot Web PageCaptures a screenshot of a web page with ScrapFly's Screenshot API and returns the URL where the stored image can be downloaded.
Action
Send Web Scraping API RequestSends a request to any web page through Scrapfly's Web Scraping API, with your choice of HTTP method, request body and custom headers, and returns the scraped content along with the scrape details.
No trigger or action matches that. Ask your agent to add it: it reads the API documentation and builds what you describe.
Each app on its own
Reviews
What our customers say
More from crates.io
crates.io to PostmanPostman is a platform for building and testing APIs.
crates.io to HubSpotHubSpot is your all-in-one stop for all of your marketing software needs.
crates.io to SalesforceSalesforce is a leading enterprise customer relationship management (CRM) platform.
crates.io to SlackSlack is a messaging platform for teams. Post messages, manage channels, users, reminders, and react to...
crates.io to Google CalendarGoogle Calendar is a time management tool providing scheduling features, event reminders, and integration...
crates.io to Google DriveGoogle Drive is a cloud storage solution for uploading, sharing, and collaborating on files across devices...
More into ScrapFly
HubSpot to ScrapFlyHubSpot is your all-in-one stop for all of your marketing software needs.
Salesforce to ScrapFlySalesforce is a leading enterprise customer relationship management (CRM) platform.
Slack to ScrapFlySlack is a messaging platform for teams. Post messages, manage channels, users, reminders, and react to...
Google Sheets to ScrapFlyGoogle Sheets
Gmail to ScrapFlyGmail is Google’s email service, featuring spam protection, search functions, and seamless integration with...
Google Calendar to ScrapFlyGoogle Calendar is a time management tool providing scheduling features, event reminders, and integration...
Questions
crates.io and ScrapFly, answered
What can start an automation from crates.io?
Any of crates.io's 2 triggers in the catalog, including New crate and New crate version. Describe the moment in plain language and your agent picks the right one.
What can your agent do in ScrapFly when something happens in crates.io?
Any of ScrapFly's 7 actions, including Send Web Scraping API Request, Add crawl, AI Data Extraction and Get crawl artifact. Your agent maps the data both ways and tests every scenario before it ships.
Can it also run from ScrapFly to crates.io?
ScrapFly has no triggers in the catalog today, so automations start in crates.io. If you need the other direction, ask: your agent reads ScrapFly's API documentation and adds it.
Do I have to build a connector for crates.io or ScrapFly?
No. Both are in the catalog with their triggers and actions. You describe the automation; your agent builds it, tests every scenario and keeps it running.
What happens when something fails?
Your agent works that out for you. It plans the failure paths along with the happy path, then tests every scenario before it ships.
Is there a free plan?
Yes. Every plan includes the agent, including free, and building from your own AI client spends no assistant credits.