> **Building with AI coding agents?** Install the authstack plugin with one command. This equips your agent with accurate Scalekit implementation patterns.
>
> **Recommended** (the `-y` flags skip prompts, so the command runs without an interactive terminal):
> ```bash
> npx -y @scalekit-inc/cli setup -y
> ```
>
> Global:
> ```bash
> npm install -g @scalekit-inc/cli
> scalekit setup -y
> ```
>
> Supports Claude Code, Cursor, GitHub Copilot, Codex + skills for other Agent Skills-compatible agents in `~/.agents/skills`.
> Skills: integrate-agentkit, implement-saaskit, add-mcp-oauth, implement-sso, implement-scim.
> [Full setup guide](https://docs.scalekit.com/dev-kit/build-with-ai/)

---

# Connect AI agents to Crawlbase

The Crawlbase connector lets your AI agent act in each user's Crawlbase account. Each user connects their own Crawlbase API key once, and Scalekit sends it with every call, so your agent never handles credentials. It comes with 14 tools.

**Authentication:** API Key
**Categories:** Developer Tools, Analytics
**Tools:** 14: 8 read, 4 write, 2 destructive
**Users sign in with:** API key
**Built by:** Scalekit connector
**Try it:** [Playground in the Scalekit dashboard](https://app.scalekit.com/ws/signup?sk_intent=playground&provider=CRAWLBASE)

## Setup

1. ### Install the SDK

   **Node.js**

   ```bash
   npm install @scalekit-sdk/node dotenv
   ```

   **Python**

   ```bash
   pip install scalekit-sdk-python python-dotenv
   ```

2. ### Set your credentials

   Add your Scalekit credentials to your `.env` file. Find values in **[app.scalekit.com](https://app.scalekit.com)** > **Developers** > **API Credentials**.

   ```sh title=".env"
   SCALEKIT_ENVIRONMENT_URL=<your-environment-url>
   SCALEKIT_CLIENT_ID=<your-client-id>
   SCALEKIT_CLIENT_SECRET=<your-client-secret>
   ```

3. ### Create the Crawlbase connection

   In **AgentKit > Connections**, create a Crawlbase connection. The name you give it is the `connection_name` your code passes. See [Configure connections](/agentkit/connections/).

4. ### Authorize a user and make your first call

   **Node.js** (`quickstart.mts`)

   ```typescript
   import { ScalekitClient } from '@scalekit-sdk/node'
   import 'dotenv/config'
   import { createInterface } from 'node:readline/promises'

   const scalekit = new ScalekitClient(
     process.env.SCALEKIT_ENVIRONMENT_URL,
     process.env.SCALEKIT_CLIENT_ID,
     process.env.SCALEKIT_CLIENT_SECRET,
   )
   const actions = scalekit.actions

   const connector = 'crawlbase'
   const identifier = 'user_123'

   // Generate an authorization link for the user
   const { link } = await actions.getAuthorizationLink({ connectionName: connector, identifier })
   console.log('Authorize Crawlbase:', link)
   const rl = createInterface({ input: process.stdin, output: process.stdout })
   await rl.question('Press Enter after authorizing...')
   rl.close()

   // Make your first call
   const result = await actions.executeTool({
     connector,
     identifier,
     toolName: 'crawlbase_storage_get',
     toolInput: {},
   })
   console.log(result)
   ```

   ```bash
   npx tsx quickstart.mts
   ```

   **Python** (`quickstart.py`)

   ```python
   import os
   from scalekit import ScalekitClient
   from dotenv import load_dotenv
   load_dotenv()

   scalekit_client = ScalekitClient(
       env_url=os.getenv("SCALEKIT_ENVIRONMENT_URL"),
       client_id=os.getenv("SCALEKIT_CLIENT_ID"),
       client_secret=os.getenv("SCALEKIT_CLIENT_SECRET"),
   )
   actions = scalekit_client.actions

   connection_name = "crawlbase"
   identifier = "user_123"

   # Generate an authorization link for the user
   link_response = actions.get_authorization_link(
       connection_name=connection_name,
       identifier=identifier,
   )
   print("Authorize Crawlbase:", link_response.link)
   input("Press Enter after authorizing...")

   # Make your first call
   result = actions.execute_tool(
       tool_input={},
       tool_name="crawlbase_storage_get",
       connection_name=connection_name,
       identifier=identifier,
   )
   print(result)
   ```

   ```bash
   python quickstart.py
   ```

   Each user opens the link once and enters their Crawlbase credentials there. See [Authorize a user](/agentkit/tools/authorize/) for the full flow and statuses.

## Tools

Pass the exact name to `execute_tool`, with an input like each tool's example. To ask for a tool that's missing, use the [request form](https://scalekitsupport.portal.usepylon.com/forms/request-a-connector-tool).

**Node.js**

```typescript
const result = await actions.executeTool({
  toolName: 'crawlbase_account_usage_get',
  toolInput: {
    product: 'crawling-api',
  },
  connector: 'crawlbase',
  identifier: 'user_123',
})
```

**Python**

```python
result = actions.execute_tool(
    tool_name="crawlbase_account_usage_get",
    tool_input={
        "product": "crawling-api",
    },
    connection_name="crawlbase",
    identifier="user_123",
)
```

`result.data` is the app's response as JSON, and `result.execution_id` (`executionId` in Node.js) is the ID of the call.

### `crawlbase_account_usage_get`

Get Account Usage · Read-only

Get this month's usage statistics for one Crawlbase product.
Returns totalSuccess, totalFailed, totalDue, remainingCredits (subscription products) and domainStats per domain.
Use this to monitor credit consumption. Rate limited to 1 request every 5 minutes, so cache the result.

Read only: yes. Destructive: no. Idempotent (safe to retry): yes.

Inputs:

- `product` (`string`, required): Product whose usage to return. Example: crawling-api. One of: `crawling-api`, `crawler`, `smartproxy`, `scraper-api`, `leads-api`, `screenshot-api`.
- `previous_month` (`boolean`, optional): Set to true to include the previous month's statistics too. Example: true.

Example input: `{"product":"crawling-api"}`

### `crawlbase_page_crawl`

Crawl Page · Read-only

Fetch any web page through Crawlbase's proxy network, with optional headless-browser rendering, anti-bot bypass and geo-routing.
Returns, with the default format json, an object with cb_status, original_status, url, body (the page HTML) and rid when stored; format html returns raw HTML and format md returns Markdown.
Use this for raw page content. Use crawlbase_page_markdown_get for clean article text, crawlbase_page_scrape for structured data from a supported site and crawlbase_page_crawl_async for slow pages.

Read only: yes. Destructive: no. Idempotent (safe to retry): yes.

Inputs:

- `url` (`string`, required): Full URL of the page to crawl, including http:// or https://. The platform URL-encodes it. Example: https://www.example.com/products/123.
- `ajax_wait` (`boolean`, optional): Set to true to wait until the page's network is idle before capturing. JavaScript rendering only. Example: true.
- `cookies` (`string`, optional): Cookies to forward to the site, in Cookie header form. Example: session=abc123; theme=dark.
- `cookies_session` (`string`, optional): Sticky cookie session name, up to 32 characters. Calls sharing the value replay cookies set by earlier calls. Sessions expire 300 seconds after the last call. Example: checkout-flow-1.
- `country` (`string`, optional): Two-letter country code to route the crawl through that country's exit nodes. Supported: AE, BR, CA, CN, DE, DK, ES, FI, FR, GB, IL, JP, KZ, MD, NL, PK, PL, RU, SE, TR, UA, US. Leave empty for automatic selection; Crawlbase may override it for some sites. Example: US.
- `css_click_selector` (`string`, optional): CSS selector to click before capturing; separate several with a pipe to click them in order. If a selector is missing the request fails with cb_status 595, so add ,body as a fallback. JavaScript rendering only. Example: #load-more,body.
- `custom_success_codes` (`string`, optional): Comma-separated HTTP status codes from the site to treat as success instead of retrying. These requests are charged. Example: 403,429.
- `device` (`string`, optional): Device class whose User-Agent and viewport to emulate. Default desktop. Example: mobile. One of: `desktop`, `tablet`, `mobile`.
- `format` (`string`, optional): Response envelope: json (page plus metadata, default for this tool), html (raw page) or md (GitHub-flavored Markdown). Example: json. One of: `json`, `html`, `md`. Default: `json`.
- `get_cookies` (`boolean`, optional): Set to true to include the site's Set-Cookie values (as original_set_cookie). Example: true.
- `get_headers` (`boolean`, optional): Set to true to include the site's response headers (under original_headers with format json). Example: true.
- `height` (`integer`, optional): Screenshot height in pixels with mode viewport. Example: 800.
- `javascript` (`boolean`, optional): Set to true to render the page in a headless browser with the account's JavaScript token, even when connected with the normal token. Billed as a JavaScript request. Needed for page_wait, ajax_wait, scroll and css_click_selector unless the connection uses the JavaScript token. Example: true.
- `mode` (`string`, optional): With screenshot true, viewport captures only the visible area (see width and height); the default is the full page. Example: viewport. One of: `viewport`.
- `page_wait` (`integer`, optional): Milliseconds to wait after page load before capturing. JavaScript rendering only. Example: 2000.
- `pretty` (`boolean`, optional): Set to true to pretty-print the JSON envelope. Example: false.
- `request_headers` (`string`, optional): Headers to forward to the site, pipe-separated name:value pairs. Example: accept-language:en-GB|accept-encoding:gzip.
- `screenshot` (`boolean`, optional): Set to true to also capture a JPEG of the rendered page; its temporary screenshot_url (valid one hour) comes back in the JSON. JavaScript rendering only. Example: true.
- `scroll` (`boolean`, optional): Set to true to scroll to the bottom before capturing, to trigger lazy loading. JavaScript rendering only; billed by processing time. Example: true.
- `scroll_interval` (`integer`, optional): Maximum seconds to spend scrolling when scroll is true, up to 60. Default 10. Example: 10.
- `store` (`boolean`, optional): Set to true to also save the result in Crawlbase Cloud Storage and get back an rid for crawlbase_storage_get. Example: true.
- `tor_network` (`boolean`, optional): Set to true to route over the Tor network, for .onion sites only. Example: false.
- `user_agent` (`string`, optional): Override the User-Agent header sent to the site. Use sparingly; the defaults are tuned per site. Example: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0 Safari/537.36.
- `width` (`integer`, optional): Screenshot width in pixels with mode viewport. Example: 1200.

Example input: `{"url":"<url>"}`

### `crawlbase_page_markdown_get`

Get Page as Markdown · Read-only

Fetch a web page through Crawlbase and convert it to GitHub-flavored Markdown, optionally keeping only the main article content.
Returns the page as Markdown text.
Use this to read articles, docs or blog posts as clean LLM context. Use crawlbase_page_crawl for HTML or metadata.

Read only: yes. Destructive: no. Idempotent (safe to retry): yes.

Inputs:

- `url` (`string`, required): Full URL of the page to crawl, including http:// or https://. The platform URL-encodes it. Example: https://www.example.com/products/123.
- `ajax_wait` (`boolean`, optional): Set to true to wait until the page's network is idle before capturing. JavaScript rendering only. Example: true.
- `cookies` (`string`, optional): Cookies to forward to the site, in Cookie header form. Example: session=abc123; theme=dark.
- `cookies_session` (`string`, optional): Sticky cookie session name, up to 32 characters. Calls sharing the value replay cookies set by earlier calls. Sessions expire 300 seconds after the last call. Example: checkout-flow-1.
- `country` (`string`, optional): Two-letter country code to route the crawl through that country's exit nodes. Supported: AE, BR, CA, CN, DE, DK, ES, FI, FR, GB, IL, JP, KZ, MD, NL, PK, PL, RU, SE, TR, UA, US. Leave empty for automatic selection; Crawlbase may override it for some sites. Example: US.
- `css_click_selector` (`string`, optional): CSS selector to click before capturing; separate several with a pipe to click them in order. If a selector is missing the request fails with cb_status 595, so add ,body as a fallback. JavaScript rendering only. Example: #load-more,body.
- `device` (`string`, optional): Device class whose User-Agent and viewport to emulate. Default desktop. Example: mobile. One of: `desktop`, `tablet`, `mobile`.
- `javascript` (`boolean`, optional): Set to true to render the page in a headless browser with the account's JavaScript token, even when connected with the normal token. Billed as a JavaScript request. Needed for page_wait, ajax_wait, scroll and css_click_selector unless the connection uses the JavaScript token. Example: true.
- `md_readability` (`boolean`, optional): Set to true (default) to drop navigation, sidebars, footers and ads and keep the main content before converting. Example: true. Default: `true`.
- `page_wait` (`integer`, optional): Milliseconds to wait after page load before capturing. JavaScript rendering only. Example: 2000.
- `request_headers` (`string`, optional): Headers to forward to the site, pipe-separated name:value pairs. Example: accept-language:en-GB|accept-encoding:gzip.
- `scroll` (`boolean`, optional): Set to true to scroll to the bottom before capturing, to trigger lazy loading. JavaScript rendering only; billed by processing time. Example: true.
- `scroll_interval` (`integer`, optional): Maximum seconds to spend scrolling when scroll is true, up to 60. Default 10. Example: 10.
- `user_agent` (`string`, optional): Override the User-Agent header sent to the site. Use sparingly; the defaults are tuned per site. Example: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0 Safari/537.36.

Example input: `{"url":"<url>"}`

### `crawlbase_page_scrape`

Scrape Page Data · Read-only

Fetch a page from a supported site and extract structured JSON with one of Crawlbase's built-in scrapers, or auto-detect the page type.
Returns the scraper's parsed fields as JSON (for example title, price, rating and reviews for a product page).
Use this for Amazon, Google, eBay, LinkedIn, Instagram, Facebook, TikTok and other supported pages. Use crawlbase_page_crawl for unsupported sites.

Read only: yes. Destructive: no. Idempotent (safe to retry): yes.

Inputs:

- `url` (`string`, required): Full URL of the page to scrape, including https://, for a site the chosen scraper supports. Example: https://www.example.com/products/123.
- `ajax_wait` (`boolean`, optional): Set to true to wait until the page's network is idle before capturing. JavaScript rendering only. Example: true.
- `autoparse` (`boolean`, optional): Set to true to detect the page type and apply the matching scraper automatically. Example: true.
- `cookies` (`string`, optional): Cookies to forward to the site, in Cookie header form. Example: session=abc123; theme=dark.
- `cookies_session` (`string`, optional): Sticky cookie session name, up to 32 characters. Calls sharing the value replay cookies set by earlier calls. Sessions expire 300 seconds after the last call. Example: checkout-flow-1.
- `country` (`string`, optional): Two-letter country code to route the crawl through that country's exit nodes. Supported: AE, BR, CA, CN, DE, DK, ES, FI, FR, GB, IL, JP, KZ, MD, NL, PK, PL, RU, SE, TR, UA, US. Leave empty for automatic selection; Crawlbase may override it for some sites. Example: US.
- `css_click_selector` (`string`, optional): CSS selector to click before capturing; separate several with a pipe to click them in order. If a selector is missing the request fails with cb_status 595, so add ,body as a fallback. JavaScript rendering only. Example: #load-more,body.
- `device` (`string`, optional): Device class whose User-Agent and viewport to emulate. Default desktop. Example: mobile. One of: `desktop`, `tablet`, `mobile`.
- `javascript` (`boolean`, optional): Set to true to render the page in a headless browser with the account's JavaScript token, even when connected with the normal token. Billed as a JavaScript request. Needed for page_wait, ajax_wait, scroll and css_click_selector unless the connection uses the JavaScript token. Example: true.
- `page_wait` (`integer`, optional): Milliseconds to wait after page load before capturing. JavaScript rendering only. Example: 2000.
- `request_headers` (`string`, optional): Headers to forward to the site, pipe-separated name:value pairs. Example: accept-language:en-GB|accept-encoding:gzip.
- `scraper` (`string`, optional): Built-in scraper to apply, for example amazon-product-details, amazon-serp, google-serp, ebay-product, linkedin-profile, linkedin-company, instagram-profile, facebook-page, tiktok-profile or email-extractor. Leave empty and set autoparse to detect it. Full list: https://crawlbase.com/docs/scrapers. Example: amazon-product-details.
- `scroll` (`boolean`, optional): Set to true to scroll to the bottom before capturing, to trigger lazy loading. JavaScript rendering only; billed by processing time. Example: true.
- `scroll_interval` (`integer`, optional): Maximum seconds to spend scrolling when scroll is true, up to 60. Default 10. Example: 10.
- `user_agent` (`string`, optional): Override the User-Agent header sent to the site. Use sparingly; the defaults are tuned per site. Example: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0 Safari/537.36.

Example input: `{"url":"<url>"}`

### `crawlbase_storage_get`

Get Stored Page · Read-only

Get a page saved in Crawlbase Cloud Storage, by request id or by original URL.
Returns the stored page; with format json an object with the body and its metadata (url, original_status, rid, stored date).
Use this to read async crawls, crawler results or pages crawled with store true. Send rid or url. Retrieval is free.

Read only: yes. Destructive: no. Idempotent (safe to retry): yes.

Inputs:

- `format` (`string`, optional): Response envelope: json (body plus metadata, default for this tool) or html. Example: json. One of: `json`, `html`. Default: `json`.
- `rid` (`string`, optional): Request id returned when the page was stored. Send this or url. Example: a1B2c3D4e5F6.
- `url` (`string`, optional): Original URL of the stored page; returns the latest stored version. Send this or rid. Example: https://www.example.com/products/123.

Example input: `{}`

### `crawlbase_storage_rids_list`

List Stored Page IDs · Read-only

List the request ids of pages in your Crawlbase Cloud Storage, newest first by default, with scroll pagination.
Returns an array of rids and, when scroll is true, a scroll_id for the next page.
Use this to inventory stored results before crawlbase_storage_bulk_get. A scroll_id expires after about 15 seconds of inactivity.

Read only: yes. Destructive: no. Idempotent (safe to retry): yes.

Inputs:

- `limit` (`integer`, optional): Maximum number of rids to return, up to 10000. Set this explicitly; there is no default. Example: 100.
- `scroll` (`boolean`, optional): Set to true on the first call to start a scroll session and get a scroll_id. Example: true.
- `scroll_id` (`string`, optional): scroll_id from the previous response, to get the next page. Do not send scroll with it. Example: dXVlcnlUaGVuRmV0Y2g7.
- `scroll_order` (`string`, optional): Order by stored time: desc (newest first, default) or asc. Example: desc. One of: `asc`, `desc`.

Example input: `{}`

### `crawlbase_storage_total_count_get`

Get Stored Page Count · Read-only

Get how many pages are currently in your Crawlbase Cloud Storage.
Returns a single integer count.
Use this to check storage size. Use crawlbase_storage_rids_list to list the ids.

Read only: yes. Destructive: no. Idempotent (safe to retry): yes.

Inputs: none.

Example input: `{}`

### `crawlbase_user_agents_get`

Get Random User Agents · Read-only

Get random, realistic browser User-Agent strings for crawling outside Crawlbase.
Returns one or more User-Agent strings.
Use this only for your own crawlers; crawlbase_page_crawl already rotates User-Agents. Free, limited to 1 request a second.

Read only: yes. Destructive: no. Idempotent (safe to retry): yes.

Inputs:

- `device` (`string`, optional): Device class to pick User-Agents for. Default desktop. Example: mobile. One of: `desktop`, `tablet`, `mobile`.
- `size` (`integer`, optional): Number of User-Agents to return, 1 to 10. Default 1. Example: 5.

Example input: `{}`

### `crawlbase_crawler_url_push`

Push URL to Crawler · Write

Add a URL to one of your Enterprise Crawler queues so Crawlbase crawls it in the background.
Returns rid for the queued URL.
Use this to feed a crawler created in the Crawlbase console; results go to that crawler's webhook or to Cloud Storage (read them with crawlbase_storage_get). Push rate is capped at 30 URLs a second.

Read only: no. Destructive: no. Idempotent (safe to retry): no.

Inputs:

- `crawler` (`string`, required): Name of an Enterprise Crawler created in the Crawlbase console. Example: product-monitor.
- `url` (`string`, required): Full URL to enqueue, including https://. Example: https://www.example.com/products/123.
- `callback_headers` (`string`, optional): Custom header to add to the webhook delivery, as Name|value, for example to authenticate it. Example: X-Webhook-Token|s3kret.
- `country` (`string`, optional): Two-letter country code to route the crawl through that country's exit nodes. Supported: AE, BR, CA, CN, DE, DK, ES, FI, FR, GB, IL, JP, KZ, MD, NL, PK, PL, RU, SE, TR, UA, US. Leave empty for automatic selection; Crawlbase may override it for some sites. Example: US.
- `device` (`string`, optional): Device class whose User-Agent and viewport to emulate. Default desktop. Example: mobile. One of: `desktop`, `tablet`, `mobile`.
- `format` (`string`, optional): Shape of the delivered result: html or json. Example: json. One of: `html`, `json`.

Example input: `{"crawler":"<crawler>","url":"<url>"}`

### `crawlbase_page_crawl_async`

Crawl Page Asynchronously · Write

Queue a page crawl and return immediately with a request id instead of waiting for the page.
Returns rid. The result goes to the callback URL if set, otherwise it is stored in Cloud Storage.
Use this for slow or heavy pages, then read the result with crawlbase_storage_get by rid. Use crawlbase_page_crawl to wait for the page inline.

Read only: no. Destructive: no. Idempotent (safe to retry): no.

Inputs:

- `url` (`string`, required): Full URL of the page to crawl, including http:// or https://. The platform URL-encodes it. Example: https://www.example.com/products/123.
- `ajax_wait` (`boolean`, optional): Set to true to wait until the page's network is idle before capturing. JavaScript rendering only. Example: true.
- `callback` (`string`, optional): Webhook URL that receives the crawl result. Leave empty to keep the result in Cloud Storage. Example: https://example.com/hooks/crawlbase.
- `cookies` (`string`, optional): Cookies to forward to the site, in Cookie header form. Example: session=abc123; theme=dark.
- `cookies_session` (`string`, optional): Sticky cookie session name, up to 32 characters. Calls sharing the value replay cookies set by earlier calls. Sessions expire 300 seconds after the last call. Example: checkout-flow-1.
- `country` (`string`, optional): Two-letter country code to route the crawl through that country's exit nodes. Supported: AE, BR, CA, CN, DE, DK, ES, FI, FR, GB, IL, JP, KZ, MD, NL, PK, PL, RU, SE, TR, UA, US. Leave empty for automatic selection; Crawlbase may override it for some sites. Example: US.
- `css_click_selector` (`string`, optional): CSS selector to click before capturing; separate several with a pipe to click them in order. If a selector is missing the request fails with cb_status 595, so add ,body as a fallback. JavaScript rendering only. Example: #load-more,body.
- `device` (`string`, optional): Device class whose User-Agent and viewport to emulate. Default desktop. Example: mobile. One of: `desktop`, `tablet`, `mobile`.
- `format` (`string`, optional): Envelope of the delivered result: html or json. Example: json. One of: `html`, `json`.
- `javascript` (`boolean`, optional): Set to true to render the page in a headless browser with the account's JavaScript token, even when connected with the normal token. Billed as a JavaScript request. Needed for page_wait, ajax_wait, scroll and css_click_selector unless the connection uses the JavaScript token. Example: true.
- `page_wait` (`integer`, optional): Milliseconds to wait after page load before capturing. JavaScript rendering only. Example: 2000.
- `request_headers` (`string`, optional): Headers to forward to the site, pipe-separated name:value pairs. Example: accept-language:en-GB|accept-encoding:gzip.
- `scroll` (`boolean`, optional): Set to true to scroll to the bottom before capturing, to trigger lazy loading. JavaScript rendering only; billed by processing time. Example: true.
- `scroll_interval` (`integer`, optional): Maximum seconds to spend scrolling when scroll is true, up to 60. Default 10. Example: 10.
- `user_agent` (`string`, optional): Override the User-Agent header sent to the site. Use sparingly; the defaults are tuned per site. Example: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0 Safari/537.36.

Example input: `{"url":"<url>"}`

### `crawlbase_page_post`

Send POST Through Crawlbase · Write

Send a JSON POST request to a URL through Crawlbase's proxy network and anti-bot handling.
Returns the target's response body; metadata such as original_status comes in response headers.
Use this for JSON APIs or GraphQL endpoints you are allowed to call. Works with the normal token only; Crawlbase suspends accounts that use POST for spam or abuse.

Read only: no. Destructive: no. Idempotent (safe to retry): no.

Inputs:

- `body` (`object`, required): JSON object to send to the target unchanged. Example: {"query": "{ viewer { login } }"}
- `url` (`string`, required): Full URL of the endpoint to send the POST to, including https://. Example: https://www.example.com/products/123.
- `country` (`string`, optional): Two-letter country code to route the crawl through that country's exit nodes. Supported: AE, BR, CA, CN, DE, DK, ES, FI, FR, GB, IL, JP, KZ, MD, NL, PK, PL, RU, SE, TR, UA, US. Leave empty for automatic selection; Crawlbase may override it for some sites. Example: US.
- `custom_success_codes` (`string`, optional): Comma-separated HTTP status codes from the site to treat as success instead of retrying. These requests are charged. Example: 403,429.
- `device` (`string`, optional): Device class whose User-Agent and viewport to emulate. Default desktop. Example: mobile. One of: `desktop`, `tablet`, `mobile`.
- `get_headers` (`boolean`, optional): Set to true to include the site's response headers (under original_headers with format json). Example: true.

Example input: `{"body":{},"url":"<url>"}`

### `crawlbase_storage_bulk_get`

Get Stored Pages in Bulk · Write

Get up to 100 stored pages from Cloud Storage by request id in one call, optionally deleting them as they are returned.
Returns an array with one object per found rid; each body is base64-encoded gzip data.
Use this to drain many crawler results at once. Use crawlbase_storage_get for one readable page.

Read only: no. Destructive: no. Idempotent (safe to retry): no.

Inputs:

- `rids` (`array`, required): Request ids to fetch, at most 100; extra ids are ignored. Example: ["a1B2c3D4e5F6", "g7H8i9J0k1L2"]
- `auto_delete` (`boolean`, optional): Set to true to delete each returned page from storage in the same call. Example: false.

Example input: `{"rids":["a1B2c3D4e5F6","g7H8i9J0k1L2"]}`

### `crawlbase_storage_bulk_delete`

Delete Stored Pages in Bulk · Destructive

Permanently delete several pages from Crawlbase Cloud Storage by request id.
Returns an array with status true for each deleted rid, or status false with result Not Found.
Use this to clean up stored results. Deletion cannot be undone; use crawlbase_storage_delete for a single page.

Read only: no. Destructive: yes. Idempotent (safe to retry): no.

Inputs:

- `rids` (`array`, required): Request ids of the stored pages to delete. Example: ["a1B2c3D4e5F6", "g7H8i9J0k1L2"]

Example input: `{"rids":["a1B2c3D4e5F6","g7H8i9J0k1L2"]}`

### `crawlbase_storage_delete`

Delete Stored Page · Destructive

Permanently delete one page from Crawlbase Cloud Storage by request id.
Returns success, or an error of Not Found when the rid is not in storage.
Use crawlbase_storage_bulk_delete for many pages. Deletion cannot be undone.

Read only: no. Destructive: yes. Idempotent (safe to retry): yes.

Inputs:

- `rid` (`string`, required): Request id of the stored page to delete. Example: a1B2c3D4e5F6.

Example input: `{"rid":"<rid>"}`

## Related

Other Developer Tools connectors ([all 200](/agentkit/connectors/?category=developer-tools)):

- [GitHub](/agentkit/connectors/github/): Scalekit connector, OAuth, 217 tools
- [Datadog](/agentkit/connectors/datadog/): Scalekit connector, API key, 105 tools
- [Linear](/agentkit/connectors/linear/): Scalekit connector, OAuth, 64 tools


---

## More Scalekit documentation

| Resource | What it contains | When to use it |
|----------|-----------------|----------------|
| [/llms.txt](/llms.txt) | Structured index with routing hints per product area | Start here — find which documentation set covers your topic before loading full content |
| [/llms-full.txt](/llms-full.txt) | Complete documentation for all Scalekit products in one file | Use when you need exhaustive context across multiple products or when the topic spans several areas |
| [sitemap-0.xml](https://docs.scalekit.com/sitemap-0.xml) | Full URL list of every documentation page | Use to discover specific page URLs you can fetch for targeted, page-level answers |
