Skip to content
Scalekit Docs
Talk to an Engineer Dashboard

Connect AI agents to GroqCloud

Scalekit connector
Open markdown

The GroqCloud connector lets your AI agent act in each user's GroqCloud account. Each user connects their own GroqCloud access token once, and Scalekit sends it with every call, so your agent never handles credentials. It comes with 12 tools.

Tools
12
What they doRead · write · destructive
7 · 3 · 27 read3 write2 destructive
Users sign in with

Setup

  1. Install the SDK

    Terminal window
    npm install @scalekit-sdk/node dotenv
  2. Set your credentials

    Add your Scalekit credentials to your .env file. Find values in app.scalekit.com > Developers > API Credentials.

    .env
    SCALEKIT_ENVIRONMENT_URL=<your-environment-url>
    SCALEKIT_CLIENT_ID=<your-client-id>
    SCALEKIT_CLIENT_SECRET=<your-client-secret>
  3. Create the GroqCloud connection

    In AgentKit > Connections, create a GroqCloud connection. The name you give it is the connection_name your code passes. See Configure connections.

  4. Authorize a user and make your first call

    quickstart.mts
    import { ScalekitClient } from '@scalekit-sdk/node'
    import 'dotenv/config'
    import { createInterface } from 'node:readline/promises'
    const scalekit = new ScalekitClient(
    process.env.SCALEKIT_ENVIRONMENT_URL,
    process.env.SCALEKIT_CLIENT_ID,
    process.env.SCALEKIT_CLIENT_SECRET,
    )
    const actions = scalekit.actions
    const connector = 'groq'
    const identifier = 'user_123'
    // Generate an authorization link for the user
    const { link } = await actions.getAuthorizationLink({ connectionName: connector, identifier })
    console.log('Authorize GroqCloud:', link)
    const rl = createInterface({ input: process.stdin, output: process.stdout })
    await rl.question('Press Enter after authorizing...')
    rl.close()
    // Make your first call
    const result = await actions.executeTool({
    connector,
    identifier,
    toolName: 'groq_batches_list',
    toolInput: {},
    })
    console.log(result)
    Terminal window
    npx tsx quickstart.mts

    Each user opens the link once and enters their GroqCloud credentials there. See Authorize a user for the full flow and statuses.

Tools

Pass the exact name to execute_tool
Try in PlaygroundRequest a tool
  • groq_batch_getGet a batch job's status and progress.Read-only

    Get Batch

    Get a batch job's status and progress. Returns id, status, input_file_id, output_file_id, error_file_id, request_counts (total, completed, failed) and timestamps. Use groq_file_content_get on output_file_id to read results once status is completed.

    Inputs

    batch_idstringrequired
    ID of the batch. Example: batch_01jh6xa7reempvjyh6n3yst2zw.
  • groq_batches_listList your organization's batch jobs.Read-only

    List Batches

    List your organization's batch jobs. Returns data with each batch's id, status, input_file_id, output_file_id, request_counts and timestamps. Use groq_batch_get for one batch.

    Inputs

    This tool takes no inputs.

  • groq_file_content_getDownload the contents of a file, such as a batch's JSONL output or error file.Read-only

    Get File Content

    Download the contents of a file, such as a batch's JSONL output or error file. Returns the raw file content (JSON Lines for batch files). Use this after groq_batch_get shows an output_file_id.

    Inputs

    file_idstringrequired
    ID of the file to download. Example: file_01jh6x76wtemjr74t1fh0faj5t.
  • groq_file_getGet one file's metadata.Read-only

    Get File

    Get one file's metadata. Returns id, object, bytes, created_at, filename and purpose. Use groq_file_content_get for its contents.

    Inputs

    file_idstringrequired
    ID of the file. Example: file_01jh6x76wtemjr74t1fh0faj5t.
  • groq_files_listList the files uploaded to your GroqCloud organization, such as batch input and output files.Read-only

    List Files

    List the files uploaded to your GroqCloud organization, such as batch input and output files. Returns data with each file's id, filename, purpose, bytes and created_at. Use groq_file_get for one file and groq_file_content_get to read it.

    Inputs

    This tool takes no inputs.

  • groq_model_getGet details of one GroqCloud model.Read-only

    Get Model

    Get details of one GroqCloud model. Returns id, object, created, owned_by, active, context_window and max_completion_tokens. Use groq_models_list to see every model.

    Inputs

    modelstringrequired
    ID of the model. Example: llama-3.3-70b-versatile.
  • groq_models_listList the models available to your GroqCloud organization.Read-only

    List Models

    List the models available to your GroqCloud organization. Returns data with each model's id, owned_by, active status, context_window and max_completion_tokens. Use this to pick a model ID for groq_chat_completion_create. Use groq_model_get for one model.

    Inputs

    This tool takes no inputs.

  • groq_batch_createCreate a batch job that runs many chat completion requests from an uploaded JSONL file asynchronously, at a discount.Write

    Create Batch

    Create a batch job that runs many chat completion requests from an uploaded JSONL file asynchronously, at a discount. Returns the batch with id, status (validating at first), input_file_id, completion_window, created_at and request_counts. The input file must already be uploaded with purpose batch (in the GroqCloud console or API). Track it with groq_batch_get.

    Inputs

    completion_windowstringrequired
    Time frame for processing, from 24h to 7d. Example: 24h.
    input_file_idstringrequired
    ID of the uploaded JSONL file of requests, from groq_files_list. Example: file_01jh6x76wtemjr74t1fh0faj5t.
    metadataobject
    Custom metadata for the batch. Example: {"job": "nightly-eval"}