Skip to main content

Groq

Groq provides ultra-fast inference on open-source models (Llama, Gemma, Mistral, and more) using custom LPU hardware. OpenClaw connects to Groq through its OpenAI-compatible API.
PropertyValue
Providergroq
AuthGROQ_API_KEY
APIOpenAI-compatible

Getting started

1

Get an API key

Create an API key at console.groq.com/keys.
2

Set the API key

export GROQ_API_KEY="gsk_..."
3

Set a default model

{
  agents: {
    defaults: {
      model: { primary: "groq/llama-3.3-70b-versatile" },
    },
  },
}

Config file example

{
  env: { GROQ_API_KEY: "gsk_..." },
  agents: {
    defaults: {
      model: { primary: "groq/llama-3.3-70b-versatile" },
    },
  },
}

Available models

Groq’s model catalog changes frequently. Run openclaw models list | grep groq to see currently available models, or check console.groq.com/docs/models.
ModelNotes
Llama 3.3 70B VersatileGeneral-purpose, large context
Llama 3.1 8B InstantFast, lightweight
Gemma 2 9BCompact, efficient
Mixtral 8x7BMoE architecture, strong reasoning
Use openclaw models list --provider groq for the most up-to-date list of models available on your account.

Audio transcription

Groq also provides fast Whisper-based audio transcription. When configured as a media-understanding provider, OpenClaw uses Groq’s whisper-large-v3-turbo model to transcribe voice messages through the shared tools.media.audio surface.
{
  tools: {
    media: {
      audio: {
        models: [{ provider: "groq" }],
      },
    },
  },
}
PropertyValue
Shared config pathtools.media.audio
Default base URLhttps://api.groq.com/openai/v1
Default modelwhisper-large-v3-turbo
API endpointOpenAI-compatible /audio/transcriptions
If the Gateway runs as a daemon (launchd/systemd), make sure GROQ_API_KEY is available to that process (for example, in ~/.openclaw/.env or via env.shellEnv).
Keys set only in your interactive shell are not visible to daemon-managed gateway processes. Use ~/.openclaw/.env or env.shellEnv config for persistent availability.

Model selection

Choosing providers, model refs, and failover behavior.

Configuration reference

Full config schema including provider and audio settings.

Groq Console

Groq dashboard, API docs, and pricing.

Groq model list

Official Groq model catalog.