Skip to main content
Groq offers blazing-fast API endpoints for large language models. See all the Groq supported models here.
  • We recommend using llama-3.3-70b-versatile for general use
  • We recommend llama-3.1-8b-instant for a faster result.
  • We recommend using llama-3.2-90b-vision-preview for image understanding.

​
Multimodal Support

With Groq we support Image as input

​
Authentication

Set your GROQ_API_KEY environment variable. Get your key from here. 
export GROQ_API_KEY=***

​
Example

Use Groq with your Agent: 
from agno.agent import Agent
from agno.models.groq import Groq

agent = Agent(
    model=Groq(id="llama-3.3-70b-versatile"),
    markdown=True
)

# Print the response in the terminal
agent.print_response("Share a 2 sentence horror story.")
View more examples here.

​
Parameters

ParameterTypeDefaultDescription
idstr"llama-3.3-70b-versatile"The id of the Groq model to use
namestr"Groq"The name of the model
providerstr"Groq"The provider of the model
api_keyOptional[str]NoneThe API key for Groq (defaults to GROQ_API_KEY env var)
base_urlstr"https://api.groq.com/openai/v1"The base URL for the Groq API
Groq extends the OpenAI-compatible interface and supports most parameters from the OpenAI model.
⌘I