Groq

The Groq model provides access to Groq’s high-performance language models.

Parameters

Parameter	Type	Default	Description
id	str	"llama-3.3-70b-versatile"	The id of the Groq model to use
name	str	"Groq"	The name of the model
provider	str	"Groq"	The provider of the model
api_key	Optional[str]	None	The API key for Groq (defaults to GROQ_API_KEY env var)
base_url	str	"https://api.groq.com/openai/v1"	The base URL for the Groq API

Groq extends the OpenAI-compatible interface and supports most parameters from OpenAI.