Skip to main content
The Nvidia model provides access to Nvidia’s language models.

Parameters

ParameterTypeDefaultDescription
idstr"nvidia/llama-3.1-nemotron-70b-instruct"The id of the NVIDIA model to use
namestr"NVIDIA"The name of the model
providerstr"NVIDIA"The provider of the model
api_keyOptional[str]NoneThe API key for NVIDIA (defaults to NVIDIA_API_KEY env var)
base_urlstr"https://integrate.api.nvidia.com/v1"The base URL for the NVIDIA API
NVIDIA extends the OpenAI-compatible interface and supports most parameters from OpenAI.
I