Parameters
Parameter | Type | Default | Description |
---|---|---|---|
id | str | "nvidia/llama-3.1-nemotron-70b-instruct" | The id of the NVIDIA model to use |
name | str | "NVIDIA" | The name of the model |
provider | str | "NVIDIA" | The provider of the model |
api_key | Optional[str] | None | The API key for NVIDIA (defaults to NVIDIA_API_KEY env var) |
base_url | str | "https://integrate.api.nvidia.com/v1" | The base URL for the NVIDIA API |