Parameters
| Parameter | Type | Default | Description |
|---|---|---|---|
id | str | "meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo" | The id of the Together model to use |
name | str | "Together" | The name of the model |
provider | str | "Together" | The provider of the model |
api_key | Optional[str] | None | The API key for Together (defaults to TOGETHER_API_KEY env var) |
base_url | str | "https://api.together.xyz/v1" | The base URL for the Together API |