watsonx/ibm/granite-3-8b-instruct
Not enough verified architecture information for a reliable VRAM estimate.
GeekRadar / The comparison desk
COMPARE.
AI modelswatsonx/ibm/granite-3-8b-instruct
AI model
- API mode
- Chat*
- Maximum output
- 1,024 tokens*
No matched benchmark results are available for this entry yet.
Run it locally
Capabilities
- Maximum input
- 8,192 tokens*
- Maximum output
- 1,024 tokens*
- Tool calling
- Yes*
- Structured output
- Yes*
- API mode
- Chat*
- Image input
- No*
- Audio input
- No*
- Audio output
- No*
- Parallel tool calls
- No*
- Prompt caching
- Yes*
- System messages
- Yes*
- Tool choice
- Yes*
System configuration
Detailed specifications
Specifications · 16 fields
- input cost per token
- 2.0e-7*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- litellm provider
- watsonx*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- max input tokens
- 8,192*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- max output tokens
- 1,024*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- max tokens
- 1,024*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- mode
- chat*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- output cost per token
- 2.0e-7*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- supports audio input
- No*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- supports audio output
- No*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- supports function calling
- Yes*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- supports parallel function calling
- No*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- supports prompt caching
- Yes*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- supports response schema
- Yes*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- supports system messages
- Yes*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- supports tool choice
- Yes*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- supports vision
- No*
Scope and conditions
- native_context
- provider
- watsonx*
- mode
- chat*
- full_native_model_id
- watsonx/ibm/granite-3-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
0 selected Compare 0
* Provisional data