vertex_ai/meta/llama-3.1-8b-instruct-maas
Not enough verified architecture information for a reliable VRAM estimate.
GeekRadar / The comparison desk
COMPARE.
AI modelsvertex_ai/meta/llama-3.1-8b-instruct-maas
AI model
- API mode
- Chat*
- Maximum output
- 2,048 tokens*
No matched benchmark results are available for this entry yet.
Run it locally
Capabilities
- Maximum input
- 128,000 tokens*
- Maximum output
- 2,048 tokens*
- API mode
- Chat*
- Image input
- Yes*
- System messages
- Yes*
- Tool choice
- Yes*
System configuration
Detailed specifications
Specifications · 11 fields
- input cost per token
- 0.0*
Scope and conditions
- native_context
- provider
- vertex_ai-llama_models*
- mode
- chat*
- full_native_model_id
- vertex_ai/meta/llama-3.1-8b-instruct-maas*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- litellm provider
- vertex_ai-llama_models*
Scope and conditions
- native_context
- provider
- vertex_ai-llama_models*
- mode
- chat*
- full_native_model_id
- vertex_ai/meta/llama-3.1-8b-instruct-maas*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- max input tokens
- 128,000*
Scope and conditions
- native_context
- provider
- vertex_ai-llama_models*
- mode
- chat*
- full_native_model_id
- vertex_ai/meta/llama-3.1-8b-instruct-maas*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- max output tokens
- 2,048*
Scope and conditions
- native_context
- provider
- vertex_ai-llama_models*
- mode
- chat*
- full_native_model_id
- vertex_ai/meta/llama-3.1-8b-instruct-maas*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- max tokens
- 2,048*
Scope and conditions
- native_context
- provider
- vertex_ai-llama_models*
- mode
- chat*
- full_native_model_id
- vertex_ai/meta/llama-3.1-8b-instruct-maas*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- metadata
- notes
- VertexAI states that The Llama 3.1 API service for llama-3.1-70b-instruct-maas and llama-3.1-8b-instruct-maas are in public preview and at no cost.*
Scope and conditions
- native_context
- provider
- vertex_ai-llama_models*
- mode
- chat*
- full_native_model_id
- vertex_ai/meta/llama-3.1-8b-instruct-maas*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- mode
- chat*
Scope and conditions
- native_context
- provider
- vertex_ai-llama_models*
- mode
- chat*
- full_native_model_id
- vertex_ai/meta/llama-3.1-8b-instruct-maas*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- output cost per token
- 0.0*
Scope and conditions
- native_context
- provider
- vertex_ai-llama_models*
- mode
- chat*
- full_native_model_id
- vertex_ai/meta/llama-3.1-8b-instruct-maas*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- supports system messages
- Yes*
Scope and conditions
- native_context
- provider
- vertex_ai-llama_models*
- mode
- chat*
- full_native_model_id
- vertex_ai/meta/llama-3.1-8b-instruct-maas*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- supports tool choice
- Yes*
Scope and conditions
- native_context
- provider
- vertex_ai-llama_models*
- mode
- chat*
- full_native_model_id
- vertex_ai/meta/llama-3.1-8b-instruct-maas*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- supports vision
- Yes*
Scope and conditions
- native_context
- provider
- vertex_ai-llama_models*
- mode
- chat*
- full_native_model_id
- vertex_ai/meta/llama-3.1-8b-instruct-maas*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
0 selected Compare 0
* Provisional data