sagemaker/meta-textgeneration-llama-2-70b
Not enough verified architecture information for a reliable VRAM estimate.
GeekRadar / The comparison desk
COMPARE.
AI modelssagemaker/meta-textgeneration-llama-2-70b
AI model
- API mode
- Text completion*
- Maximum output
- 4,096 tokens*
No matched benchmark results are available for this entry yet.
Run it locally
Capabilities
- Maximum input
- 4,096 tokens*
- Maximum output
- 4,096 tokens*
- API mode
- Text completion*
System configuration
Detailed specifications
Specifications · 7 fields
- input cost per token
- 0.0*
Scope and conditions
- native_context
- provider
- sagemaker*
- mode
- completion*
- full_native_model_id
- sagemaker/meta-textgeneration-llama-2-70b*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- litellm provider
- sagemaker*
Scope and conditions
- native_context
- provider
- sagemaker*
- mode
- completion*
- full_native_model_id
- sagemaker/meta-textgeneration-llama-2-70b*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- max input tokens
- 4,096*
Scope and conditions
- native_context
- provider
- sagemaker*
- mode
- completion*
- full_native_model_id
- sagemaker/meta-textgeneration-llama-2-70b*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- max output tokens
- 4,096*
Scope and conditions
- native_context
- provider
- sagemaker*
- mode
- completion*
- full_native_model_id
- sagemaker/meta-textgeneration-llama-2-70b*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- max tokens
- 4,096*
Scope and conditions
- native_context
- provider
- sagemaker*
- mode
- completion*
- full_native_model_id
- sagemaker/meta-textgeneration-llama-2-70b*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- mode
- completion*
Scope and conditions
- native_context
- provider
- sagemaker*
- mode
- completion*
- full_native_model_id
- sagemaker/meta-textgeneration-llama-2-70b*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- output cost per token
- 0.0*
Scope and conditions
- native_context
- provider
- sagemaker*
- mode
- completion*
- full_native_model_id
- sagemaker/meta-textgeneration-llama-2-70b*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
0 selected Compare 0
* Provisional data