GeekRadar / The comparison desk
COMPARE.
AI models
Unspecified

us.meta.llama3-1-8b-instruct-v1:0

AI model

API mode
Chat*
Maximum output
4,096 tokens*

No matched benchmark results are available for this entry yet.

Run it locally

Inference · memory estimate

us.meta.llama3-1-8b-instruct-v1:0

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Maximum input
128,000 tokens*
Maximum output
4,096 tokens*
Tool calling
Yes*
API mode
Chat*
Tool choice
No*

System configuration

Detailed specifications

Specifications · 12 fields
deprecation date
2027-03-30*
Scope and conditions
native_context
provider
bedrock*
mode
chat*
full_native_model_id
us.meta.llama3-1-8b-instruct-v1:0*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
input cost per token
2.2e-7*
Scope and conditions
native_context
provider
bedrock*
mode
chat*
full_native_model_id
us.meta.llama3-1-8b-instruct-v1:0*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
input cost per token batches
1.1e-7*
Scope and conditions
native_context
provider
bedrock*
mode
chat*
full_native_model_id
us.meta.llama3-1-8b-instruct-v1:0*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
litellm provider
bedrock*
Scope and conditions
native_context
provider
bedrock*
mode
chat*
full_native_model_id
us.meta.llama3-1-8b-instruct-v1:0*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max input tokens
128,000*
Scope and conditions
native_context
provider
bedrock*
mode
chat*
full_native_model_id
us.meta.llama3-1-8b-instruct-v1:0*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max output tokens
4,096*
Scope and conditions
native_context
provider
bedrock*
mode
chat*
full_native_model_id
us.meta.llama3-1-8b-instruct-v1:0*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max tokens
4,096*
Scope and conditions
native_context
provider
bedrock*
mode
chat*
full_native_model_id
us.meta.llama3-1-8b-instruct-v1:0*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
mode
chat*
Scope and conditions
native_context
provider
bedrock*
mode
chat*
full_native_model_id
us.meta.llama3-1-8b-instruct-v1:0*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
output cost per token
2.2e-7*
Scope and conditions
native_context
provider
bedrock*
mode
chat*
full_native_model_id
us.meta.llama3-1-8b-instruct-v1:0*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
output cost per token batches
1.1e-7*
Scope and conditions
native_context
provider
bedrock*
mode
chat*
full_native_model_id
us.meta.llama3-1-8b-instruct-v1:0*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports function calling
Yes*
Scope and conditions
native_context
provider
bedrock*
mode
chat*
full_native_model_id
us.meta.llama3-1-8b-instruct-v1:0*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports tool choice
No*
Scope and conditions
native_context
provider
bedrock*
mode
chat*
full_native_model_id
us.meta.llama3-1-8b-instruct-v1:0*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*

* Provisional data