wandb/meta-llama/Llama-3.1-70B-Instruct

AI model

API mode: Chat^*

No matched benchmark results are available for this entry yet.

Run it locally

Inference · memory estimate

wandb/meta-llama/Llama-3.1-70B-Instruct

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Maximum input: 131,000 tokens^*
API mode: Chat^*
Image input: No^*

System configuration

Detailed specifications

Specifications · 8 fields

deprecation date

2026-10-05^*

Scope and conditions

native_context

provider: wandb^*
mode: chat^*
full_native_model_id: wandb/meta-llama/Llama-3.1-70B-Instruct^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

input cost per token

8.0e-7^*

Scope and conditions

native_context

provider: wandb^*
mode: chat^*
full_native_model_id: wandb/meta-llama/Llama-3.1-70B-Instruct^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

litellm provider

wandb^*

Scope and conditions

native_context

provider: wandb^*
mode: chat^*
full_native_model_id: wandb/meta-llama/Llama-3.1-70B-Instruct^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max input tokens

131,000^*

Scope and conditions

native_context

provider: wandb^*
mode: chat^*
full_native_model_id: wandb/meta-llama/Llama-3.1-70B-Instruct^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max tokens

128,000^*

Scope and conditions

native_context

provider: wandb^*
mode: chat^*
full_native_model_id: wandb/meta-llama/Llama-3.1-70B-Instruct^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

mode

chat^*

Scope and conditions

native_context

provider: wandb^*
mode: chat^*
full_native_model_id: wandb/meta-llama/Llama-3.1-70B-Instruct^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

output cost per token

8.0e-7^*

Scope and conditions

native_context

provider: wandb^*
mode: chat^*
full_native_model_id: wandb/meta-llama/Llama-3.1-70B-Instruct^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

supports vision

No^*

Scope and conditions

native_context

provider: wandb^*
mode: chat^*
full_native_model_id: wandb/meta-llama/Llama-3.1-70B-Instruct^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

* Provisional data