nscale/meta-llama/Llama-3.1-8B-Instruct

AI model

No matched benchmark results are available for this entry yet.

Run it locally

Inference · memory estimate

Not enough verified architecture information for a reliable VRAM estimate.

Specifications · 5 fields

input cost per token

3.0e-8^*

Scope and conditions

native_context

provider: nscale^*
mode: chat^*
full_native_model_id: nscale/meta-llama/Llama-3.1-8B-Instruct^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

litellm provider

nscale^*

Scope and conditions

native_context

provider: nscale^*
mode: chat^*
full_native_model_id: nscale/meta-llama/Llama-3.1-8B-Instruct^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

metadata

notes: Pricing listed as $0.06/1M tokens total. Assumed 50/50 split for input/output.^*

Scope and conditions

native_context

provider: nscale^*
mode: chat^*
full_native_model_id: nscale/meta-llama/Llama-3.1-8B-Instruct^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

mode

chat^*

Scope and conditions

native_context

provider: nscale^*
mode: chat^*
full_native_model_id: nscale/meta-llama/Llama-3.1-8B-Instruct^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

output cost per token

3.0e-8^*

Scope and conditions

native_context

provider: nscale^*
mode: chat^*
full_native_model_id: nscale/meta-llama/Llama-3.1-8B-Instruct^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

* Provisional data