together_ai/meta-llama/Meta-Llama-3.1-8B

Modello IA

Non sono ancora disponibili benchmark associati a questa scheda.

Esecuzione locale

Inferenza · stima della memoria

Informazioni verificate sull’architettura insufficienti per una stima affidabile della VRAM.

Specifiche · 6 campi

input cost per token

2,0e-7^*

Ambito e condizioni

native_context

provider: together_ai^*
mode: completion^*
full_native_model_id: together_ai/meta-llama/Meta-Llama-3.1-8B^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

litellm provider

together_ai^*

Ambito e condizioni

native_context

provider: together_ai^*
mode: completion^*
full_native_model_id: together_ai/meta-llama/Meta-Llama-3.1-8B^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max input tokens

16.384^*

Ambito e condizioni

native_context

provider: together_ai^*
mode: completion^*
full_native_model_id: together_ai/meta-llama/Meta-Llama-3.1-8B^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max tokens

16.384^*

Ambito e condizioni

native_context

provider: together_ai^*
mode: completion^*
full_native_model_id: together_ai/meta-llama/Meta-Llama-3.1-8B^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

mode

completion^*

Ambito e condizioni

native_context

provider: together_ai^*
mode: completion^*
full_native_model_id: together_ai/meta-llama/Meta-Llama-3.1-8B^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

output cost per token

2,0e-7^*

Ambito e condizioni

native_context

provider: together_ai^*
mode: completion^*
full_native_model_id: together_ai/meta-llama/Meta-Llama-3.1-8B^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

* Dati provvisori