Non sono ancora disponibili benchmark associati a questa scheda.
Esecuzione locale
Inferenza · stima della memoria
together_ai/meta-llama/Llama-3.1-405B-Instruct
Informazioni verificate sull’architettura insufficienti per una stima affidabile della VRAM.
Capacità
Input massimo
4.096 tokens*
Modalità API
Chat*
Configurazione di sistema
Specifiche dettagliate
Specifiche · 6 campi
input cost per token
3,5e-6*Ambito e condizioni
native_context
provider
together_ai*
mode
chat*
full_native_model_id
together_ai/meta-llama/Llama-3.1-405B-Instruct*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
litellm provider
together_ai*Ambito e condizioni
native_context
provider
together_ai*
mode
chat*
full_native_model_id
together_ai/meta-llama/Llama-3.1-405B-Instruct*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max input tokens
4.096*Ambito e condizioni
native_context
provider
together_ai*
mode
chat*
full_native_model_id
together_ai/meta-llama/Llama-3.1-405B-Instruct*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max tokens
4.096*Ambito e condizioni
native_context
provider
together_ai*
mode
chat*
full_native_model_id
together_ai/meta-llama/Llama-3.1-405B-Instruct*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
mode
chat*Ambito e condizioni
native_context
provider
together_ai*
mode
chat*
full_native_model_id
together_ai/meta-llama/Llama-3.1-405B-Instruct*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
output cost per token
3,5e-6*Ambito e condizioni
native_context
provider
together_ai*
mode
chat*
full_native_model_id
together_ai/meta-llama/Llama-3.1-405B-Instruct*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*