Non sono ancora disponibili benchmark associati a questa scheda.
Esecuzione locale
Inferenza · stima della memoria
meta.llama2-13b-chat-v1
Informazioni verificate sull’architettura insufficienti per una stima affidabile della VRAM.
Capacità
Input massimo
4.096 tokens*
Output massimo
4.096 tokens*
Modalità API
Chat*
Configurazione di sistema
Specifiche dettagliate
Specifiche · 7 campi
input cost per token
7,5e-7*Ambito e condizioni
native_context
provider
bedrock*
mode
chat*
full_native_model_id
meta.llama2-13b-chat-v1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
litellm provider
bedrock*Ambito e condizioni
native_context
provider
bedrock*
mode
chat*
full_native_model_id
meta.llama2-13b-chat-v1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max input tokens
4.096*Ambito e condizioni
native_context
provider
bedrock*
mode
chat*
full_native_model_id
meta.llama2-13b-chat-v1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max output tokens
4.096*Ambito e condizioni
native_context
provider
bedrock*
mode
chat*
full_native_model_id
meta.llama2-13b-chat-v1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max tokens
4.096*Ambito e condizioni
native_context
provider
bedrock*
mode
chat*
full_native_model_id
meta.llama2-13b-chat-v1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
mode
chat*Ambito e condizioni
native_context
provider
bedrock*
mode
chat*
full_native_model_id
meta.llama2-13b-chat-v1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
output cost per token
1,0e-6*Ambito e condizioni
native_context
provider
bedrock*
mode
chat*
full_native_model_id
meta.llama2-13b-chat-v1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*