Non sono ancora disponibili benchmark associati a questa scheda.
Esecuzione locale
Inferenza · stima della memoria
snowflake/llama2-70b-chat
Informazioni verificate sull’architettura insufficienti per una stima affidabile della VRAM.
Capacità
Input massimo
4.096 tokens*
Output massimo
8.192 tokens*
Modalità API
Chat*
Configurazione di sistema
Specifiche dettagliate
Specifiche · 5 campi
litellm provider
snowflake*Ambito e condizioni
native_context
provider
snowflake*
mode
chat*
full_native_model_id
snowflake/llama2-70b-chat*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max input tokens
4.096*Ambito e condizioni
native_context
provider
snowflake*
mode
chat*
full_native_model_id
snowflake/llama2-70b-chat*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max output tokens
8.192*Ambito e condizioni
native_context
provider
snowflake*
mode
chat*
full_native_model_id
snowflake/llama2-70b-chat*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max tokens
8.192*Ambito e condizioni
native_context
provider
snowflake*
mode
chat*
full_native_model_id
snowflake/llama2-70b-chat*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
mode
chat*Ambito e condizioni
native_context
provider
snowflake*
mode
chat*
full_native_model_id
snowflake/llama2-70b-chat*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*