sagemaker/meta-textgeneration-llama-2-7b

Modello IA

Non sono ancora disponibili benchmark associati a questa scheda.

Esecuzione locale

Inferenza · stima della memoria

Informazioni verificate sull’architettura insufficienti per una stima affidabile della VRAM.

Specifiche · 7 campi

input cost per token

0,0^*

Ambito e condizioni

native_context

provider: sagemaker^*
mode: completion^*
full_native_model_id: sagemaker/meta-textgeneration-llama-2-7b^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

litellm provider

sagemaker^*

Ambito e condizioni

native_context

provider: sagemaker^*
mode: completion^*
full_native_model_id: sagemaker/meta-textgeneration-llama-2-7b^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max input tokens

4.096^*

Ambito e condizioni

native_context

provider: sagemaker^*
mode: completion^*
full_native_model_id: sagemaker/meta-textgeneration-llama-2-7b^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max output tokens

4.096^*

Ambito e condizioni

native_context

provider: sagemaker^*
mode: completion^*
full_native_model_id: sagemaker/meta-textgeneration-llama-2-7b^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max tokens

4.096^*

Ambito e condizioni

native_context

provider: sagemaker^*
mode: completion^*
full_native_model_id: sagemaker/meta-textgeneration-llama-2-7b^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

mode

completion^*

Ambito e condizioni

native_context

provider: sagemaker^*
mode: completion^*
full_native_model_id: sagemaker/meta-textgeneration-llama-2-7b^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

output cost per token

0,0^*

Ambito e condizioni

native_context

provider: sagemaker^*
mode: completion^*
full_native_model_id: sagemaker/meta-textgeneration-llama-2-7b^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

* Dati provvisori