GeekRadar / Il banco di confronto

CONFRONTA.

Modelli IA

Unspecified

meta.llama3-1-70b-instruct-v1:0

Modello IA

Modalità API: Chat^*
Output massimo: 4.096 tokens^*

Non sono ancora disponibili benchmark associati a questa scheda.

Esecuzione locale

Inferenza · stima della memoria

meta.llama3-1-70b-instruct-v1:0

Informazioni verificate sull’architettura insufficienti per una stima affidabile della VRAM.

Capacità

Input massimo: 128.000 tokens^*
Output massimo: 4.096 tokens^*
Uso di strumenti: Sì^*
Modalità API: Chat^*
Scelta degli strumenti: No^*

Configurazione di sistema

Specifiche dettagliate

Specifiche · 12 campi

deprecation date

2027-03-30^*

Ambito e condizioni

native_context

provider: bedrock^*
mode: chat^*
full_native_model_id: meta.llama3-1-70b-instruct-v1:0^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

input cost per token

7,2e-7^*

Ambito e condizioni

native_context

provider: bedrock^*
mode: chat^*
full_native_model_id: meta.llama3-1-70b-instruct-v1:0^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

input cost per token batches

3,6e-7^*

Ambito e condizioni

native_context

provider: bedrock^*
mode: chat^*
full_native_model_id: meta.llama3-1-70b-instruct-v1:0^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

litellm provider

bedrock^*

Ambito e condizioni

native_context

provider: bedrock^*
mode: chat^*
full_native_model_id: meta.llama3-1-70b-instruct-v1:0^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max input tokens

128.000^*

Ambito e condizioni

native_context

provider: bedrock^*
mode: chat^*
full_native_model_id: meta.llama3-1-70b-instruct-v1:0^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max output tokens

4.096^*

Ambito e condizioni

native_context

provider: bedrock^*
mode: chat^*
full_native_model_id: meta.llama3-1-70b-instruct-v1:0^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max tokens

4.096^*

Ambito e condizioni

native_context

provider: bedrock^*
mode: chat^*
full_native_model_id: meta.llama3-1-70b-instruct-v1:0^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

mode

chat^*

Ambito e condizioni

native_context

provider: bedrock^*
mode: chat^*
full_native_model_id: meta.llama3-1-70b-instruct-v1:0^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

output cost per token

7,2e-7^*

Ambito e condizioni

native_context

provider: bedrock^*
mode: chat^*
full_native_model_id: meta.llama3-1-70b-instruct-v1:0^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

output cost per token batches

3,6e-7^*

Ambito e condizioni

native_context

provider: bedrock^*
mode: chat^*
full_native_model_id: meta.llama3-1-70b-instruct-v1:0^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

supports function calling

Sì^*

Ambito e condizioni

native_context

provider: bedrock^*
mode: chat^*
full_native_model_id: meta.llama3-1-70b-instruct-v1:0^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

supports tool choice

No^*

Ambito e condizioni

native_context

provider: bedrock^*
mode: chat^*
full_native_model_id: meta.llama3-1-70b-instruct-v1:0^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

* Dati provvisori