databricks/databricks-meta-llama-3-1-8b-instruct
Informazioni verificate sull’architettura insufficienti per una stima affidabile della VRAM.
GeekRadar / Il banco di confronto
CONFRONTA.
Modelli IAdatabricks/databricks-meta-llama-3-1-8b-instruct
Modello IA
- Modalità API
- Chat*
- Output massimo
- 128.000 tokens*
Non sono ancora disponibili benchmark associati a questa scheda.
Esecuzione locale
Capacità
- Input massimo
- 200.000 tokens*
- Output massimo
- 128.000 tokens*
- Modalità API
- Chat*
Configurazione di sistema
Specifiche dettagliate
Specifiche · 12 campi
- cache creation input token cost
- 1,5001e-7*
Ambito e condizioni
- native_context
- provider
- databricks*
- mode
- chat*
- full_native_model_id
- databricks/databricks-meta-llama-3-1-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- cache read input token cost
- 1,5001e-7*
Ambito e condizioni
- native_context
- provider
- databricks*
- mode
- chat*
- full_native_model_id
- databricks/databricks-meta-llama-3-1-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- input cost per token
- 1,5000999999999998e-7*
Ambito e condizioni
- native_context
- provider
- databricks*
- mode
- chat*
- full_native_model_id
- databricks/databricks-meta-llama-3-1-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- input dbu cost per token
- 2,1429999999999996e-6*
Ambito e condizioni
- native_context
- provider
- databricks*
- mode
- chat*
- full_native_model_id
- databricks/databricks-meta-llama-3-1-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- litellm provider
- databricks*
Ambito e condizioni
- native_context
- provider
- databricks*
- mode
- chat*
- full_native_model_id
- databricks/databricks-meta-llama-3-1-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- max input tokens
- 200.000*
Ambito e condizioni
- native_context
- provider
- databricks*
- mode
- chat*
- full_native_model_id
- databricks/databricks-meta-llama-3-1-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- max output tokens
- 128.000*
Ambito e condizioni
- native_context
- provider
- databricks*
- mode
- chat*
- full_native_model_id
- databricks/databricks-meta-llama-3-1-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- max tokens
- 128.000*
Ambito e condizioni
- native_context
- provider
- databricks*
- mode
- chat*
- full_native_model_id
- databricks/databricks-meta-llama-3-1-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- metadata
- notes
- Input/output cost per token is dbu cost * $0.070. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation.*
Ambito e condizioni
- native_context
- provider
- databricks*
- mode
- chat*
- full_native_model_id
- databricks/databricks-meta-llama-3-1-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- mode
- chat*
Ambito e condizioni
- native_context
- provider
- databricks*
- mode
- chat*
- full_native_model_id
- databricks/databricks-meta-llama-3-1-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- output cost per token
- 4,5003000000000007e-7*
Ambito e condizioni
- native_context
- provider
- databricks*
- mode
- chat*
- full_native_model_id
- databricks/databricks-meta-llama-3-1-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
- output dbu cost per token
- 6,429000000000001e-6*
Ambito e condizioni
- native_context
- provider
- databricks*
- mode
- chat*
- full_native_model_id
- databricks/databricks-meta-llama-3-1-8b-instruct*
- pricing_scope
- Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
0 selezionati Confronta 0
* Dati provvisori