Non sono ancora disponibili benchmark associati a questa scheda.
Esecuzione locale
Inferenza · stima della memoria
ovhcloud/Mixtral-8x7B-Instruct-v0.1
Informazioni verificate sull’architettura insufficienti per una stima affidabile della VRAM.
Capacità
Input massimo
32.000 tokens*
Output massimo
32.000 tokens*
Uso di strumenti
No*
Output strutturato
Sì*
Modalità API
Chat*
Scelta degli strumenti
No*
Configurazione di sistema
Specifiche dettagliate
Specifiche · 10 campi
input cost per token
6,3e-7*Ambito e condizioni
native_context
provider
ovhcloud*
mode
chat*
full_native_model_id
ovhcloud/Mixtral-8x7B-Instruct-v0.1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
litellm provider
ovhcloud*Ambito e condizioni
native_context
provider
ovhcloud*
mode
chat*
full_native_model_id
ovhcloud/Mixtral-8x7B-Instruct-v0.1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max input tokens
32.000*Ambito e condizioni
native_context
provider
ovhcloud*
mode
chat*
full_native_model_id
ovhcloud/Mixtral-8x7B-Instruct-v0.1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max output tokens
32.000*Ambito e condizioni
native_context
provider
ovhcloud*
mode
chat*
full_native_model_id
ovhcloud/Mixtral-8x7B-Instruct-v0.1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max tokens
32.000*Ambito e condizioni
native_context
provider
ovhcloud*
mode
chat*
full_native_model_id
ovhcloud/Mixtral-8x7B-Instruct-v0.1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
mode
chat*Ambito e condizioni
native_context
provider
ovhcloud*
mode
chat*
full_native_model_id
ovhcloud/Mixtral-8x7B-Instruct-v0.1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
output cost per token
6,3e-7*Ambito e condizioni
native_context
provider
ovhcloud*
mode
chat*
full_native_model_id
ovhcloud/Mixtral-8x7B-Instruct-v0.1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports function calling
No*Ambito e condizioni
native_context
provider
ovhcloud*
mode
chat*
full_native_model_id
ovhcloud/Mixtral-8x7B-Instruct-v0.1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports response schema
Sì*Ambito e condizioni
native_context
provider
ovhcloud*
mode
chat*
full_native_model_id
ovhcloud/Mixtral-8x7B-Instruct-v0.1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports tool choice
No*Ambito e condizioni
native_context
provider
ovhcloud*
mode
chat*
full_native_model_id
ovhcloud/Mixtral-8x7B-Instruct-v0.1*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*