deepinfra/microsoft/WizardLM-2-8x22B

AI model

API mode: Chat^*
Maximum output: 65,536 tokens^*

No matched benchmark results are available for this entry yet.

Run it locally

Inference · memory estimate

deepinfra/microsoft/WizardLM-2-8x22B

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Maximum input: 65,536 tokens^*
Maximum output: 65,536 tokens^*
API mode: Chat^*
Tool choice: No^*

System configuration

Detailed specifications

Specifications · 8 fields

input cost per token

4.8e-7^*

Scope and conditions

native_context

provider: deepinfra^*
mode: chat^*
full_native_model_id: deepinfra/microsoft/WizardLM-2-8x22B^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

litellm provider

deepinfra^*

Scope and conditions

native_context

provider: deepinfra^*
mode: chat^*
full_native_model_id: deepinfra/microsoft/WizardLM-2-8x22B^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max input tokens

65,536^*

Scope and conditions

native_context

provider: deepinfra^*
mode: chat^*
full_native_model_id: deepinfra/microsoft/WizardLM-2-8x22B^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max output tokens

65,536^*

Scope and conditions

native_context

provider: deepinfra^*
mode: chat^*
full_native_model_id: deepinfra/microsoft/WizardLM-2-8x22B^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max tokens

65,536^*

Scope and conditions

native_context

provider: deepinfra^*
mode: chat^*
full_native_model_id: deepinfra/microsoft/WizardLM-2-8x22B^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

mode

chat^*

Scope and conditions

native_context

provider: deepinfra^*
mode: chat^*
full_native_model_id: deepinfra/microsoft/WizardLM-2-8x22B^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

output cost per token

4.8e-7^*

Scope and conditions

native_context

provider: deepinfra^*
mode: chat^*
full_native_model_id: deepinfra/microsoft/WizardLM-2-8x22B^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

supports tool choice

No^*

Scope and conditions

native_context

provider: deepinfra^*
mode: chat^*
full_native_model_id: deepinfra/microsoft/WizardLM-2-8x22B^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

* Provisional data