GeekRadar / The comparison desk
COMPARE.
AI models
Unspecified

novita/microsoft/wizardlm-2-8x22b

AI model

API mode
Chat*
Maximum output
8,000 tokens*

No matched benchmark results are available for this entry yet.

Run it locally

Inference · memory estimate

novita/microsoft/wizardlm-2-8x22b

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Maximum input
65,535 tokens*
Maximum output
8,000 tokens*
Structured output
Yes*
API mode
Chat*
System messages
Yes*

System configuration

Detailed specifications

Specifications · 9 fields
input cost per token
6.2e-7*
Scope and conditions
native_context
provider
novita*
mode
chat*
full_native_model_id
novita/microsoft/wizardlm-2-8x22b*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
litellm provider
novita*
Scope and conditions
native_context
provider
novita*
mode
chat*
full_native_model_id
novita/microsoft/wizardlm-2-8x22b*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max input tokens
65,535*
Scope and conditions
native_context
provider
novita*
mode
chat*
full_native_model_id
novita/microsoft/wizardlm-2-8x22b*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max output tokens
8,000*
Scope and conditions
native_context
provider
novita*
mode
chat*
full_native_model_id
novita/microsoft/wizardlm-2-8x22b*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max tokens
8,000*
Scope and conditions
native_context
provider
novita*
mode
chat*
full_native_model_id
novita/microsoft/wizardlm-2-8x22b*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
mode
chat*
Scope and conditions
native_context
provider
novita*
mode
chat*
full_native_model_id
novita/microsoft/wizardlm-2-8x22b*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
output cost per token
6.2e-7*
Scope and conditions
native_context
provider
novita*
mode
chat*
full_native_model_id
novita/microsoft/wizardlm-2-8x22b*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports response schema
Yes*
Scope and conditions
native_context
provider
novita*
mode
chat*
full_native_model_id
novita/microsoft/wizardlm-2-8x22b*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports system messages
Yes*
Scope and conditions
native_context
provider
novita*
mode
chat*
full_native_model_id
novita/microsoft/wizardlm-2-8x22b*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*

* Provisional data