No matched benchmark results are available for this entry yet.
Run it locally
Inference · memory estimate
NVIDIA-Nemotron-Nano-12B-v2
22.9 GiB checkpoint tensor payload · 12.31 B stored tensor elements · BF16
Stored tensors can include buffers and repeated shared weights. A verified unique parameter count is unavailable. Checkpoint size is not the memory required to run the model.
Capabilities
Context window
131,072 tokens
Maximum input
128,000 tokens*
Maximum output
8,000 tokens*
Tool calling
Yes*
Structured output
Yes*
Open weights
Yes
API mode
Chat*
Image input
Yes*
Audio input
No*
System messages
Yes*
Model license
other
Checkpoint tensor payload
22.93 GiB
Input modalities
text
Output modalities
text
Processing & platform
Architecture
nemotron_h
System configuration
Detailed specifications
Specifications · 19 fields
deprecation date
2027-03-30*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
input cost per token
2.0e-7*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
input cost per token batches
1.0e-7*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
input cost per token flex
1.0e-7*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
input cost per token priority
3.5e-7*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
litellm provider
bedrock_converse*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max input tokens
128,000*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max output tokens
8,000*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max tokens
8,000*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
mode
chat*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
output cost per token
6.0e-7*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
output cost per token batches
3.0e-7*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
output cost per token flex
3.0e-7*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
output cost per token priority
1.05e-6*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports audio input
No*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports function calling
Yes*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports response schema
Yes*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports system messages
Yes*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports vision
Yes*Scope and conditions
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*