Non sono ancora disponibili benchmark associati a questa scheda.
Esecuzione locale
Inferenza · stima della memoria
NVIDIA-Nemotron-Nano-12B-v2
22,9 GiB di payload dei tensori del checkpoint · 12,31 B elementi dei tensori archiviati · BF16
I tensori archiviati possono includere buffer e copie di pesi condivisi. Il numero di parametri unici non è verificato. Le dimensioni del checkpoint non indicano la memoria necessaria per eseguire il modello.
Capacità
Finestra di contesto
131.072 tokens
Input massimo
128.000 tokens*
Output massimo
8.000 tokens*
Uso di strumenti
Sì*
Output strutturato
Sì*
Pesi aperti
Sì
Modalità API
Chat*
Input immagini
Sì*
Input audio
No*
Messaggi di sistema
Sì*
Licenza del modello
other
Payload dei tensori del checkpoint
22,93 GiB
Modalità di input
text
Modalità di output
text
Elaborazione e piattaforma
Architettura
nemotron_h
Configurazione di sistema
Specifiche dettagliate
Specifiche · 19 campi
deprecation date
2027-03-30*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
input cost per token
2,0e-7*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
input cost per token batches
1,0e-7*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
input cost per token flex
1,0e-7*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
input cost per token priority
3,5e-7*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
litellm provider
bedrock_converse*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max input tokens
128.000*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max output tokens
8.000*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
max tokens
8.000*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
mode
chat*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
output cost per token
6,0e-7*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
output cost per token batches
3,0e-7*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
output cost per token flex
3,0e-7*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
output cost per token priority
1,05e-6*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports audio input
No*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports function calling
Sì*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports response schema
Sì*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports system messages
Sì*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*
supports vision
Sì*Ambito e condizioni
native_context
provider
bedrock_converse*
mode
chat*
full_native_model_id
nvidia.nemotron-nano-12b-v2*
pricing_scope
Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.*