cloudflare/@cf/meta/llama-2-7b-chat-fp16

AI model

API mode: Chat^*
Maximum output: 3,072 tokens^*

No matched benchmark results are available for this entry yet.

Run it locally

Inference · memory estimate

cloudflare/@cf/meta/llama-2-7b-chat-fp16

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Maximum input: 3,072 tokens^*
Maximum output: 3,072 tokens^*
API mode: Chat^*

System configuration

Detailed specifications

Specifications · 8 fields

input cost per token

1.923e-6^*

Scope and conditions

native_context

provider: cloudflare^*
mode: chat^*
full_native_model_id: cloudflare/@cf/meta/llama-2-7b-chat-fp16^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

litellm provider

cloudflare^*

Scope and conditions

native_context

provider: cloudflare^*
mode: chat^*
full_native_model_id: cloudflare/@cf/meta/llama-2-7b-chat-fp16^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max input tokens

3,072^*

Scope and conditions

native_context

provider: cloudflare^*
mode: chat^*
full_native_model_id: cloudflare/@cf/meta/llama-2-7b-chat-fp16^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max output tokens

3,072^*

Scope and conditions

native_context

provider: cloudflare^*
mode: chat^*
full_native_model_id: cloudflare/@cf/meta/llama-2-7b-chat-fp16^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

max tokens

3,072^*

Scope and conditions

native_context

provider: cloudflare^*
mode: chat^*
full_native_model_id: cloudflare/@cf/meta/llama-2-7b-chat-fp16^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

mode

chat^*

Scope and conditions

native_context

provider: cloudflare^*
mode: chat^*
full_native_model_id: cloudflare/@cf/meta/llama-2-7b-chat-fp16^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

output cost per token

1.923e-6^*

Scope and conditions

native_context

provider: cloudflare^*
mode: chat^*
full_native_model_id: cloudflare/@cf/meta/llama-2-7b-chat-fp16^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

rpm

300^*

Scope and conditions

native_context

provider: cloudflare^*
mode: chat^*
full_native_model_id: cloudflare/@cf/meta/llama-2-7b-chat-fp16^*
pricing_scope: Literal source field names and values retained; provider, region, cache/batch/threshold conditions and per-unit meaning must be checked. max_tokens is not automatically a context limit.^*

* Provisional data