granite-34b-code-instruct-8k

AI model

Context window: 8,192 tokens
Total parameters: 33.72 B
Open weights: Yes

No matched benchmark results are available for this entry yet.

Run it locally

Inference · memory estimate

granite-34b-code-instruct-8k

33.72 B total parameters · gpt_bigcode · BF16

Published checkpoint tensor payload: 62.8 GiB. This includes stored copies and buffers; it is separate from the runtime estimates below.

Weight-only estimates: 16-bit: 62.8 GiB; 8-bit: 34.5 GiB; 4-bit: 17.3 GiB; Cache geometry is unavailable. These are not complete GPU requirements.

Capabilities

Context window: 8,192 tokens
Open weights: Yes
Model license: apache-2.0
Total parameters: 33.72 B
Checkpoint tensor payload: 62.80 GiB

Input modalities

text

Output modalities

text

Processing & platform

Architecture: gpt_bigcode