granite-20b-code-base-8k

AI model

Context window: 8,192 tokens
Total parameters: 20.07 B
Open weights: Yes

No matched benchmark results are available for this entry yet.

Run it locally

Inference · memory estimate

granite-20b-code-base-8k

20.07 B total parameters · gpt_bigcode · BF16

Published checkpoint tensor payload: 37.4 GiB. This includes stored copies and buffers; it is separate from the runtime estimates below.

Weight-only estimates: 16-bit: 37.4 GiB; 8-bit: 20.6 GiB; 4-bit: 10.3 GiB; Cache geometry is unavailable. These are not complete GPU requirements.

Capabilities

Context window: 8,192 tokens
Open weights: Yes
Model license: apache-2.0
Total parameters: 20.07 B
Checkpoint tensor payload: 37.38 GiB

Input modalities

text

Output modalities

text

Processing & platform

Architecture: gpt_bigcode