falcon-40b

AI model Released May 25, 2023

Open weights: Yes

Capability & preference

General capability · ECI

A cross-benchmark capability estimate. Index points, not a percentage; intervals show uncertainty.

falcon-40b 104.4^* Falcon-40B · 95% interval 95.5–110.1

Run it locally

Inference · memory estimate

falcon-40b

77.9 GiB checkpoint tensor payload · 41.84 B stored tensor elements · BF16

Stored tensors can include buffers and repeated shared weights. A verified unique parameter count is unavailable. Checkpoint size is not the memory required to run the model.

Capabilities

Open weights: Yes
Model license: apache-2.0
Checkpoint tensor payload: 77.93 GiB

Input modalities

text

Output modalities

text

Processing & platform

Architecture: falcon

Connectivity & software

Connectivity & features

Published training sequence length: 2,048 tokens.

* Provisional data