Baichuan-M3-235B

Baichuan-M3-235B

235.09 B total parameters · qwen3_moe · BF16

Published checkpoint tensor payload: 437.9 GiB. This includes stored copies and buffers; it is separate from the runtime estimates below.

One user, full model in accelerator memory.

GPUs with memory headroom

• NVIDIA B200 GPU accelerator · 180 GiB
• AMD Instinct MI300X · 192 GiB
• NVIDIA B100 GPU accelerator · 192 GiB

No single GPU in this selection has enough memory headroom. Offloading or multi-GPU inference needs a separate plan.

Local AI systems with memory headroom

No catalogued Local AI system meets this memory estimate with the reserved headroom.

Shared-memory systems use a planning budget of 75% of installed memory, leaving 25% for the OS and other allocations. This is an assumption, not a measured GPU allocation. Firmware and driver limits may be lower and may require configuration. Memory matches do not verify a runtime, quantized model artifact or inference speed.

Includes FP16 KV cache, prompt plus generated tokens, quantization metadata and a runtime allowance. GPU matches reserve 10% of VRAM. Memory fit is not a speed or software-compatibility guarantee; quantized weights and runtime support must be available.