AI & Technology / Background
A 12GB GPU is only part of the 125B setup
Gorden Sun introduced Strata October 4. This background item completes an earlier unresolved source; it is not a new October 6 release. The project runs Qwen3.8-Flash-Next through coordinated GPU, system-memory and storage use.
125B refers to the model’s parameter count; 12GB is the minimum graphics-memory requirement. Frequently used experts remain on the GPU while compressed experts reside in RAM and the CPU participates in inference. Alongside at least 12GB VRAM, the project specifies at least 32GB RAM, roughly 80GB disk space and an SSD recommendation.
The 32GB Coder variant removes about half the experts; the project warns of weaker non-code and CJK performance. A 48GB configuration supports smaller compressed files, while 64GB supports a wider selection. The headline does not promise the same complete model on every 12GB-GPU computer.
Initial loading may take one to three minutes and temporarily reduce responsiveness. Published speeds depend on hardware, quantization and engine version. We have not installed or benchmarked it. Match those conditions to the intended workload before judging practical value.
The morning documentation check is pinned to October 6 commit 82f46a8c. It describes that version, not necessarily the configuration available when the October 4 post appeared.
Sources and further reading
Edited report · Sources and limitations in the text
Selected through a verified followed account: @Gorden_Sun.