A StepFun kiadta a Step 5 Preview nevű, ritka Mixture-of-Experts (MoE) architektúrára épülő modelljének nyílt súlyait a Hugging Face és a ModelScope platformokon. A modell összesen 600 milliárd paraméterrel rendelkezik, de tokenenként csak 27 milliárd aktív, miközben akár 1 millió tokenes kontextusablakot is képes kezelni. A modell FP8 és BF16 formátumban tölthető le, és elsősorban nagy szoftverfejlesztési, dokumentumelemzési és pénzügyi munkafolyamatokhoz tervezték.
Futtatása komoly infrastruktúrát igényel, mivel kifejezetten adatközponti hardverekre lett optimalizálva: a legkisebb támogatott konfigurációhoz is legalább 4 darab B300-as vagy 8 darab H200-as GPU-ra van szükség. A mérések szerint a modell 88,3 százalékos eredményt ér el a hosszú kontextusú logikai feladatoknál (AA-LCR), és a pénzügyi feladatok terén is jól teljesít, de bizonyos terminálalapú teszteken elmarad a riválisoktól.
A fejlesztők számára a saját szerveres futtatás mellett az API-hozzáférés is elérhető, amelynek ára 1 millió bemeneti tokenre 1,00 dollár, míg 1 millió kimeneti tokenre 2,70 dollár. Az API támogatja a kép- és videófeldolgozást, az eszközmeghívásokat (tool calling), valamint a struktúrált JSON-kimeneteket is.
Az eredeti szöveg (MarkTechPost)
StepFun has released Step 5 Preview as open weights. FP8 and BF16 checkpoints are live on Hugging Face and ModelScope . Step 5 Preview is a sparse Mixture-of-Experts model from StepFun built for long-horizon agentic work. It has 600B total parameters, 27B active per token and up to 1M tokens of context. For developers, this is a new self-hostable option for coding agents, document analysis and finance workflows.
TL;DR
Size: 600B total, 27B active per token, up to 1M-token context.
Runs on: data-center GPUs only. FP8 needs 4x B300 or 8x H200. BF16 needs 8x B300 or 16x H200.
Performance: near open-weight peers GLM-5.3 and Kimi K3 on coding. Behind GPT-6 Astra and Claude Opus 5.
Best: 88.3% on AA-LCR long-context reasoning (Artificial Analysis).
Worst: 33.3% on Terminal-Bench 4.0, versus 41.9% for GLM-5.3.
What is Step 5 Preview?
Step 5 Preview is StepFun’s flagship model for agentic work . StepFun positions it for software engineering, professional knowledge work and finance. The model navigates large codebases, coordinates multi-file changes, runs code and iterates on results. It also analyzes long documents, charts, screenshots and video to produce structured reports.
The API launched September 20 . Weights followed on October 14 .
How does the architecture work?
Only 27B of the 600B parameters activate per token. StepFun’s tech team adds the internals:
Depth: 92 transformer blocks in a narrow, deep design.
Attention mix: gated sliding-window attention and full attention layers, interleaved 3:1.
Sparse GQA: full-attention layers pick 4,096 history tokens per query, scored in blocks of 8.
Speculative decoding: an MTP-3 head gives roughly 30% end-to-end speedup.
Training: FP8 mixed precision, with RL on million-level verifiable agentic environments.
How does Step 5 Preview perform on benchmarks?
StepFun ran its own evaluations at the High reasoning setting. Rivals in its chart ran at Max effort , so the comparison is not like-for-like.
Results reported on the Hugging Face card :
DeepSWE v1.1: 67.7 (SWE-agent harness, temperature 1.0, top_p 0.95)
Terminal-Bench 4.0: 33.3
Agents’ Last Exam (ALE-CLI): 29.5
Independent numbers come from Artificial Analysis via OpenRouter . The model scores 43.7 on the Intelligence Index. It hits 88.3% on AA-LCR and 46.5% on Humanity’s Last Exam. GDPval-AA lands at 54.3%.
Vals AI results show clear weak spots. SRE Bench is 0.4%. Harvey’s Legal Agent Benchmark is 9.2%.
On finance, StepFun’s chart shows 66.4% on FrontierFinance . That beats GLM-5.3 and Kimi K3, but trails Claude Opus 5 at 69.7%.
How does it compare with other open-weight models?
Feature Step 5 Preview GLM-5.3 Kimi K3 Total parameters 600B 753B ( HF file size ) 2.8T Active parameters 27B Not disclosed 104B Context window 1M 1M 1M Input modalities Text, image (API adds video) Text only Text, image Weight formats FP8, BF16 BF16, FP8 MXFP4 weights License StepFun Model License 1.0 GLM-5.3 license Kimi K3 License Minimum listed self-host setup 4x B300 (FP8) Not disclosed Not disclosed DeepSWE v1.1 (StepFun-reported) 67.7 66.9 67.5 Terminal-Bench 4.0 (StepFun-reported) 33.3 41.9 12.6 FrontierFinance (StepFun-reported) 66.4 64.1 62.6 API price per 1M tokens (in / out) $1.00 / $2.70 Not disclosed $3.00 / $15.00
Benchmark rows come from StepFun’s comparison chart, as transcribed by CellCog and eesel .
What hardware does Step 5 Preview need to run?
This is a data-center model. The FP8 checkpoint alone is 650.32 GB . Listed configurations :
FP8 on vLLM or SGLang: 4 B300 GPUs or 8 H200 GPUs, each on 1 node.
BF16 on vLLM: 1 node with 8 B300 GPUs, or 2 nodes with 16 H200 GPUs.
Transformers: offline generation only. The full BF16 shard workflow is not yet validated end to end.
vLLM and SGLang ship dedicated Docker images with OpenAI-compatible APIs. On Blackwell, expert-parallel modes use the MegaMoE backend. StepFun recommends temperature 1.0, top_p 0.95 and top_k 0.
How m
