Kimi K2 0905
Kimi K2 0905 is the September update of [Kimi K2 0711](moonshotai/kimi-k2). It is a large-scale Mixture-of-Experts (MoE) language model developed by Moonshot AI, featuring 1 trillion total parameters with 32 billion active per forward pass. It supports long-context inference up to 256k tokens, extended from the previous 128k. This update improves agentic coding with higher accuracy and better generalization across scaffolds, and enhances frontend coding with more aesthetic and functional outputs for web, 3D, and related tasks. Kimi K2 is optimized for agentic capabilities, including advanced tool use, reasoning, and code synthesis. It excels across coding (LiveCodeBench, SWE-bench), reasoning (ZebraLogic, GPQA), and tool-use (Tau2, AceBench) benchmarks. The model is trained with a novel stack incorporating the MuonClip optimizer for stable large-scale MoE training.
Specifications
Modalities
Supported Parameters
Frequently asked questions
- Is Kimi K2 0905 available on FastMetal?
- Not at the moment. Kimi K3, from the same lab, is available on the FastMetal API today.
- What is the context window of Kimi K2 0905?
- 131,072 tokens, shared between the prompt and the response.
- How does Kimi K2 0905 rank?
- #92 on the public arena's Japanese board (ELO 1,378). Ranks move as the leaderboard is updated.