Compatible Moonshot AI Kimi Models
You can import large language models from Hugging Face and OCI Object Storage buckets into OCI Generative AI, create endpoints for those models, and use them in the Generative AI service.
Kimi
The Kimi K2.6 and Kimi K2.7 Code models are optimized for long-horizon coding, agentic workflows, and complex software engineering tasks. Kimi K2.6 is designed for coding, coding-driven design, autonomous execution, and task orchestration, while Kimi K2.7 Code is a coding-focused model built on Kimi K2.6 for long-horizon software engineering workflows.
| Hugging Face Model ID | Model Capability | Minimum Dedicated AI Cluster Unit Shape |
|---|---|---|
| moonshotai/Kimi-K3 | IMAGE_TEXT_TO_TEXT |
|
| moonshotai/Kimi-K2.6 | TEXT_TO_TEXT |
|
| moonshotai/Kimi-K2.7-Code | TEXT_TO_TEXT |
|
Note
For Kimi K3, the
For Kimi K3, the
H100_X32 unit shape is available in the US Midwest (Chicago) and Japan Central (Osaka) regions, and the B200_X16 unit shape is available in the UAE Central (Abu Dhabi) region. Multi-node serving is also available in the UAE Central (Abu Dhabi) and Japan Central (Osaka) regions. Important
- For imported models, you can use the native context length specified by the model provider. However, the effective maximum context length is limited by the underlying hardware setup that you select for the hosting dedicated AI clusters in OCI Generative AI. To take full advantage of a model's native context length, you might need to provision more hardware resources.
- Use the fine-tuned models only if they match the compatible base model's transformer version and have a parameter count within ±10% of the original.
- For available hardware and steps on how to deploy the imported models, see Managing Imported Models.