Phancy and RiseUnion Launch ModelSphere, an Open-Source, One-Stop Production-Grade AI Deployment Platform
- Written by Reporters
- ModelSphere simplifies enterprise large-model deployment and operations and boosts peak throughput by up to 285% (nearly 4x the baseline).
- Building a more open, chip-agnostic foundation for AI at scale.
- Free and open source for enterprise users and available on Github now.
- Simplified deployment and stable model services: ModelSphere provides a graphical console and pre-built deployment capabilities that reduce the environment-configuration code developers need to write, helping them quickly stand up inference services for large models and simplifying deployment across different chip clusters. Built-in enterprise-grade capabilities, including automatic elastic scaling, prefill-decode (PD) disaggregated deployment, three-tier KV caching, high-availability load balancing and automatic stream resumption after service interruptions, keep model services running stably in production.
- Continuous automated tuning for higher efficiency: The platform's built-in AutoTune intelligent model scheduling strategy, combined with adaptive load-balancing scheduling that leverages hardware acceleration, improves request-handling capacity and time to first token (TTFT) while lowering inference cost per token. Built-in AutoTune boosts peak throughput by around 285% compared with the baseline, increasing overall performance to nearly four times the previous level and making full use of the available computing power.
- Unified management of diverse chips without repeated adaptation: Integrated with the EngineX inference engine, ModelSphere supports and is deeply optimized for a wide range of AI accelerators. It enables unified and mixed scheduling of all computing resources, including Huawei Ascend, Iluvatar CoreX, Moore Threads and Hygon DCU, so users do not need to rewrite low-level code for each chip.
- Continuous optimization for mainstream models and faster deployment: The ModelSphere team closely tracks iterations in the open-source community and has already adapted and optimized the platform for leading models, including DeepSeek-V4/V4-Flash, Qwen, Kimi, MiniMax and GLM. New models can be deployed quickly after release and tuned to production-grade performance, helping enterprises put the latest models to work in real business scenarios.
The issuer is solely responsible for the content of this announcement.
About Phancy Group
Phancy Group (6682.HK) is a leading full-stack AI cloud services platform, providing comprehensive solutions for the AI 2.0 era. Our offerings include SageAIOS, HAMi vGPU and ModelHub XC, delivering efficient and scalable AI infrastructure with end-to-end capabilities. We provide a complete solution from heterogeneous compute resource management and optimization to the deployment of intelligent agent models. These solutions empower digital transformation across a wide range of industries, supporting our vision of building a large-scale and efficient "Token Factory." Guided by the mission of "AI for Everyone" and positioned as the "Navigator of AI," Phancy Group is committed to becoming a global leader in Artificial General Intelligence.
Source https://www.media-outreach.com/news/china/2026/10/16/494454/

