Frank Lee
Employers on the program
- 2025GMI Cloud1 talk
Events1
Conferences1
Talks1
Years active2025
Appearances by year
- AICon 全球人工智能开发与应用大会 (AICon Global AI Development and Application Conference)
Talks
| Date | Event | Conference | Role | Title | Links |
|---|---|---|---|---|---|
| May 23, 2025 | AICon 全球人工智能开发与应用大会 | 上海 | AICon 全球人工智能开发与应用大会 (AICon Global AI Development and Application Conference) | speaker | GMI Cloud 全球化高性能分布式推理服务构建实践 as GMI Cloud AI应用全球化浪潮下, 推理效率与算力供给成为破局关键。本次演讲以GMI Cloud Inference Engine为锚点,拆解其高并发、低延迟、动态扩缩容能力如何支撑全球AI业务爆发,深度分享GMI Cloud自研推理平台的架构设计、跨区域合规部署及软硬协同优化实践,揭秘其实现推理成本、指数级效率提升的关键路径。…Show lessAI应用全球化浪潮下, 推理效率与算力供给成为破局关键。本次演讲以GMI Cloud Inference Engine为锚点,拆解其高并发、低延迟、动态扩缩容能力如何支撑全球AI业务爆发,深度分享GMI Cloud自研推理平台的架构设计、跨区域合规部署及软硬协同优化实践,揭秘其实现推理成本、指数级效率提升的关键路径。 演讲提纲: AI应用爆发背景下模型推理服务的核心挑战分析 GMI Cloud推理优化技术分享 单集群内推理服务自动扩容技术 跨集群跨地区的推理服务自动扩容技术 单集群的PD分离技术 基于共享持久化存储的跨集群PD分离技术 推理参数自动化评测… |
Frequent co-speakers
No one else spoke at two or more of the same events.
Speakers with the same name are merged into one entry, so this page may combine more than one person. Affiliations are shown as each conference listed them.