视频需要登录后观看
《大模型推理系统的全栈优化》 本研究聚焦大模型推理系统,探讨推理阶段在算力、延迟与吞吐之间的系统级权衡。 This study focuses on system-level design and optimization for large language model inference.