Zhihao Jia

发表论文 18 篇 · 总被引 1023 次 · h-index 13

代表论文

SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification (2023 · International Conference on Architectural Support for Programming Languages and Operating Systems · 被引 417)
Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems (2023 · ACM Computing Surveys · 被引 181)
SpotServe: Serving Generative Large Language Models on Preemptible Instances (2023 · International Conference on Architectural Support for Programming Languages and Operating Systems · 被引 155)
Sia: Heterogeneity-aware, goodput-optimized ML-cluster scheduling (2023 · Symposium on Operating Systems Principles · 被引 119)
Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow (2024 · International Conference on Architectural Support for Programming Languages and Operating Systems · 被引 100)
Parcae: Proactive, Liveput-Optimized DNN Training on Preemptible Instances (2024 · Symposium on Networked Systems Design and Implementation · 被引 47)