publications

2026

  1. OSDI’26
    No Buffer, No Bottleneck: Efficient Zero-Copy KV Cache Offloading for Long-Context LLMs
    Shutian Luo and Haiying Shen
    In Proceedings of the 20th USENIX Symposium on Operating Systems Design and Implementation (OSDI ’26), 2026

2025

  1. ASPLOS’25
    Embracing Imbalance: Dynamic Load Shifting among Microservice Containers in Shared Clusters
    Shutian Luo, Jianxiong Liao, Huanle Xu, and 2 more authors
    In Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS ’25), 2025
  2. SoCC’25
    Understanding Diffusion Model Serving in Production: A Top-Down Analysis of Workload, Scheduling, and Resource Efficiency
    Yanying Lin, Shuaipeng Wu, Shutian Luo, and 8 more authors
    In Proceedings of the 16th ACM Symposium on Cloud Computing (SoCC ’25), 2025
  3. HPCA
    Grad: Intelligent Microservice Scaling by Harnessing Resource Fungibility
    Liao Chen, Chenyu Lin, Shutian Luo, and 2 more authors
    In Proceedings of the 31st IEEE International Symposium on High-Performance Computer Architecture (HPCA ’25), 2025

2024

  1. ISCA’24
    Derm: SLA-aware Resource Management for Highly Dynamic Microservices
    Liao Chen, Shutian Luo, Chenyu Lin, and 4 more authors
    In Proceedings of the 51st Annual IEEE/ACM International Symposium on Computer Architecture (ISCA ’24), 2024
  2. ICDCS
    Quart: Latency-Aware FaaS System for Pipelining Large Model Inference
    Yanying Lin, Yanbo Li, Yingfei Tang, and 4 more authors
    In Proceedings of the 44th IEEE International Conference on Distributed Computing Systems (ICDCS ’24), 2024
  3. TOCS
    Optimizing Resource Management for Shared Microservices: A Scalable System Design
    Shutian Luo, Chenyu Lin, Kejiang Ye, and 5 more authors
    ACM Transactions on Computer Systems, 2024

2023

  1. ASPLOS’23
    Erms: Efficient Resource Management for Shared Microservices with SLA Guarantees
    Shutian Luo, Huanle Xu, Kejiang Ye, and 5 more authors
    In Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS ’23), 2023

2022

  1. SoCC’22
    The Power of Prediction: Microservice Auto Scaling via Workload Learning
    Shutian Luo, Huanle Xu, Kejiang Ye, and 4 more authors
    In Proceedings of the 13th ACM Symposium on Cloud Computing (SoCC ’22), 2022
  2. TPDS
    An In-depth Study of Microservice Call Graph and Runtime Performance
    Shutian Luo, Huanle Xu, Chengzhi Lu, and 5 more authors
    IEEE Transactions on Parallel and Distributed Systems, 2022

2021

  1. SoCC’21
    Characterizing Microservice Dependency and Performance: Alibaba Trace Analysis
    Shutian Luo, Huanle Xu, Chengzhi Lu, and 6 more authors
    In Proceedings of the 12th ACM Symposium on Cloud Computing (SoCC ’21), 2021