Jiarong Xing's Homepage

Jiarong Xing

• About
• Research
• Publications
• Group
• Awards
• Teaching
• Service

Jiarong Xing

Assistant Professor Computer Science Rice University

Office: 2099 Duncan Hall E-mail: jxing at rice dot edu [Google scholar] [LinkedIn] [Twitter]

About Me

I am an Assistant Professor in the Department of Computer Science at Rice University. Prior to this, I was a Postdoctoral Scholar in the Sky Computing Lab at UC Berkeley working with Prof. Ion Stoica. I earned my Ph.D. in Computer Science from Rice University and my bachelor's degree from Shandong University. I am seeking self-motivated interns and PhD students in the directions of LLM and agentic systems. If you're interested, feel free to reach out via email ['jxing AT rice.edu'].

Research

My group builds practical and open-source systems for evolving AI workloads (e.g., LLMs and agents) to run efficiently on GPUs. We currently focus on the following directions:

• GPU "OS": We aim to build an efficient and practical GPU "OS" that manages GPU resources for sharing across various AI workloads. This becomes increasingly important as GPUs become larger and workloads become more diverse and dynamic. See our vision paper for more thoughts. Our recent progress includes kvcached Fetching stars... , Prism, and ConServe.
• LLM/Agent routing: We aim to build an open-source community for LLM/Agent routing including evaluation, leaderboards, training, and new routers. Checkout our leaderboard website https://routeworks.github.io/ to understand the current state-of-the-art. To evaluate your routers, refer to our github RouterArena Fetching stars... . Datasets and routers are released on our huggingface. Read our RouterArena paper for more details.
• LLM/Agentic systems: We also work on general LLM/Agentic systems, such as large scale serving (SkyLB Eurosys'26), offline inference (BlendServe ASPLOS'26), code generation (S* EMNLP'25), deterministic inference (TBIK).

Older projects:

• Programmable hardware for systems/security: We leverage programmable switches and SmartNICs to build secure and efficient networked systems. Projects include NetWarden (USENIX Security'20), Ripple (USENIX Security'21), Bedrock (USENIX Security'22), RDMI (USENIX Security'23), FlexCore (NSDI'22), Pipeleon (SIGCOMM'23), Atlas (MobiCom'23).

Group

I am fortunate to work with a group of amazing students. Feel free to email if you are interested in working with us.

Current PhD students

• Xingqi Cui (2025-)
• Rixin Liu (2025-)
• Louie Lu (2025-)

Current graduate/undergraduate RAs

• George Zhang (undergraduate)
• Shen Zhang (undergraduate)

Awards & Honors

• COMP 600 Best Presentation Award, Rice University 2024
• USENIX Security Distinguished Paper Award 2023
• Future Faculty Fellow, Rice University 2023
• Google PhD Fellowship for systems and networking (6 students selected world-wide), Google 2022
• Meta PhD Research Fellowship finalists for networking (6 students selected world-wide), Meta 2022
• Lodieska Stockbridge Vaughn Fellowship(3 student selected university-wide), Rice University 2021
• Ken Kennedy Institute 2020/21 Andrew Ladd Graduate Fellowship (1 student selected department-wide), CS Department, Rice University 2020

Teaching

• COMP 620 Graduate Seminar in Computer Systems (Spring 2026) [Course page]
• COMP 436/536 Secure and Cloud Computing (Fall 2025) [Course page]

Service

Conference committee

• MLSys 2026, NSDI 2026, ASPLOS 2026
• ACM CCS 2025, APSys 2025, S&P 2025
• IEEE Symposium on Security and Privacy (S&P) 2024
• EuroP4 2023

Journal reviewer

• IEEE/ACM Transactions on Networking
• IEEE Transactions on Parallel and Distributed Systems
• Journal of Systems Research