Yuhang Yao

Building Super-Intelligent Agents

I am a Senior Research Engineer at Zoom, working on conversation intelligence, virtual agents, and post-training.

Previously, I was a founding research scientist at TensorOpera AI, where I helped build a production LLM agent system from 0 to 1M DAU. I earned my PhD in Computer Engineering from Carnegie Mellon University in 2024, advised by Prof. Carlee Joe-Wong, and completed my bachelor's degree in Computer Science (IEEE Honor Class) at Shanghai Jiao Tong University in 2019.

Open to collaboration on efficient agent systems. For conversations, feel free to reach out via LinkedIn or email.

News

Jul 05, 2026 Our VISTA coding benchmark was covered by 机器之心.
Jun 28, 2026 Released the VISTA benchmark and leaderboard for visual spec-to-web-app coding agents; read the paper.
Nov 10, 2025 Graph based Agent Planning, GAP are accepted by NeurIPS workshop Nora.
Nov 01, 2025 FedGraph and FedLink are accepted by NeurIPS workshop NPGML.
Aug 04, 2025 Gave an 1-min talk at Berkeley Agentic AI Summit! Finished 10K (6.2 miles) at San Francisco Marathon!
May 09, 2025 Got the A.G. Milnes Award 2025 (Best PhD Thesis Award at CMU ECE Department)!!
May 07, 2025 Check my interview from MIT Technology Review and DeepTech Wechat Blog.
Mar 01, 2025 Deployed the Super Agent System CoCo at ChainOpera Platform.
Jun 28, 2024 We have released pretrained LLM Fox-1-1.6B and instruction version Fox-1-1.6B-Instruct-v0.1. Top-3 among Small Language Models!
Fox-1-1.6B
Feb 15, 2024 We are developing FedGraph library for federated graph learning.
Feb 01, 2024 I join TensorOpera AI as a research scientist for generative AI.
Dec 10, 2023 FedGCN and WyzeRule are accepted by NeurIPS. FedML-HE gets accepted by FL-NeurIPS workshop.

Selected Publications

2026

  1. trustworthy_agent_network.png
    Trustworthy Agent Network: Trust in Agent Networks Must Be Baked In, Not Bolted On
    Yixiang Yao , Yuhang Yao, Xinyi Fan , Jiechao Gao , Jie Wang , Minjia Zhang , Srivatsan Ravi , and Carlee Joe-Wong
    KDD Blue Sky Ideas Track, 2026
    PDF Website
  2. vista.png
    VISTA: An End-to-End Benchmark for Visual Spec-to-Web-App Coding Agents
    JunJia Guo , Yuhang Yao, Jiawei Zhou , and Jingdi Chen
    arXiv preprint arXiv:2605.26144, 2026
    PDF Website
  3. fedllm.png
    Federated large language models: Current progress and future directions
    Yuhang Yao, Jianyi Zhang , Junda Wu , Chengkai Huang , Yu Xia , Tong Yu , Ruiyi Zhang , Sungchul Kim , Ryan Rossi , Ang Li , Lina Yao , Julian McAuley , Yiran Chen , and Carlee Joe-Wong
    Pacific-Asia Conference on Knowledge Discovery and Data Mining, 2026
    PDF

2025

  1. gap.png
    GAP: Graph-Based Agent Planning with Parallel Tool Use and Reinforcement Learning
    Jiaqi Wu , Qinlao Zhao , Zefeng Chen , Kai Qin , Yifei Zhao , Xueqian Wang , and Yuhang Yao
    NORA Workshop in NeurIPS, 2025
    PDF Website
  2. super_agent.png
    Toward super agent system with hybrid ai routers
    Yuhang Yao, Haixin Wang , Yibo Chen , Jiawen Wang , Min Chang Jordan Ren , Bosheng Ding , Salman Avestimehr , and Chaoyang He
    arXiv preprint arXiv:2504.10519, 2025
    PDF Video Blog Slides Website

2024

  1. router.png
    Tensoropera router: A multi-model router for efficient llm inference
    Dimitris Stripelis , Zhaozhuo Xu , Zijian Hu , Alay Dilipbhai Shah , Han Jin , Yuhang Yao, Jipeng Zhang , Tong Zhang , Salman Avestimehr , and Chaoyang He
    EMNLP (Industry Track), 2024
    PDF Slides
  2. scalellm.png
    Scalellm: A resource-frugal LLM serving framework by optimizing end-to-end efficiency
    Yuhang Yao, Han Jin , Alay Dilipbhai Shah , Shanshan Han , Zijian Hu , Dimitris Stripelis , Yide Ran , Zhaozhuo Xu , Salman Avestimehr , and Chaoyang He
    EMNLP (Industry Track), 2024
    PDF Slides
  3. fox.png
    Fox-1: Open Small Language Model for Cloud and Edge
    Zijian Hu , Jipeng Zhang , Rui Pan , Zhaozhuo Xu , Shanshan Han , Han Jin , Alay Dilipbhai Shah , Dimitris Stripelis , Yuhang Yao, Salman Avestimehr , Tong Zhang , and Chaoyang He
    arXiv preprint arXiv:2411.05281, 2024
    PDF Blog Website
  4. fedgraph.png
    FedGraph: A Research Library and Benchmark for Federated Graph Learning
    Yuhang Yao, Yuan Li , Xinyi Fan , Junhao Li , Kay Liu , Weizhao Jin , Yu Yang , Srivatsan Ravi , Philip S Yu , and Carlee Joe-Wong
    New Perspectives in Graph Machine Learning, NeurIPS, 2024
    PDF Code
  5. fedgat.png
    FedGAT: A Privacy-Preserving Federated Approximation Algorithm for Graph Attention Networks
    Siddharth Ambekar , Yuhang Yao, Ryan Li , and Carlee Joe-Wong
    AAAI Workshop, 2024
    PDF Code
  6. fedgcn.png
    FedGCN: Convergence-Communication Tradeoffs in Federated Training of Graph Convolutional Networks
    Yuhang Yao, Weizhao Jin , Srivatsan Ravi , and Carlee Joe-Wong
    Advances in Neural Information Processing Systems, 2024
    PDF Code Slides
  7. wyzerule.png
    Wyze Rule: Federated Rule Dataset for Rule Recommendation Benchmarking
    Mohammad Mahdi Kamani , Yuhang Yao, Hanjia Lyu , Zhongwei Cheng , Lin Chen , Liangju Li , Carlee Joe-Wong , and Jiebo Luo
    Advances in Neural Information Processing Systems, 2024
    PDF Code Slides Website
  8. fedsecurity.png
    Fedmlsecurity: A benchmark for attacks and defenses in federated learning and llms
    Shanshan Han , Baturalp Buyukates , Zijian Hu , Han Jin , Weizhao Jin , Lichao Sun , Xiaoyang Wang , Wenxuan Wu , Chulin Xie , Yuhang Yao, Kai Zhang , Qifan Zhang , Yuhui Zhang , Carlee Joe-Wong , Salman Avestimehr , and Chaoyang He
    Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2024
    PDF Code
  9. multi_agent.png
    LLM multi-agent systems: Challenges and open problems
    Shanshan Han , Qifan Zhang , Yuhang Yao, Weizhao Jin , and Zhaozhuo Xu
    arXiv preprint arXiv:2402.03578, 2024
    PDF
  10. thesis.png
    Efficient Federated Graph Learning: Formulation, Algorithms and Applications
    Yuhang Yao
    Carnegie Mellon University , 2024
    🏆 A.G. Milnes Award (Best Thesis Award)
    PDF

2023

  1. fedrule.png
    FedRule: Federated Rule Recommendation System with Graph Neural Networks
    Yuhang Yao, Mohammad Mahdi Kamani , Zhongwei Cheng , Lin Chen , Carlee Joe-Wong , and Tianqiang Liu
    In Proceedings of the 8th ACM/IEEE Conference on Internet of Things Design and Implementation , 2023
    PDF Code Slides
  2. fedhe.png
    FedML-HE: An Efficient Homomorphic-Encryption-Based Privacy-Preserving Federated Learning System
    Weizhao Jin , Yuhang Yao, Shanshan Han , Jiajun Gu , Carlee Joe-Wong , Srivatsan Ravi , Salman Avestimehr , and Chaoyang He
    FL-NeurIPS Workshop, 2023
    PDF Code

2022

  1. neuralmab.png
    A neural-based bandit approach to mobile crowdsourcing
    Shouxu Lin , Yuhang Yao, Pei Zhang , Hae Young Noh , and Carlee Joe-Wong
    In Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications , 2022
    PDF

2021

  1. gcnse.png
    Gcn-se: Attention as explainability for node classification in dynamic graphs
    Yucai Fan , Yuhang Yao, and Carlee Joe-Wong
    In 2021 IEEE International Conference on Data Mining (ICDM) , 2021
    PDF Code
  2. rnngcn.png
    Interpretable clustering on dynamic graphs with recurrent graph neural networks
    Yuhang Yao, and Carlee Joe-Wong
    In Proceedings of the AAAI Conference on Artificial Intelligence , 2021
    PDF Code