Publications

publications by categories in reversed chronological order. generated by jekyll-scholar.

2026

  1. MAC.png
    MAC-Attention: a Match-Amend-Complete Scheme for Fast and Accurate Attention Computation
    Jinghan Yao ,  Sam Adé Jacobs ,  Walid Krichene , and 2 more authors
    Advances in Ninth Annual Conference on Machine Learning and Systems, MLSys 2026, 2026
  2. NIMBLE.png
    From Skew to Symmetry: Node-Interconnect Multi-Path Balancing with Execution-time Planning for Modern GPU Clusters
    Jinghan Yao ,  Kaushik Kandadi ,  Bharath Ramesh , and 2 more authors
    Advances in 40th IEEE International Parallel & Distributed Processing Symposium, IPDPS 2026, 2026

2025

  1. deepspeed.svg
    Training ultra long context language model with fully pipelined distributed transformer
    Jinghan Yao ,  Sam Ade Jacobs ,  Masahiro Tanaka , and 4 more authors
    Advances in Eighth Annual Conference on Machine Learning and Systems, MLSys 2025, 2025

2024

  1. exflow.png
    Exploiting Inter-Layer Expert Affinity for Accelerating Mixture-of-Experts Model Inference
    Jinghan Yao ,  Quentin Anthony ,  Aamir Shafi , and 2 more authors
    Advances in 38th IEEE International Parallel & Distributed Processing Symposium (IPDPS 24), 2024

2023

  1. flover.png
    Flover: A Temporal Fusion Framework for Efficient Autoregressive Model Parallel Inference
    Jinghan Yao ,  Nawras Alnaasan ,  Tian Chen , and 3 more authors
    Advances in 30th IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING, DATA, & ANALYTICS (HiPC 23), 2023
  2. gvmi.png
    A novel framework for efficient offloading of communication operations to bluefield smartnics
    Kaushik Kandadi Suresh ,  Benjamin Michalowicz ,  Bharath Ramesh , and 6 more authors
    In 2023 IEEE International Parallel and Distributed Processing Symposium (IPDPS 23) , 2023
  3. xccl.png
    MPI-xCCL: A Portable MPI Library over Collective Communication Libraries for Various Accelerators
    Chen-Chun Chen ,  Kawthar Shafie Khorassani ,  Pouya Kousha , and 4 more authors
    In Proceedings of the SC’23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis , 2023

2021

  1. soft.png
    Soft: Softmax-free transformer with linear complexity
    Jiachen Lu ,  Jinghan Yao ,  Junge Zhang , and 6 more authors
    Advances in Neural Information Processing Systems (NeurIPS 21), 2021

2020

  1. sprnet.png
    SPRNet: single-pixel reconstruction for one-stage instance segmentation
    Jinghan Yao ,  Jun Yu ,  Jian Zhang , and 2 more authors
    IEEE transactions on cybernetics, 2020