Weiyan Wang (王伟俨)

Nothing is more practical than a good theory. —— Kurt Lewin
What I cannot create, I do not understand. —— Richard Feynman

Hi there! I am working as a senior R&D engineer with Technology and Engineering Group, Tencent, where I fortunately receive support from Project Up (青云计划). I focus on the co-design of both system and algorithm for large-scale machine learning systems. By exploring the large design space combining system and algorithm, I try to find better ways to make big models trained on big data really happen. I advocate the philosophy proposed by Wang Yangming, which regards the inner knowledge (i.e. abstract theory) and the exterior actions(i.e. concrete practices) as one (知行合一).

Brief Biography

I recieved the PhD degree from Computer Science and Engineering, Hong Kong University of Science and Technology, advised by Prof. Kai Chen. I obtained my M.Phil. degree in Computer Software and Theory from Institute of Software, Chinese Academy of Sciences, under the supervision of Prof. Yunquan Zhang and Dr. Guoping Long. My B.Eng. degree in Computer Science and Technology is from Huazhong University of Science and Technology.

Research Interests

Co-design in both System and Algorithm especially for:

• Efficient large-scale training
• Efficient model inference for real-time requirements
• Real big data without perfect supervision (e.g. sparse/scarce, noisy, and out-of-distribution labels/rewards)

Selected Publications

HY Multi-Modal Seriers

• HunyuanVideo-1.5: A Leading Lightweight Video Generation Model, Technical Report 2025
  Tencent Hunyuan Team (incl. Weiyan Wang) | GitHub
• HunyuanImage-3.0: A Powerful Native Multimodal Model for Image Generation, Technical Report 2025
  Tencent Hunyuan Team (incl. Weiyan Wang) | GitHub
• HunyuanVideo: A Systematic Framework For Large Video Generative Models, Technical Report 2024
  Tencent Hunyuan Team (incl. Weiyan Wang) | GitHub
• Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understanding, Technical Report 2024
  Tencent Hunyuan Team (incl. Weiyan Wang) | GitHub

the Selected Works for Efficient Training

• Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling, NeurIPS 2024(CCF-A)
  Shuaipeng Li, Penghao Zhao, Hailin Zhang, Samm Sun, Hao Wu, Dian Jiao, Weiyan Wang, Chengjun Liu, Zheng Fang, Jinbao Xue, Yangyu Tao, Bin CUI, Di Wang
• Addressing Network Bottlenecks with Divide-and-Shuffle Synchronization for Distributed DNN Training, Infocom 2022 (CCF-A)
  Weiyan Wang, Cengguang Zhang, Liu Yang, Kai Chen, Kun Tan
• Rethinking transport layer design for distributed machine learning, APNet 2019（CCF-C）
  Jiacheng Xia, Gaoxiong Zeng, Junxue Zhang, Weiyan Wang, Wei Bai, Junchen Jiang, Kai Chen
• Quantifying the Performance of Federated Transfer Learning, IJCAI FL Workshop 2019 (Best Student Paper)
  Qinghe Jing, Weiyan Wang, Junxue Zhang, Han Tian, Kai Chen

the Selected Works for Efficient Inference

• Exploiting Student Parallelism for Low-latency GPU Inference of BERT-like Models in Online Services, KDD 2025 (CCF-A)
  Weiyan Wang, Yilun Jin, Yiming Zhang, Victor Junqiu Wei, Han Tian, Li Chen, Jinbao Xue, Yangyu Tao, Di Wang, Kai Chen
• Enabling Edge-Cloud Video Analytics for Robotics Applications, Infocom 2021 (CCF-A)
  Yiding Wang, Weiyan Wang, Duowen Liu, Xin Jin, Junchen Jiang, Kai Chen
• MDP: Model Decomposition and Parallelization of Vision Transformer for Distributed Edge Inference, IEEE MSN (CCF-C)
  Weiyan Wang, Yiming Zhang, Yilun Jin, Han Tian, Li Chen
• CLSIFT: An Optimization Study of the Scale Invariance Feature Transform on GPUs, HPCC 2013 (CCF-C)
  Weiyan Wang, Yunquan Zhang, Guoping Long, Shengen Yan, Haipeng Jia

the Selected Works about Imperfect Supervision

• BeamVQ: Beam Search with Vector Quantization to Mitigate Data Scarcity in Physical Spatiotemporal Forecasting, Technical Report 2024
  Weiyan Wang, Xingjian Shi, Ruiqi Shu, Yuan Gao, Rui Ray Chen, Kun Wang, Fan Xu, Jinbao Xue, Shuaipeng Li, Yangyu Tao, Di Wang, Hao Wu, Xiaomeng Huang
• Prometheus: Out-of-distribution Fluid Dynamics Modeling with Disentangled Graph ODE, ICML 2024（CCF-A)
  Hao Wu, Huiyuan Wang, Kun Wang, Weiyan Wang, ChanganYe, Yangyu Tao, Chong Chen, Xian-Sheng Hua, Xiao Luo
• Multi-task Learning Based Keywords Weighted Siamese Model for Semantic Retrieval, PAKDD 2023 (CCF-C)
  Mengmeng Kuang, Zhenhong Chen, Weiyan Wang (Corresponding), Lie Kang, Qiang Yan, Min Tang, Penghui Hao
• Efficient Two-stage Label Noise Reduction for Retrieval-based Tasks, WSDM 2022 (CCF-B)
  Mengmeng Kuang, Weiyan Wang, Zhenhong Chen, Lie Kang, Qiang Yan

See the full Publications page for all 22 papers.

Professional Services

• 2025    NeurIPS Reviewer
• 2025    Journal Reviewer: Performance Evaluation, Sensor, and Electronics
• 2025    KDD Commendable Reviewer
• 2023    Globalcom Workshop AINextGenWN Reviewer
• 2022    ICNCIT Reviewer
• 2020    Sigcomm Artifact Reviewer
• 2013–2018    CSDN OpenCL Forum Moderator
• 2011–2013    OpenCV Code Contributor

Contact

• Work Email: neowywang AT tencent.com wwangbc@connect.ust.hk
• Personal Email: wangweiyanster AT gmail.com
• Google Scholar
• LinkedIn

Miscellaneous

I am a badminton fan and amateur player, especially for men’s doubles. I prefer combining drop shots with smashes, using an even-balance long-size Duora racket from Yonex. If I have time, I also like reading, hiking, and watching football.