profile photo

Haojie Cheng (程浩杰)

​Research Fellow
National University of Singapore (NUS)
Email: hjcheng [at] nus.edu.sg

github github github github github


Short Bio

I am currently a Research Fellow at the Immersive Reality Lab, College of Design and Engineering (CDE), working in collaboration with the Yong Loo Lin School of Medicine, NUS. Before joining NUS, I obtained my Ph.D. degree in March, 2024 at University of Science and Technology of China (USTC). My research interest mainly focuses on the intersection of computer vision and computer graphics, including but not limited to interactive VR/AR/MR rendering/interaction, egocentric pose estimation, and panoramic scene understanding. My research goal is to enable realistic content creation automatically for VR/AR/MR applications. Recently, my research interests have expanded to full-body motion estimation and motion generation for embodied avatars and teleoperation in VR/AR/MR, targeting applications in entertainment and healthcare.

[Pinned Ads] Our lab at NUS is recruiting Postdoctoral Research Fellows, PhD students, Research Assistants (RA), and Research Engineers (RE), working on VR/AR/MR Rendering/Interaction, Generative AI, and Robotic Surgery Training. Interested candidates are welcome to email me directly.

News
Publications
clean-usnob

EgoPoseVR: Spatiotemporal Multi-Modal Reasoning for Egocentric Full-Body Pose in Virtual Reality
Haojie Cheng, Shaun Jing Heng Ong, Shaoyu Cai, Aiden Tat Yang Koh, Fuxi Ouyang, and Eng Tat Khoo.
IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR 2026, TVCG Journal Track)
[Paper] [Project]

clean-usnob

A Mixed Reality System for Robust Manikin Localization in Childbirth Training
Haojie Cheng, Chang Liu, Abhiram Kanneganti, Gosavi Arundhati Tushar, Mahesh Choolani, and Eng Tat Khoo.
IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR 2026, TVCG Journal Track)
[Paper] [Project]

clean-usnob

Evaluating Image Matching with Robust Estimators: Bridging Natural and Surgical Domains to Enhance Scene Understanding
Ying Zhen Tan, Haojie Cheng, Kian Wei Ng, Kee Yuan Ngiam, Yujia Gao, and Eng Tat Khoo.
IEEE Journal of Biomedical and Health Informatics (JBHI)
[ Paper] [Project]

clean-usnob

Real-time Realistic Volume Rendering of Consistently High Quality with Dynamic Illumination
Chunxiao Xu, Haojie Cheng, Zhenxin Chen, Jiajun Wang, Yibo Chen and Lingxiao Zhao.
IEEE Transactions on Visualization and Computer Graphics (TVCG)
[ Paper] [Project]

clean-usnob

Realistic Volume Rendering with Environment-Synced Illumination in Mixed Reality
Haojie Cheng, Chunxiao Xu, Xujing Chen, Zhenxin Chen, Jiajun Wang and Lingxiao Zhao.
IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR Adjunct) 2023
[ Paper] [ Project]

clean-usnob

A Mixed Reality Framework for Interactive Realistic Volume Rendering with Dynamic Environment Illumination
Haojie Cheng, Chunxiao Xu, Zhenxin Chen, Jiajun Wang, Yibo Chen and Lingxiao Zhao.
IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) 2023
[ Paper] [Project]

clean-usnob

Fast and Accurate Illumination Estimation Using LDR Panoramic Images for Realistic Rendering
Haojie Cheng, Chunxiao Xu, Jiajun Wang, Zhenxin Chen and Lingxiao Zhao.
IEEE Transactions on Visualization and Computer Graphics (TVCG)
[ Paper] [ Project]

clean-usnob

Quad-fisheye Image Stitching for Monoscopic Panorama Reconstruction
Haojie Cheng, Chunxiao Xu, Jiajun Wang and Lingxiao Zhao.
Computer Graphics Forum (CGF)
[ Paper] [ Project]



Awards
  • Outstanding Ph.D. thesis of Anhui Province, China, 2025.
  • Outstanding Ph.D. thesis of USTC, China, 2024.
  • Outstanding graduate of Anhui Province, China, 2024.
  • Outstanding graduate of USTC, China, 2024.
  • China National Scholarship, 2023.
  • First class scholarship, University of Science and Technology of China, 2023.
  • Nanjing Branch Scholarship of Chinese Academy of Sciences, 2023.
  • First class scholarship, University of Science and Technology of China, 2022.
  • First class scholarship, University of Science and Technology of China, 2021.
  • National Second Prize, Chinese Mathematical Contest In Modeling, 2020.
  • First class scholarship, University of Science and Technology of China, 2020.
  • National First Prize, Chinese Mechanical Innovation and Design Competition, 2017.

Miscellaneous

Conference Service
  • Associate Chair for the DIS 2026 Artifacts & Systems subcommittee.
  • Program Committee Member for NeuroXR@ISMAR 2025.
  • Reviewer for CHI 2026.
  • Reviewer for UbiComp/ISWC 2025.
  • Reviewer for SIGGRAPH Asia 2024, 2025, 2026.
  • Reviewer for MICCAI 2024.
  • Reviewer for EuroVis 2024.
  • Reviewer for IEEE VR 2024, 2025, 2026.
  • Reviewer for ISMAR 2023, 2024, 2025, 2026.
Teaching/Research Mentorship and Presentation Experience
  • Jan. 2026 - Present Co-Mentor: Music-to-Dance Generation for Automated Choreography (MSc Project, UROP)
  • From Aug. 2026 (TBA) Co-Supervisor: AI Digital Twin for Robotic Surgery Training (NUSGRTII PhD Project)
  • Jan. 2026 – Jun. 2026 Co-Mentor: Egocentric Pose Estimation in Mixed Reality (Undergraduate Internship)
  • Jan. 2026 – Aug. 2026 Co-Mentor: Haptic Intervention for Eating Behavior (NUS–Stanford–Meta, CDE4301)
  • Jan. 2026 – Aug. 2026 Co-Mentor: Scene Reconstruction Using Gaussian Splatting (CDE3301)
  • Jul. 2025 Talk: Science Tuesday Talk at the Department of O&G, NUS
  • Feb. 2025 Talk: Virtual Reality Workshop at CDE, NUS
  • Jul. 2024 – Nov. 2024 Co-Mentor: Mixed Reality for Obstetrics Training (EG3301R)
  • Sept. 2022 – Jan. 2023 Teaching Assistant: Advanced Visualization of Medical Images (BMED6207P)