Yusi Sun

PhD student in the University of Hong Kong

uclaphoto.png

about me

I am a PhD student at the Data and System Engineering Department in the University of Hong Kong, under the supervision of Prof. Yong-Hong Kuo, HIS Lab. I’m also a visiting student under the supervision of Dr. Ying Jiang and Prof. Chenfanfu Jiang in AIVC Lab, UCLA. I received my Msc in Data and Systems Engineering, the University of Hong Kong, supervised by Dr. L.K.Y. Chan, and my B.Eng. in Engineering Management from Tianjin University.

My primary research interests focus on Agentic AI with Human in the loop and Augmented Reality, spanning human-computer interaction, embodied AI, computer vision, and interactive intelligent systems. My work centers on how AI can collaborate with humans in real time to perceive, interpret, and generate context-aware content in physical and mixed-reality environments. I am particularly interested in building human-in-the-loop AR systems that tightly couple human feedback, environmental understanding, and generative intelligence to support our daily life, situated assistance, interactive storytelling, and embodied experience design. A few questions that drive my recent research are:

Human-in-the-Loop AI for AR: How can we design AI systems that continuously incorporate human feedback, preferences, and intervention to enable more adaptive, controllable, and collaborative AR experiences?

Context-Aware and Embodied Intelligence: How can AI agents perceive objects, space, and user context in physical environments to generate meaningful, situated, and interactive content for AR and immersive applications?

Human-AI Creation and Collaboration: How can we enable AI to assist humans in better understanding, learning, creating, and interacting through mixed-reality systems that are both perceptually grounded and user-centered?

selected publications

2026

  1. foresee.png
    Foresee: Making Procedural Futures Tangible through Generative Previews
    Yusi Sun, Ying Jiang, Jiayin Lu, and 4 more authors
    2026
  2. jarvis.png
    JARVIS: A Just-in-Time AR Visual Instruction System for Cross-Reality Task Guidance
    Yusi Sun, Ying Jiang, Jiayin Lu, and 3 more authors
    2026

2025

  1. IEEE VR’26
    storytelling.jpg
    Object-driven narrative in ar: A scenario-metaphor framework with vlm integration
    Yusi Sun, Haoyan Guan, Yong Hong Kuo, and 1 more author
    2025