HCI / XR / AI / Spatial Learning

Lefan Lai

PhD Student in Human-Computer Interaction, Extended Reality, and AI

Designing interactive and intelligent technologies for spatial learning, cognition, and human skill development.

Portrait of Lefan Lai
Human-centered systems HCI / XR / AI

About

I am currently a PhD student at the University of Auckland, New Zealand. My PhD is fully funded through a Smart Ideas project supported by MBIE. I am jointly supervised by Associate Professor Burkhard Wuensche and Professor Mark Billinghurst, with each supervisor contributing equally to my PhD supervision. I am affiliated with both the Graphics Lab and the Empathic Computing Lab.

Before starting my PhD, I completed a Master of Computer Science at the University of Sydney, where I worked in the AID-Lab under the supervision of Dr Brandon Syiem and Dr Zhanna Sarsenbayeva. I received my Bachelor's degree in Software Engineering from Nanchang University.

My research interests include Human-Computer Interaction, Extended Reality and Mixed Reality, Artificial Intelligence, Large Language Models, multimodal AI, and spatial skills training. I am particularly interested in how interactive and intelligent technologies can be designed to support spatial learning, cognition, and human skill development.

In addition to applied HCI and XR research, I am also interested in AI and LLM algorithms, especially efficient, reliable, and human-centred methods for large language models and multimodal systems. My current research explores immersive environments, AI-driven systems, and adaptive interaction techniques for training and assessing spatial skills in educational contexts.

Research Interests

Four threads that shape the work.

Human-Computer Interaction

Designing and evaluating interactive systems that support human cognition, learning, and experience.

AI, LLMs, and Multimodal AI

Developing and studying intelligent systems that are efficient, reliable, and human-centred.

Spatial Skills Training

Designing adaptive and interactive tools for training spatial reasoning, STEM-related skills, and human skill development.

Extended Reality

Exploring how virtual and physical environments shape perception, attention, interaction, and spatial behaviour.

Education

A research path across software engineering, computer science, and HCI.

2026.5 - Present

Doctor of Philosophy

The University of Auckland, New Zealand

  • Fully funded PhD position supported by a Smart Ideas research project.
  • Research Area: HCI, LLMs, AI, MR, and Education.
  • Supervisors: Professor Mark Billinghurst and Associate Professor Burkhard Wuensche.

2024.7 - 2026.1

Master of Computer Science

The University of Sydney, Australia

  • Weighted Average Mark: 85.75, High Distinction.
  • Thesis: Searching Through Complex Worlds.
  • Thesis Grade: 92, High Distinction.
  • Supervisors: Dr Brandon Syiem and Dr Zhanna Sarsenbayeva.

2019.9 - 2023.6

Bachelor of Software Engineering

Nanchang University, China

Selected Research Experience

Research projects across MR interaction, spatial cognition, and multimodal AI.

The University of Sydney | 2025.2 - 2025.9

Searching Through Complex Worlds: Visual Search and Spatial Regularity Memory in Mixed Reality

This project investigates how physical surroundings, virtual depth cues, and task demands shape visual search and spatial regularity memory in mixed reality. It examines how users search for virtual targets in complex environments and how repeated spatial configurations influence performance.

Led the entire project, designing and executing all stages from conception to completion.

Mixed Reality Visual Search Spatial Regularity HCI

The Hong Kong University of Science and Technology | 2026.3 - 2026.5

Looking Closer When Unsure: VIGOR, A Training-Free Framework for Mitigating Object Hallucination in Multimodal Large Language Models

This project explores uncertainty-guided local visual refinement for reducing object hallucination in multimodal large language models.

Contributed to idea refinement, manuscript writing and revision, experimental design, and implementation.

MLLMs Object Hallucination Training-Free Methods

Publications

Selected publication.

Contact

Open to research conversations about HCI, XR, AI, and spatial learning.

I would be very happy to discuss extended reality, AI, HCI, and spatial learning, and I welcome research collaborations, project ideas, and thoughtful academic conversations.