.png){kind=small}
Nomy Jianing Yu
I am a designer and HCI researcher working at the intersection of embodied interaction, multisensory intelligence, and human-centered AI. My work investigates how computational systems enter human perception, emotion, and decision-making.
Through research-driven prototyping, user studies, and system building, I explore how AI can move beyond recognition toward participation: sensing human states, adapting over time, and intervening in ways that preserve agency. My projects span wearable and ambient interfaces, multisensory feedback systems, and human–AI co-creation tools, with a particular focus on how interaction design can shape more attuned, ethical, and experiential forms of intelligence.
Education
2024-Present
Harvard Graduate School of Design
Master in Design Studies, Mediums
Focused on human–computer interaction (HCI), embodied and multisensory AI. Cross-Registered at MIT Media Lab. Completed advanced coursework such as Tangible Interfaces, Enactive Design, Multimodal Interaction, Affective Computing, Machine Learning, and Computational Cognitive Science.
2019-2023
The University of Hong Kong
Bachelor of Arts and Sciences, Design+CS
First Class Honours
Received interdisciplinary training spanning design methodology, rapid prototyping, user research, and core computer science foundations including data structures, object-oriented programming, and statistics.
Participated in an exchange program at the National University of Singapore (2022).
Research
Jun 2023-Aug 2024
Research Assistant II (full-time)
Department of Architecture, HKU
Supervisor: Haotian Zhang
Explored novel spatial experiences enabled by 3D reconstruction and generative techniques, including point clouds, Neural Radiance Fields (NeRF), and Gaussian Splatting. This research investigated how generative AI can be integrated into spatial design workflows from data capture and reconstruction to generation and representation.
Through iterative prototyping and exhibition, the research examined how AI-generated spaces influence interpretability, immersion, and design decision-making.
May-Sep 2023
Student Research Assistant
Human-Centered AI Lab, Northeastern University
Supervisor: Dakuo Wang
Investigated human–AI collaboration in high-stakes clinical decision-making, with a focus on how clinicians interpret, trust, and act upon AI-generated predictions. The project examined the role of interface design in shaping cognitive support and sensemaking in medical AI systems.
Through interface prototyping and qualitative user studies with medical professionals, this research identified limitations in existing AI-driven diagnostic tools and explored design strategies that reposition AI from an authoritative predictor to a collaborative partner that supports clinical reasoning and judgment.
Internship
Jun-Aug 2025
Hardware Interaction Design Intern
Design Innovation Team@PICO, ByteDance
San Jose, CA
Worked on hardware interaction design, human factors research, and intelligent systems for AR eyewear. The internship focused on understanding how physical design parameters and interaction strategies shape comfort, perception, and long-term usability in everyday wearable devices.
I conducted a design-of-experiments (DOE)–based human factors study to identify key drivers of comfort and stability in AR glasses, and explored personalized information interaction on smart eyewear, investigating how human-in-the-loop learning can support adaptive, context-aware user experiences.
Teaching Experience
Summer 2024
Workshop Teaching Assistant
MIT City Science Shanghai Lab + HKU
Atlas of the Unseen
Supported a cross-institutional design workshop focused on sensing, mapping, and visualizing invisible urban phenomena. Assisted students in translating environmental collections into experiential design outcomes.
Spring 2024
Course Teaching Assistant
HKU
React to Climate Change
Assisted in designing a course to explore climate change through sensing and speculative design. Guided students in building interactive systems and visual narratives that connect environmental data with human experience.
Spring 2024
Course Teaching Assistant
HKU
Digital Representation
Supported instruction in digital modeling and representation techniques, helping students bridge computational tools with spatial reasoning and design intent.
Winter 2023
Workshop Teaching Assistant
ACADIA
Yesterday Once More
Assisted an intensive workshop on advanced 3D reconstruction techniques at the ACADIA conference. Helped 20 participants prototype AI-assisted spatial representations and reflect on the role of generative systems in spatial design.