Jiawei Fang

Self-Introduction

My name is Jiawei Fang (方家卫).

My vision is to build a close-loop emboided system—one in which machines continuously sense, interpret, generate, and refine their interactions with the physical world. To make such a closed-loop system possible, my research is driven by two tightly coupled questions: (1) How can machines perceive and reason about physical intelligence from real-world sensory interaction in an accurate and imperceptible way? (2) How can such physically grounded intelligence be further used to autonomously design and evolve embodied systems, including mechanical devices and robots?

I had my bachelor’s degree in Xiamen University. I am fortunate to work with Prof. Shihui Guo and Prof. Yipeng Qin for four years. Previously, I was a research intern at Carnegie Mellon University in the Computer Science Department and a visiting scholar at UC Berkeley in the Mechanical Engineering Department, mentored by Prof. Lining Yao and University of Washington, mentored by Prof. Yiyue Luo. I am now working at CSAIL, MIT, mentored by Prof. Wojciech Matusik.

If you are interested in any aspect of me, I am always open to discussions and collaborations. Feel free to reach out to me at jiaweif[at]stu.xmu.edu.cn

Research Experience

Massachusetts Institute of Technology
CDFG, CSAIL (2025.5 – present)
Research Assistant | Advisor: Prof. Wojciech Matusik

University of Washington, Seattle
Wearable Intelligence Lab, ECE (2024.7 – 2024.9)
Research Intern | Advisor: Prof. Yiyue Luo

University of California, Berkeley
Morphing Matter Lab, ME (2024.1 – 2025.5)
Visiting Scholar | Advisor: Prof. Lining Yao

Carnegie Mellon University
Morphing Matter Lab, HCII (2023.4 – 2024.5)
Research Intern | Advisor: Prof. Lining Yao

Project1: Acquiring Physical Intelligence Through Imperceptible Wearable Sensing

Project2: Designing and Evolving Embodied Systems

Flex Inertia Poser (FIP)

FIP: Endowing Robust Motion Capture on Daily Garment by Fusing Flex and Inertial Sensors

Jiawei Fang*, Ruonan Zheng*, Yuan Yao, Xiaoxia Gao, Chengxu Zuo, Shihui Guo, Yiyue Luo.

CHI 2025, ArXiv

FIP endows real-time, accurate motion capture on daily clothes by fusing flex and inertial sensors.

What if our clothes could capture our body motion accurately? This paper introduces Flexible Inertial Poser (FIP), a novel motion capturing system using daily garments with two elbow-attached flex sensors and four Inertial Measurement Units (IMUs). To address the inevitable sensor displacements in loose wearables which degrade joint tracking accuracy significantly, we identify the distinct characteristics of the flex and inertial sensor displacements and develop a Displacement Latent Diffusion Model and a Physics informed Calibrator to compensate for sensor displacements based on such observations, resulting in a substantial improvement in motion capture accuracy.

The process of prototyping: (a) Assemble the sensors together by soldering; (b) Cut the fabric into pieces according to the patterns; (c) Integrate the assembled sensors into the fabric through heat pressing and sew the fabric into the garment.

Posted

in

by

jiawei fang

Tags: