Self-Introduction

My name is Jiawei Fang (方家卫).

My vision is to build a close-loop emboided system—one in which machines continuously sense, interpret, generate, and refine their interactions with the physical world. To make such a closed-loop system possible, my research is driven by two tightly coupled questions: (1) How can machines perceive and reason about physical intelligence from real-world sensory interaction in an accurate and imperceptible way? (2) How can such physically grounded intelligence be further used to autonomously design and evolve embodied systems, including mechanical devices and robots?

I had my bachelor’s degree in Xiamen University. I am fortunate to work with Prof. Shihui Guo and Prof. Yipeng Qin for four years. Previously, I was a research intern at Carnegie Mellon University in the Computer Science Department and a visiting scholar at UC Berkeley in the Mechanical Engineering Department, mentored by Prof. Lining Yao and University of Washington, mentored by Prof. Yiyue Luo. I am now working at CSAIL, MIT, mentored by Prof. Wojciech Matusik.

If you are interested in any aspect of me, I am always open to discussions and collaborations. Feel free to reach out to me at jiaweif[at]stu.xmu.edu.cn

Research Experience

Massachusetts Institute of Technology
CDFG, CSAIL (2025.5 – present)
Research Assistant | Advisor: Prof. Wojciech Matusik

University of Washington, Seattle
Wearable Intelligence Lab, ECE (2024.7 – 2024.9)
Research Intern | Advisor: Prof. Yiyue Luo

University of California, Berkeley
Morphing Matter Lab, ME (2024.1 – 2025.5)
Visiting Scholar | Advisor: Prof. Lining Yao

Carnegie Mellon University
Morphing Matter Lab, HCII (2023.4 – 2024.5)
Research Intern | Advisor: Prof. Lining Yao

Project1: Acquiring Physical Intelligence Through Imperceptible Wearable Sensing

Project2: Designing and Evolving Embodied Systems

MobileCopilot

MobileCopilot: A Domain-Specific Language Framework for LLM-Assisted Mobile Robot Development

Jiawei Fang, Benjamin Jones, Minghao Guo, Zizhao Tong, Yunsheng Tian, Frank Zhiyang Dou, Wojciech Matusik (Under review of ICRA’ 25)

Mobile robots play an increasingly central role in robotics research and real-world deployment, spanning logistics, healthcare, service, and field exploration.

To solve problem1, CoreDSL introduces the Robot Mating Connection Protocol. instead of manual coordinate calculation, components connect through typed mating ports to alleviate complex spatial calculation.
For problem2, CoreDSL introduces Component Reframing — a taxonomy that organizes robots into four categories: wheels, chassis, sensors, and attachments. This hierarchy cuts ambiguity and speeds setup, since choosing a subtype also links to the right controller while keeping parameters flexible.
CoreDSL tackles Problem 3: Manual Configuration with Automated Configuration. It infers both the footprint and controller from RobotMCP connectors, unifying ground-contact geometry with kinematic models like wheel order, wheelbase, and radius — so robots can be modeled without manual setup.
Our CoreDSL creates the robot with only 8 lines of code, whereas the equivalent URDF description requires nearly 600 lines, which demonstrates the effectiveness of our DSL.
We introduce three more DSLs for end-to-end development: 1) WorldDSL builds environments, 2) TaskDSL encodes behaviors with behavior trees, and 3) EvaluateDSL tests physics and task performance.
Based on MobileDSL, the MobileCopilot system follows a three-stage pipeline:
(1) Semantic Interpretation extracts design intent from multimodal inputs and retrieves components;
(2) DSL Generation assembles them into MobileDSL programs using RobotMCP for spatial composition;
(3) DSL Compilation checks constraints with Lark grammars and produces an executable robot simulation world.

Posted

in

by

Comments

Leave a comment