Fu-En Yang

Research ScientistNVIDIA Research

I am a Research Scientist at NVIDIA Research, developing generalizable and agentic systems for robot learning and control. My work connects world–action modeling, embodied reasoning, and action to help robots understand physical dynamics, anticipate the consequences of their decisions, and adapt their behavior across tasks and environments.

I received my Ph.D. from National Taiwan University in July 2023, advised by Prof. Yu-Chiang Frank Wang. Previously, I was a research intern at NVIDIA Research (Feb.–Aug. 2023) and a Ph.D. program researcher at ASUS AICS (Sep. 2020–Oct. 2022), working on model personalization, vision-language models, and visual transfer learning.

I received my bachelor’s degree in Electrical Engineering from National Taiwan University in 2018.

Portrait of Fu-En Yang

Research Interests

My research focuses on generalizable and agentic robot intelligence. I study world modeling and world–action modeling to understand physical dynamics, predict action outcomes, and reason through imagined futures. By connecting these predictive models with agentic robotics, I aim to build robots that plan over long horizons, learn from interaction, and adapt to unfamiliar tasks and environments.

News

  • Our papers "TTVidT" and "VESPER" are accepted at NeurIPS 2026. "ThinkWorld" is accepted by NeurIPS 2026 RoboWM and PTA workshops, and "PhysCaP" is accepted by WRL workshop.
  • I gave an invited talk, “Thinking through Word to World: Embodied Reasoning from Imagination,” at the ECCV 2026 X-REASON Workshop.
  • Our papers "Scal3R" and "ReactVAU" are accepted at ECCV 2026.
  • Our paper "PhaseLock" is accepted at ICML 2026.
  • Our papers "Fast-ThinkAct" and "Free Sinewich" are accepted at CVPR 2026.
Earlier news

Selected Publications

Google Scholar
ThinkWorld real-robot demonstration: opening an oven, retrieving a crown, and placing it on a bear.
Official demo · 7× speedView figure ↗
Preprint 2026Robot Intelligence

ThinkWorld: World Imagination Reinforces Chain-of-Dynamics Reasoning

Chaehyun Kim, Chi-Pin Huang, Jisoo Kim, Min-Hung Chen, Yu-Chiang Frank Wang, Seungryong Kim, Fu-En Yang

Workshops: RoboWM @ NeurIPS 2026 · PTA @ NeurIPS 2026

World–action modeling that learns shared motion representations from human and robot videos, imagines their future consequences, and reinforces chain-of-dynamics reasoning by comparing imagined futures with observed outcomes.

DreamX demonstrates cross-embodiment motion transfer and robot execution of actions inferred from human videos.
Official teaser · demos sped upView figure ↗
Preprint 2026Robot Intelligence

DreamX: Video Diffusion Model is a Universal Latent Action Learner

Jisoo Kim*, Chaehyun Kim*, Junsu Kim, Jiho Park, Seongchan Kim, Eunbeen Hong, Soowon Son, Fu-En Yang, Seungryong Kim

A universal latent action space extracted from a pretrained video diffusion model, capturing motion shared across humans and robots for cross-embodiment video transfer, human-to-robot action transfer, and compact robot policy learning.

PhysCaP robot demonstrations that explore object mass and stiffness through physical interaction.
Official demo · sped upView figure ↗
Preprint 2026Robot Intelligence

PhysCaP: Grounding Code-as-Policy Agent with Physics-Informed Exploration

Chen-Yu Lin*, Jing-Wen Chen*, Hsueh-En Chang, Hung-An Chen, Sheng-Hsun Chang, Chi-Pin Huang, Fu-En Yang, Min-Hung Chen, Yi-Ting Chen, Yu-Chiang Frank Wang, Shao-Hua Sun

Workshops: Robot Learning @ NeurIPS 2026 · Agentic Robotics @ CoRL 2026

A physics-informed code-as-policy agent that actively measures hidden object properties through robot interaction, combining mass and stiffness estimation with multi-agent planning for targeted exploration and reliable manipulation.

Service & Background

Academic Services

  • Area Chair: NeurIPS 2025 Workshop GenProCC
  • Conference program committees & reviewing

    ICLR 2027, ICRA 2027, CoRL 2026, NeurIPS 2026, ECCV 2026, CVPR 2026, ICLR 2026, AAAI 2026, WACV 2026, BMVC 2026, NeurIPS 2025, ICCV 2025, ICML 2025, CVPR 2025, ICLR 2025, ICLR 2025 WS SCOPE, AAAI 2025, ACM MM 2025, NeurIPS 2024, ECCV 2024, ICML 2024, CVPR 2024, AAAI 2024, ACCV 2024, ICIP 2024, NeurIPS 2023, ICCV 2023, CVPR 2023, AAAI 2023, WACV 2023, ICIP 2023, ACCV 2022, CVPR 2022, AAAI 2022, WACV 2022, AAAI 2021, ICIP 2020, AAAI 2020

  • Journal Reviewer: Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Computer Vision and Image Understanding (CVIU), ACM Computing Surveys (CSUR)

Awards

  • Honorable Mention at 2023 TAAI Ph.D. Thesis Award, Nov. 2023
  • NTU Presidential Award for Graduate Students, Sep. 2023
  • Merit Award at the 16th IPPR Doctoral Thesis Award, Aug. 2023

Teaching Assistant

  • Deep Learning for Computer Vision, Spring 2019
  • Computer Vision: from recognition to geometry, Fall 2018
Visitor locations and counts for Fu-En Yang’s website — open MapMyVisitors for detailed statistics. Visitor statistics & locations ↗