Mutian Xu (许牧天)

I am a Ph.D. candidate at GAP Lab, advised by Prof. Xiaoguang Han, at the Chinese University of Hong Kong (Shenzhen) . Prior to this, I completed my M.Sc. at the University of California, Irvine and my B.Eng. at Xidian University. I am fortunate to have had the opportunity to work at CVMI Lab under the guidance of Prof. Xiaojuan Qi and at SIAT-MMLab under the supervision of Prof. Yu Qiao .

My research is centered around developing intelligent algorithms and creating diverse data to comprehend, model, and represent the 3D world. Currently, I am keenly interested in embodied AI and data generation.

I am seeking a Postdoctoral or Faculty position for the Summer/Fall of 2025. If you have any openings or are interested, please feel free to contact me.

News

• [11/2024] One paper (SAMPro3D) is accepted to 3DV2025. The updated paper and code will be available soon.
• [08/2024] One paper (survey) is accepted to TPAMI. The updated paper will be available soon.
• [07/2024] One paper (Free-ATM) is accepted to ECCV2024. The updated paper and code will be available soon.
• [07/2024] MVImgNet is awarded WAIC Youth Outstanding Paper Nomination, 2024 (2024世界人工智能大会青年优秀论文提名奖).
• [03/2024] One paper (RichDreamer) is accepted to CVPR2024 as Highlight (2.8%). Paper and code are available.
• [11/2023] I was recognized as one of the NeurIPS2023 Top Reviewers (9.9%).
• [08/2023] MVImgNet is awared CCF Outstanding Graphics Open-Source Dataset, 2023 (CCF-2023年度优秀图形开源数据集奖).
• [05/2023] I was named one of the CVPR2023 Outstanding Reviewers (3.3%).
• [03/2023] Three papers (MVImgNet, MM-3DScene, REC-MV) are accepted to CVPR2023. Papers, dataset, and codes are all available.
• [07/2022] One paper (TO-Scene) is accepted to ECCV2022 for Oral Presentation (2.7%). Paper and dataset are available.
• [03/2021] One paper (PAConv) is accepted to CVPR2021. Paper and code are available.
• [12/2020] One paper (GDANet) is accepted to AAAI2021. Paper and code are available.

Publications

(^* indicates equal contribution, ^† denotes project lead, ^‡ means corresponding author)

Selected Representatives

MVImgNet: A Large-scale Dataset of Multi-view Images

Xianggang Yu^*, Mutian Xu^{†, *}, Yidan Zhang^*, Haolin Liu^*, Chongjie Ye^*, et al., Guanying Chen, Shuguang Cui, Xiaoguang Han^‡. (^†part of project lead)
(CVPR, 2023) [project][paper][code]

PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Clouds

Mutian Xu^*, Runyu Ding^*, Hengshuang Zhao, Xiaojuan Qi^‡.
(CVPR, 2021) [paper][code]

TO-Scene: A Large-scale Dataset for Understanding 3D Tabletop Scenes

Mutian Xu^*, Pei Chen^*, Haolin Liu, Xiaoguang Han^‡.
(ECCV, 2022, Oral, 2.7%) [paper][code]

SAMPro3D: Locating SAM Prompts in 3D for Zero-Shot Instance Segmentation

Mutian Xu, Xingyilang Yin, Lingteng Qiu, Yang Liu, Xin Tong, Xiaoguang Han^‡.
(3DV, 2025) [project][paper][code]

Free-ATM: Harnessing Free Attention Masks for Representation Learning on Diffusion-Generated Images

David Junhao Zhang, Mutian Xu^†, Jay Zhangjie Wu, Chuhui Xue, Wenqing Zhang, Xiaoguang Han, Song Bai, Mike Zheng Shou^‡. (^†project lead)
(ECCV, 2024) [paper]

Others

Learning Geometry-Disentangled Representation for Complementary Understanding of 3D Object Point Cloud

Mutian Xu^*, David Junhao Zhang^*, Zhipeng Zhou, Mingye Xu, Xiaojuan Qi, Yu Qiao^‡.
(AAAI, 2021, BEST performance on OmniObject 3D robust perception) [paper][code]

MM-3DScene: 3D Scene Understanding by Customizing Masked Modeling with Informative-Preserved Reconstruction and Self-Distilled Consistency

Mingye Xu^*, Mutian Xu^*, Tong He, Wanli Ouyang, Yali Wang^‡, Xiaoguang Han, Yu Qiao^‡.
(CVPR, 2023) [project][paper][code]

RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3D

Lingteng Qiu^*, Guanying Chen^*, Xiaodong Gu^*, Qi Zuo, Mutian Xu, Yushuang Wu, Weihao Yuan, Zilong Dong, Liefeng Bo, Xiaoguang Han^‡.
(CVPR, 2024, Highlight, 2.8%) [project][paper][code]

REC-MV: REconstructing 3D Dynamic Cloth from Monucular Videos

Lingteng Qiu^*, Guanying Chen^*, Jiapeng Zhou, Mutian Xu, Junle Wang, Xiaoguang Han^‡.
(CVPR, 2023) [project][paper][code]

A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspective

Chaoqi Chen^*, Yushuang Wu^*, Qiyuan Dai^*, Hong-Yu Zhou^*, Mutian Xu, Sibei Yang^‡, Xiaoguang Han^‡, Yizhou Yu^‡.
(TPAMI, 2024) [paper]

Activites & Certificates

Experience

• CVMI Lab, University of Hong Kong, HK SAR, China
  06. 2020 – 02. 2021
  
  Research Assistant
  Topic: 3D Point Cloud Convolution
  Advisor: Prof. Xiaojuan Qi
  
• MMLab, Shenzhen Institutes of Advanced Technology, China
  07. 2019 – 11. 2019
  
  Visiting Student
  Topic: 3D Object Point Cloud Classification and Segmentation
  Advisor: Prof. Yu Qiao & Dr. Zhipeng Zhou
  
• University of California, Irvine, USA
  04. 2019 – 06. 2019
  
  Master Individual Project
  Topic: 3D Object Reconstrution Based on Structured Light
  Advisor: Prof. Charless Fowlkes
  

Talks

Teaching

Miscellaneous