Xin Chen - 陈欣
CV | Resume - 简历
Email | LinkedIn | GitHub
Conference Timer
Google Scholar


  • Talks:  20230701 - XDC 2023
  • Journal Reviewer:  SIGGRAPH, CVPR, ICCV, AAAI
  • Conference Reviewer:  TPAMI, TIP, IJCV, TMM, JVCI
  • Selected Publications (Complete list…)

    Paint3D: Paint Anything 3D with Lighting-less Texture Diffusion Models

    Xianfang Zeng*, Xin Chen*, Zhongqi Qi*, Wen Liu, Zibo Zhao, Zhibin Wang, Bin Fu, Yong Liu, Gang Yu

    CVPR 2024

    [Project] [Paper] [Code] GitHub stars

    AppAgent: Multimodal Agents as Smartphone Users

    Chi Zhang*, Zhao Yang*, Jiaxuan Liu*, Yuchen Han, Xin Chen, Zebiao Huang, Bin Fu, Gang Yu

    Arxiv 2023

    [Project] [Paper] [Code] GitHub stars

    MotionGPT: Human Motion as a Foreign Language

    Biao Jiang*, Xin Chen*, Wen Liu, Jingyi Yu, Gang Yu, Tao Chen

    NeurIPS 2023

    [Project] [Paper] [Code] GitHub stars

    Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representation

    Zibo Zhao*, Wen Liu*, Xin Chen, Xianfang Zeng, Rui Wang, Pei Cheng, Bin Fu, Tao Chen,Gang Yu, Shenghua Gao

    NeurIPS 2023

    [Project] [Paper] [Code]GitHub stars

    A Large-Scale Outdoor Multi-modal Dataset and Benchmark for Novel View Synthesis and Implicit Scene Reconstruction

    Chongshan Lu, Fukun Yin, Xin Chen, Tao Chen, Gang Yu, Jiayuan Fan

    ICCV 2023

    [Project] [Paper] [Code]GitHub stars

    Popup Image

    Executing your Commands via Motion Diffusion in Latent Space

    Xin Chen*, Biao Jiang*, Wen Liu, Zilong Huang, Bin Fu, Tao Chen, Jingyi Yu, Gang Yu

    CVPR 2023

    [Project] [Paper] [Code]GitHub stars

    Popup Image

    End-to-End 3D Dense Captioning with Vote2Cap-DETR

    Sijin Chen, Hongyuan Zhu, Xin Chen, Yinjie Lei, Tao Chen, Gang Yu

    CVPR 2023

    [Paper] [Code]

    TightCap: 3D Human Shape Capture with Clothing Tightness Field

    Xin Chen, Anqi Pang, Wei Yang, Peihao Wang, Lan Xu, Jingyi Yu

    SIGGRAPH 2022 TOG Journal Track

    [Project] [Code] [Arxiv] [Paper] [Video] [BibTex]GitHub stars

    SportsCap: Monocular 3D Human Motion Capture and Fine-grained Understanding in Challenging Sports Videos

    Xin Chen, Anqi Pang, Wei Yang, Yuexin Ma, Lan Xu, Jingyi Yu

    IJCV 2021

    [Project] [Code] [Arxiv] [Paper] [Video] [BibTex]GitHub stars

    ChallenCap: Monocular 3D Capture of Challenging Human Performances using Multi-Modal References

    Yannan He, Anqi Pang, Xin Chen, Han Liang, Yuexin Ma, Lan Xu

    CVPR 2021 Oral

    [Project] [Arxiv] [Paper] [Video] [BibTex]

    Popup Image

    Anisotropic Fourier Features for Neural Image-Based Rendering and Relighting

    Huangjie Yu, Anpei Chen, Xin Chen, Lan Xu, Ziyu Shao, Jingyi Yu

    AAAI 2022 Oral

    [Paper] [BibTex]

    Few-shot Neural Human Performance Rendering from Sparse RGBD Videos

    Anqi Pang*, Xin Chen*, Haimin Luo, Mingye Wu, Jingyi Yu, Lan Xu

    IJCAI 2021

    [Project] [Arxiv] [Paper] [Video] [BibTex]

    Neural Free-Viewpoint Performance Rendering under ComplexHuman-object Interactions

    Guoxing Sun, Xin Chen, Yizhang Chen, Anqi Pang, Pei Lin, Yuheng Jiang, Lan Xu, Jingya Wang, Jingyi Yu

    ACMMM 2021

    [Project] [Arxiv] [Paper] [Video] [BibTex]

    Sparse Photometric 3D Face Reconstruction Guided by Morphable Models

    Xuan Cao, Zhang Chen, Anpei Chen, Xin Chen, Shiying Li, Jingyi Yu

    CVPR 2018

    [Paper] [Video] [Supp] [BibTex]

    AutoSweep: Recovering 3D Editable Objects from a Single Photograph

    Xin Chen, Yuwei Li, Xi Luo, Tianjia Shao, Jingyi Yu, Kun Zhou, Youyi Zheng

    TVCG 2018

    [Project] [Code] [Arxiv] [Paper] [Video] [BibTex]

    See all publications ...

    Projects (More projects…)

    MotionGPT:Motion-Language Generations

    A unified and user-friendly motion-language model to learn the semantic coupling of two modalities and generate high-quality motions and text descriptions on multiple motion tasks.

    Portfolio Image

    Motion Latent Diffusion Models

    Human-Object Motion Capture

    Using 13 infrared cameras for complex motion capture. We collected a complex motion dataset to assist challenging monocular motion capture for sports video.

    Portfolio Image

    Light Stage

    Multi-view light stage system for MoCap and 3D Reconstruction.

    Dynamic 3D Mesh Player

    Stand-alone development work for free-view browsing on 4D scans, which supports 3D mesh rendering, free-angle viewpoint change, Poisson Surface Reconstruction.

    I am as a performer for boxing.

    Portfolio Image
    Multi-view Dome System

    Using more than 72 cameras for dynamic human reconstruction.

    Poping result with free view-points.

    Avatar with high fidelity clothes and face.

    Portfolio Image
    Dome System for static objects

    Using more than 80 cameras for multi-view stereo reconstruction. Lead the reconstruction project and aim to build a large 3D mesh sequences dataset.



    PCG QQ - Research Scientist

    Feb. 2022 - Present

    CSIG YouTu Lab -Research Scientist Intern

    Nov. 2020 - Mar. 2021

    I am working at Tencent, Shanghai and received two Outstanding performances and Tencent STAR Award in 2023.

    I was a research scientist intern at Tencent YouTu Lab in 2020 focuing on the 3D human body reconstruction.

    Research Engineer Intern

    I work as a research engineer intern at DGene Digital Technology Inc., my supervisor's start-up, for world digitalization.

    I won the Best Outstanding Intern Award in 2018 for leading the mobile virtual fitting project.

    Ph.D. Degree

    I received my Ph.D. degree from UCAS under the supervision of Prof. Jingyi Yu, working on human performance capture including human reconstruction, clothing capture, and shape estimation.

    Master Student

    I spent 2 years on computer graphics research, advised by Prof. Youyi Zheng and developed a fully automatic framework for recovering 3D editable objects from a single photograph, published on TVCG 2018 (Top journal in graphics).

    Qingdao University of Technology

    Sep. 2012 - Jul. 2016


    I received a B.S. degree in electronic information science and technology and won honorable awards including:

  • National Encouragement Scholarship, 2016
  • Provincial Government Scholarship, 2015
  • Second Prize in China Mathematical Contest in Modeling, 2015
  • Province-level Merit Student, 2013
  • Supervisors

    Prof. Jingyi Yu - Supervisor

  • IEEE Fellow
  • Program chair of ICPR 2020 and CVPR 2021
  • Executive Dean, SIST, ShanghaiTech University
  • Founder, DGene Inc.
  • Ph.D.'s degree, MIT, 2005
  • Prof. Youyi Zheng - Former Supervisor

  • Hundred Talents Program, ZheJiang Univeristy
  • Professor, State Key Lab of CAD&CG, ZheJiang Univeristy
  • Ph.D.'s degree, Hong Kong University of Science and Technology, 2011