Xingang Pan 潘新钢

Xingang Pan 潘新钢

Assistant Professor at Nanyang Technological University

About me

I am an Assistant Professor with MMLab@NTU at the School of Computer Science and Engineering, Nanyang Technological University. Prior to joining NTU, I was a postdoc researcher at Max Planck Institute for Informatics, advised by Prof. Christian Theobalt. I received my Ph.D. degree at Multimedia Laboratory in the Chinese University of Hong Kong in 2021, supervised by Prof. Xiaoou Tang. I also worked closely with Prof. Ping Luo and Prof. Chen Change Loy during my Ph.D. time. I obtained my Bachelor’s degree from Tsinghua University in 2016.

My research interests are at the interface of computer vision, machine learning, and computer graphics. Our group will explore the following research directions:

  • Generative Models
  • AI-Human Collaborative Content Generation
  • 3D/Video Editing and Generation
  • Neural Scene Representations and Rendering
  • Physics-aware Content Generation

I am looking for self-motivated Ph.D. students to join my group at MMLab@NTU in Fall 2024. I also have openings for Postdocs and RAs. Please drop me an email at xingang.pan@ntu.edu.sg with your resume if you are interested in working together with me on cutting-edge research topics listed above. For more details, please refer to:

To perspective students (click here) Thank you for your interest in joining my group! Due to the volume of emails received, I apologize in advance if I'm unable to respond to every applicant personally.

PhD applicants for 2024 spring intake: The review and interview process for the Spring 2024 intake is now complete. We appreciate your application and interest in our program!

PhD applicants for 2024 fall intake: The review and interview process is scheduled to take place around November or December 2023. Thank you for your patience.

RA and Postdocs: The review and interview process is scheduled to take place around August or September 2023. Thank you for your patience.

Publications

GlowGAN: Unsupervised Learning of HDR Images from LDR Images in the Wild
Chao Wang, Ana Serrano, Xingang Pan, Bin Chen, Hans-Peter Seidel, Christian Theobalt, Karol Myszkowski, Thomas Leimkühler
International Conference on Computer Vision (ICCV), 2023
[Paper]
AssetField: Assets Mining and Reconfiguration in Ground Feature Plane Representation
Yuanbo Xiangli*, Linning Xu*, Xingang Pan, Nanxuan Zhao, Bo Dai, Dahua Lin
International Conference on Computer Vision (ICCV), 2023
[Paper], [Project page]
Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold
Xingang Pan, Ayush Tewari, Thomas Leimkühler, Lingjie Liu, Abhimitra Meka, Christian Theobalt
SIGGRAPH, 2023
[Code], [Paper], [Project page]
Grid-guided Neural Radiance Fields for Large Urban Scenes
Linning Xu*, Yuanbo Xiangli*, Sida Peng, Xingang Pan, Nanxuan Zhao, Christian Theobalt, Bo Dai, Dahua Lin
Computer Vision and Pattern Recognition (CVPR), 2023
[Paper], [Project page]
Voxurf: Voxel-based Efficient and Accurate Neural Surface Reconstruction
Tong Wu, Jiaqi Wang, Xingang Pan, Xudong Xu, Christian Theobalt, Ziwei Liu, Dahua Lin
International Conference on Learning Representations (ICLR), 2023 (spotlight)
[Code], [Paper], [Project page]
GAN2X: Non-Lambertian Inverse Rendering of Image GANs
Xingang Pan, Ayush Tewari, Lingjie Liu, Christian Theobalt
International Conference on 3D Vision (3DV), 2022
[Paper], [Project page]
BungeeNeRF: Progressive Neural Radiance Field for Extreme Multiscale Scene Rendering
Yuanbo Xiangli*, Linning Xu*, Xingang Pan, Nanxuan Zhao, Anyi Rao, Christian Theobalt, Bo Dai, and Dahua Lin
European Conference on Computer Vision (ECCV), 2022
[Code], [Paper], [Project page]
Disentangled3D: Learning a 3D Generative Model with Disentangled Geometry and Appearance from Monocular Images
Ayush Tewari, Mallikarjun B R, Xingang Pan, Ohad Fried, Maneesh Agrawala, Christian Theobalt
Computer Vision and Pattern Recognition (CVPR), 2022
[Paper], [Project page]
A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis
Xingang Pan, Xudong Xu, Chen Change Loy, Christian Theobalt, Bo Dai
Advances in Neural Information Processing Systems (NeurIPS), 2021
[Code], [Paper], [Project page]
Generative Occupancy Fields for 3D Surface-Aware Image Synthesis
Xudong Xu, Xingang Pan, Dahua Lin, Bo Dai
Advances in Neural Information Processing Systems (NeurIPS), 2021
[Code], [Paper], [Project page]
Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation
Xingang Pan, Xiaohang Zhan, Bo Dai, Dahua Lin, Chen Change Loy, Ping Luo
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021
[Code], [Paper], [Project page]
Talk-to-Edit: Fine-Grained Facial Editing via Dialog
Yuming Jiang*, Ziqi Huang*, Xingang Pan, Chen Change Loy, Ziwei Liu
International Conference on Computer Vision (ICCV), 2021
[Code], [Paper], [Project page], [Dataset]

Do 2D GANs Know 3D Shape? Unsupervised 3D Shape Reconstruction from 2D Image GANs
Xingang Pan, Bo Dai, Ziwei Liu, Chen Change Loy, Ping Luo
International Conference on Learning Representations (ICLR), 2021 (oral)
[Code], [Paper], [Project page], [Video]
Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation
Xingang Pan, Xiaohang Zhan, Bo Dai, Dahua Lin, Chen Change Loy, Ping Luo
European Conference on Computer Vision (ECCV), 2020 (oral)
[Code], [Paper], [Project page]
Self-Supervised Scene De-occlusion
Xiaohang Zhan, Xingang Pan, Bo Dai, Ziwei Liu, Dahua Lin, Chen Change Loy
Computer Vision and Pattern Recognition (CVPR), 2020 (oral)
[Code], [Paper], [Project page]

Open Compound Domain Adaptation
Ziwei Liu*, Zhongqi Miao*, Xingang Pan, Xiaohang Zhan, Stella X. Yu, Dahua Lin, Boqing Gong
Computer Vision and Pattern Recognition (CVPR), 2020 (oral)
[Paper], [Project page]

Channel Equilibrium Networks for Learning Deep Representation
Wenqi Shao, Shitao Tang, Xingang Pan, Ping Tan, Xiaogang Wang, Ping Luo
International Conference on Machine Learning (ICML), 2020
[Paper]

Switchable Whitening for Deep Representation Learning
Xingang Pan, Xiaohang Zhan, Jianping Shi, Xiaoou Tang, Ping Luo
International Conference on Computer Vision (ICCV), 2019
[Code], [Paper]
Self-Supervised Learning via Conditional Motion Propagation
Xiaohang Zhan, Xingang Pan, Ziwei Liu, Dahua Lin, Chen Change Loy
Computer Vision and Pattern Recognition (CVPR), 2019
[Code], [Paper]

Two at Once: Enhancing Learning and Generalization Capacities via IBN-Net
Xingang Pan, Ping Luo, Jianping Shi, Xiaoou Tang
European Conference on Computer Vision (ECCV), 2018
[Code], [Paper], [Supplementary]
Spatial As Deep: Spatial CNN for Traffic Scene Understanding
Xingang Pan, Jianping Shi, Ping Luo, Xiaogang Wang, Xiaoou Tang
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI), 2018
[Dataset], [Code], [Paper], [Demo]

Education Experience

Max Planck Institute for Informatics, Germany
August 2021 - May 2023
Postdoc researcher at the Department of Visual Computing and Artificial Intelligence
Advisor: Prof. Christian Theobalt
The Chinese University of Hong Kong, HK SAR
August 2017 - July 2021
Ph.D. at Department of Information Engineering
Supervisor: Prof. Xiaoou Tang
Tsinghua University, Beijing, China
August 2012 - July 2016
B.E. at Department of Automotive Engineering
GPA ranking: 1/86

Honors & Awards