Xingang Pan


Assistant Professor
College of Computing and Data Science
Nanyang Technological University
Email: xingang.pan[at]ntu.edu.sg
   /      /      /  

Research Interests:

Computer Vision
Generative Models
3D Vision
Computer Graphics

I am a Nanyang Assistant Professor with MMLab@NTU at the College of Computing and Data Science, Nanyang Technological University. Prior to joining NTU, I was a postdoc researcher at Max Planck Institute for Informatics, advised by Prof. Christian Theobalt. I received my Ph.D. degree at Multimedia Laboratory in the Chinese University of Hong Kong in 2021, supervised by Prof. Xiaoou Tang. I also worked closely with Prof. Ping Luo and Prof. Chen Change Loy during my Ph.D. time. I obtained my Bachelor's degree from Tsinghua University in 2016.

My research interests are in computer vision, machine learning, and computer graphics, with a focus on generative models for visual content creation. My scientific goal is to 1) build more capable Generative AI with industry-level visual quality and applicability; and 2) develop AI-human interactive and collaborative approaches to make visual content creation more accessible to everyone. I enjoy doing the following types of research: a) exploring new, less-studied problems, b) marriage between classic and advanced methods, and c) uncovering in-depth insights in established problems and methods.

To prospective students: If you are interested in joining our group at MMLab@NTU, please drop me an email at xingang.pan\[at\]ntu.edu.sg with your resume or directly apply through the system. There has been concerns about nationality constraints. Currently we still have openings without any nationality constraint. Students from any countries are welcome to apply. Due to the volume of emails received, I apologize in advance if I'm unable to respond to every applicant personally.

Selected Publications

Google Scholar and Full List.

I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models
Ouyang Wenqi, Yi Dong, Lei Yang, Jianlou Si, Xingang Pan.
SIGGRAPH Asia, 2024.
[Project] [Paper]
LN3Diff: Scalable Latent Neural Fields Diffusion for Speedy 3D Generation
Yushi Lan, Fangzhou Hong, Shuai Yang, Shangchen Zhou, Xuyi Meng, Bo Dai, Xingang Pan, Chen Change Loy.
European Conference on Computer Vision (ECCV), 2024.
[Project] [Paper] [Code]
ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidance
Yongwei Chen*, Tengfei Wang*, Tong Wu, Xingang Pan, Kui Jia, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2024.
[Paper] [Project]
Learning Images Across Scales Using Adversarial Training
Krzysztof Wolski, Adarsh Djeacoumar, Alireza Javanmardi, Hans-Peter Seidel, Christian Theobalt, Guillaume Cordonnier, Karol Myszkowski, George Drettakis, Xingang Pan, Thomas Leimkühler.
ACM Transactions on Graphics (Proc. of SIGGRAPH 2024).
[Paper] [Project]
DiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphing
Kaiwen Zhang, Yifan Zhou, Xudong Xu, Xingang Pan (corresponding author), Bo Dai.
Computer Vision and Pattern Recognition (CVPR), 2024.
[Paper] [Project]
A Neural Implicit Representation for the Image Stack: Depth, All in Focus, and High Dynamic Range
Chao Wang, Ana Serrano, Xingang Pan, Bin Chen, Hans-Peter Seidel, Christian Theobalt, Karol Myszkowski, Krzysztof Wolski, Thomas Leimkühler.
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2023).
[Paper] [Project]
GlowGAN: Unsupervised Learning of HDR Images from LDR Images in the Wild
Chao Wang, Ana Serrano, Xingang Pan, Bin Chen, Hans-Peter Seidel, Christian Theobalt, Karol Myszkowski, Thomas Leimkühler.
International Conference on Computer Vision (ICCV), 2023.
[Paper] [Project]
AssetField: Assets Mining and Reconfiguration in Ground Feature Plane Representation
Yuanbo Xiangli*, Linning Xu*, Xingang Pan, Nanxuan Zhao, Bo Dai, Dahua Lin.
International Conference on Computer Vision (ICCV), 2023.
[Paper] [Project]
Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold
Xingang Pan, Ayush Tewari, Thomas Leimkühler, Lingjie Liu, Abhimitra Meka, Christian Theobalt.
SIGGRAPH, 2023.
[Code] [Paper] [Project] [Media coverage: The Independent, Business Insider, The Verge]
Grid-guided Neural Radiance Fields for Large Urban Scenes
Linning Xu*, Yuanbo Xiangli*, Sida Peng, Xingang Pan, Nanxuan Zhao, Christian Theobalt, Bo Dai, Dahua Lin.
Computer Vision and Pattern Recognition (CVPR), 2023.
[Paper] [Project]
Voxurf: Voxel-based Efficient and Accurate Neural Surface Reconstruction
Tong Wu, Jiaqi Wang, Xingang Pan, Xudong Xu, Christian Theobalt, Ziwei Liu, Dahua Lin.
International Conference on Learning Representations (ICLR), 2023 (spotlight).
[Code] [Paper] [Project]
GAN2X: Non-Lambertian Inverse Rendering of Image GANs
Xingang Pan, Ayush Tewari, Lingjie Liu, Christian Theobalt.
International Conference on 3D Vision (3DV), 2022.
[Paper] [Project]
BungeeNeRF: Progressive Neural Radiance Field for Extreme Multiscale Scene Rendering
Yuanbo Xiangli*, Linning Xu*, Xingang Pan, Nanxuan Zhao, Anyi Rao, Christian Theobalt, Bo Dai, and Dahua Lin.
European Conference on Computer Vision (ECCV), 2022.
[Code] [Paper] [Project]
Disentangled3D: Learning a 3D Generative Model with Disentangled Geometry and Appearance from Monocular Images
Ayush Tewari, Mallikarjun B R, Xingang Pan, Ohad Fried, Maneesh Agrawala, Christian Theobalt.
Computer Vision and Pattern Recognition (CVPR), 2022.
[Paper] [Project]
A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis
Xingang Pan, Xudong Xu, Chen Change Loy, Christian Theobalt, Bo Dai.
Advances in Neural Information Processing Systems (NeurIPS), 2021.
[Code] [Paper] [Project]
Generative Occupancy Fields for 3D Surface-Aware Image Synthesis
Xudong Xu, Xingang Pan, Dahua Lin, Bo Dai.
Advances in Neural Information Processing Systems (NeurIPS), 2021.
[Code] [Paper] [Project]
Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation
Xingang Pan, Xiaohang Zhan, Bo Dai, Dahua Lin, Chen Change Loy, Ping Luo.
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021.
[Code] [Paper] [Project]
Do 2D GANs Know 3D Shape? Unsupervised 3D Shape Reconstruction from 2D Image GANs
Xingang Pan, Bo Dai, Ziwei Liu, Chen Change Loy, Ping Luo.
International Conference on Learning Representations (ICLR), 2021 (oral).
[Code] [Paper] [Project] [Video]
Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation
Xingang Pan, Xiaohang Zhan, Bo Dai, Dahua Lin, Chen Change Loy, Ping Luo.
European Conference on Computer Vision (ECCV), 2020 (oral).
[Code] [Paper] [Project]
Self-Supervised Scene De-occlusion
Xiaohang Zhan, Xingang Pan, Bo Dai, Ziwei Liu, Dahua Lin, Chen Change Loy.
Computer Vision and Pattern Recognition (CVPR), 2020 (oral).
[Code] [Paper] [Project]
Two at Once: Enhancing Learning and Generalization Capacities via IBN-Net
Xingang Pan, Ping Luo, Jianping Shi, Xiaoou Tang.
European Conference on Computer Vision (ECCV), 2018.
[Code] [Paper] [Supplementary]
Spatial As Deep: Spatial CNN for Traffic Scene Understanding
Xingang Pan, Jian Ping Shi, Ping Luo, Xiaogang Wang, Xiaoou Tang.
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI), 2018.
[Dataset] [Code] [Paper] [Demo]