Zihan Zhou's Homepage

Zihan Zhou

Chief Scientist
Manycore Tech Inc.

515 Yuhangtang Rd., Building 1, Floor 11
Hangzhou, Zhejiang, P. R. China
Email: x@qunhemail.com where x = shuer
CV | Google Scholar | DBLP | Github

About Me

I am currently the chief scientist at Manycore Tech Inc.. From 2013 to 2021, I was a research associate and then an assistant professor in the College of Information Sciences and Technology at Penn State University. I completed my Ph.D in Electrical and Computer Engineering at the University of Illinois at Urbana-Champaign in 2013. I was supervised by Prof. Yi Ma. I received my Bachelor Degree in Automation from Tsinghua University, China, and Master Degree in ECE from UIUC, respectively.

My research interest lies in the broad area of computer vision, machine learning, signal processing, and applied data sciences. I am particularly focusing on 3D Vision. Specifically, I develop novel computational tools to model and analyze the 3D environments from big visual data, and apply them to solve challenging real-world problems in computer-aided design, VR/AR, social media, and more.

What's New?

[2025.03] Check out SpatialLM, an open-source multimodal large language model which generates structured 3D scene descriptions from point cloud data.

Publications

	SpatialLM: Training Large Language Models for Structured Indoor Modeling Yongsen Mao, Junhao Zhong, Chuan Fang, Jia Zheng, Rui Tang, Hao Zhu, Ping Tan, and Zihan Zhou NeurIPS, 2025. [paper][project][code][model/data]
	From 2D CAD Drawings to 3D Parametric Models: A Vision-Language Approach Xilin Wang, Jia Zheng, Yuanchao Hu, Hao Zhu, Qian Yu, and Zihan Zhou AAAI, 2025. [paper][project]
	NeRF-Enhanced Outpainting for Faithful Field-of-View Extrapolation Rui Yu, Jiachen Liu, Zihan Zhou, and Sharon X. Huang ICRA, 2024. [paper]
	PlankAssembly: Robust 3D Reconstruction from Three Orthographic Views with Learnt Shape Programs Wentao Hu, Jia Zheng, Zixin Zhang, Xiaojun Yuan, Jian Yin, and Zihan Zhou ICCV, 2023. [paper][project][code]
	Two-stage Content-Aware Layout Generation for Poster Designs Shang Chai, Liansheng Zhuang, Fengying Yan, and Zihan Zhou ACM MM, 2023. [paper]
	Deep Learning Assisted Optimization for 3D Reconstruction from Single 2D Line Drawings Jia Zheng, Yifan Zhu, Kehan Wang, Qiang Zou, and Zihan Zhou arXiv:2209.02692, 2022. [paper][project]
	End-to-end Graph-constrained Vectorized Floorplan Generation with Panoptic Refinement Jiachen Liu, Yuan Xue, Jose Duarte, Krishnendra Shekhawat, Zihan Zhou, and Xiaolei Huang ECCV, 2022. [paper]
	Neural Face Identification in a 2D Wireframe Projection of a Manifold Object Kehan Wang, Jia Zheng, and Zihan Zhou CVPR, 2022. [paper][project][code]
	Deep Depth from Focus with Differential Focus Volume Fengting Yang, Xiaolei Huang, and Zihan Zhou CVPR, 2022. [paper][code]
	Iterative Design and Prototyping of Computer Vision Mediated Remote Sighted Assistance Jingyi Xie, Madison Reddie, Sooyeon Lee, Syed M. Billah, Zihan Zhou, Chun-Hua Tsai, and John M. Carroll ACM ToCHI, 2022. [paper]
	Towards Robust Human Trajectory Prediction in Raw Videos Rui Yu, and Zihan Zhou IROS, 2021. [paper][code]
	Neural Wireframe Renderer: Learning Wireframe to Image Translations Yuan Xue, Zihan Zhou, and Xiaolei Huang ECCV, 2020. [paper][code]
	Structured3D: A Large Photo-realistic Dataset for Structured 3D Modeling Jia Zheng, Junfei Zhang, Jing Li, Rui Tang, Shenghua Gao, and Zihan Zhou ECCV, 2020. [paper][project][code]
	Data-driven Distributed State Estimation and Behavior Modeling in Sensor Networks Rui Yu, Zhenyuan Yuan, Minghui Zhu, and Zihan Zhou IROS, 2020. [paper]
	Superpixel Segmentation with Fully Convolutional Networks Fengting Yang, Qian Sun, Hailin Jin, and Zihan Zhou CVPR, 2020. [paper] [code]
	Single-Image Piece-Wise Planar 3D Reconstruction via Associative Embedding Zehao Yu, Jia Zheng, Dongze Lian, Zihan Zhou, and Shenghua Gao CVPR, 2019. [paper] [code/data]
	Recovering 3D Planes from a Single Image via Convolutional Neural Networks Fengting Yang and Zihan Zhou ECCV, 2018. [paper] [supp. material] [code/data]
	Learning to Parse Wireframes in Images of Man-Made Environments Kun Huang, Yifan Wang, Zihan Zhou, Tianjiao Ding, Shenghua Gao, and Yi Ma CVPR, 2018. [paper] [supp. material] [code/data]
	Discovering Triangles in Protraits for Supporting Photographic Creation Siqiong He, Zihan Zhou, Farshid Farhat, and James Z. Wang TMM, 2018. [paper]
	Beyond Saliency: Assessing Visual Balance with High-Level Cues Baris Kandemir, Zihan Zhou, Jia Li, and James Z. Wang ACM MM engagement workshop, 2017. [paper]
	Detecting Dominant Vanishing Points In Natural Scenes with Application to Composition-Sensitive Image Retrieval Zihan Zhou, Farshid Farhat, and James Z. Wang TMM, 2017. [paper][project][code]
	Improving Offline Handwritten Chinese Character Recognition by Iterative Refinement Xiao Yang, Dafang He, Zihan Zhou, Daniel Kifer, and C. Lee Giles ICDAR, 2017. [paper]
	Learning to Read Irregular Text with Attention Mechanisms Xiao Yang, Dafang He, Zihan Zhou, Daniel Kifer, and C. Lee Giles IJCAI, 2017. [paper]
	Label Information Guided Graph Construction for Semi-Supervised Learning Liansheng Zhuang, Zihan Zhou, Shenghua Gao, Jingwen Yin, Zhouchen Lin, and Yi Ma TIP, 2017. [paper]
	Smart Library: Identifying Books in a Library using Richly Supervised Deep Scene Text Reading Xiao Yang, Dafang He, Wenyi Huang, Alexander Ororbia, Zihan Zhou, Daniel Kifer, and C. Lee Giles JCDL short paper, 2017. [paper]
	Multi-scale FCN with Instance Aware Segmentation for Arbitrary Oriented Word Spotting In The Wild Dafang He, Xiao Yang, Chen Liang, Zihan Zhou, Alexander Ororbia, Daniel Kifer, and C. Lee Giles CVPR, 2017. [paper]
	Robust Plane-based Calibration of Multiple Non-Overlapping Cameras Chen Zhu, Zihan Zhou, Ziran Xing, Yanbing Dong, Yi Ma, and Jingyi Yu 3DV, 2016. [paper]
	Aggregating Local Context for Accurate Scene Text Detection Dafang He, Xiao Yang, Wenyi Huang, Zihan Zhou, Daniel Kifer, and C. Lee Giles ACCV, 2016. [paper]
	Detecting Arbitrary Orientated Text in the Wild with a Visual Attention Model Wenyi Huang, Dafang He, Xiao Yang, Zihan Zhou, Daniel Kifer, and C. Lee Giles ACM MM short paper, 2016. [paper]
	Modeling Perspective Effects in Photographic Composition Zihan Zhou, Siqiong He, Jia Li, and James Z. Wang ACM MM, 2015. [paper]
	Fast L1-Minimization Algorithms For Robust Face Recognition Allen Yang, Zihan Zhou, Arvind Ganesh, Shankar Sastry, and Yi Ma TIP, 2013. [paper] [code]
	Plane-Based Content-Preserving Warps for Video Stabilization Zihan Zhou, Hailin Jin, and Yi Ma CVPR, 2013. [paper] [project]
	Single-Sample Face Recognition with Image Corruption and Misalignment via Sparse Illumination Transfer Liansheng Zhuang, Allen Yang, Zihan Zhou, Shankar Sastry, and Yi Ma CVPR, 2013. [paper]
	Robust Plane-Based Structure From Motion Zihan Zhou, Hailin Jin, and Yi Ma CVPR, 2012. [paper]
	Towards a Practical Face Recognition System: Robust Alignment and Illumination by Sparse Representation Andrew Wagner, John Wright, Arvind Ganesh, Zihan Zhou, Hossein Mobahi, and Yi Ma TPAMI, 2012. [paper][project]
	Holistic Reconstruction of Urban Structures from Low-rank Textures Hossein Mobahi, Zihan Zhou, Allen Yang, and Yi Ma ICCV workshop on 3D representation and recognition, 2011. [paper]
	Towards a Robust Face Recognition System using Compressive Sensing Allen Yang, Zihan Zhou, Yi Ma, and Shankar Sastry InterSpeech, 2010. [paper]
	Stable Principal Component Pursuit Zihan Zhou, Xiaodong Li, John Wright, Emmanuel Candes, and Yi Ma ISIT, 2010. [paper][project]
	Face Recognition with Contiguous Occlusion using Markov Random Fields Zihan Zhou, Andrew Wagner, Hossein Mobahi, John Wright, and Yi Ma ICCV, 2009. [paper]
	Towards a Practical Face Recognition System: Robust Registration and Illumination via Sparse Representation Andrew Wanger, John Wright, Arvind Ganesh, Zihan Zhou, and Yi Ma CVPR, 2009. [paper]
	Separation of A Subspace-Sparse Signal: Algorithms and Conditions Arvind Ganesh, Zihan Zhou, and Yi Ma ICASSP, 2009. [paper]
	Nearest-Subspace Patch Matching for Face Recognition Under Varying Pose and Illumination Zihan Zhou, Arvind Ganesh, John Wright, Shen-Fu Tsai, and Yi Ma FG, 2008. [paper]

Dissertation, Thesis, and Book Chapter

Exploring Structural Regularities for Robust 3D Reconstruction of Urban Scenes [pdf]
Ph.D. dissertation, University of Illinois at Urbana-Champaign, 2013.
Advisor: Prof. Yi Ma.

Face Recognition under Varying Illumination, Pose and Contiguous Occlusion [pdf]
M.S. thesis, University of Illinois at Urbana-Champaign, 2010.
Advisor: Prof. Yi Ma.

Face Recognition by Sparse Representation [book chapter]
John Wright, Allen Yang, Arvind Ganesh, Andrew Wagner, Zihan Zhou, and Yi Ma.
In Compressed Sensing: Theory and Applications, 2012.

Professional Activities

Conference reviewer: CVPR, ICCV, ECCV, etc.

Journal reviewer: TPAMI, IJCV, TIP, TSP, TMI, TMM, etc.