Zihan Zhou's Homepage

Zihan Zhou

Chief Scientist
Manycore Tech Inc.

515 Yuhangtang Rd., Building 1, Floor 11
Hangzhou, Zhejiang, P. R. China
Email: x@qunhemail.com where x = shuer
CV | Google Scholar | DBLP | Github

About Me

I am currently the chief scientist at Manycore Tech Inc.. From 2013 to 2021, I was a research associate and then an assistant professor in the College of Information Sciences and Technology at Penn State University. I completed my Ph.D in Electrical and Computer Engineering at the University of Illinois at Urbana-Champaign in 2013. I was supervised by Prof. Yi Ma. I received my Bachelor Degree in Automation from Tsinghua University, China, and Master Degree in ECE from UIUC, respectively.

My research interest lies in the broad area of computer vision, machine learning, signal processing, and applied data sciences. I am particularly focusing on 3D Vision. Specifically, I develop novel computational tools to model and analyze the 3D environments from big visual data, and apply them to solve challenging real-world problems in computer-aided design, VR/AR, social media, and more.

What's New?

We are maintaining a list of papers and resources for holistic 3D reconstruction here.

Publications

	NeRF-Enhanced Outpainting for Faithful Field-of-View Extrapolation Rui Yu, Jiachen Liu, Zihan Zhou, and Sharon X. Huang IEEE International Conference on Robotics and Automation (ICRA), 2024. [paper]
	PlankAssembly: Robust 3D Reconstruction from Three Orthographic Views with Learnt Shape Programs Wentao Hu, Jia Zheng, Zixin Zhang, Xiaojun Yuan, Jian Yin, and Zihan Zhou IEEE International Conference on Computer Vision (ICCV), 2023. [paper][project/code]
	Two-stage Content-Aware Layout Generation for Poster Designs Shang Chai, Liansheng Zhuang, Fengying Yan, and Zihan Zhou ACM Multimedia Conference (ACM MM), 2023. [paper]
	Deep Learning Assisted Optimization for 3D Reconstruction from Single 2D Line Drawings Jia Zheng, Yifan Zhu, Kehan Wang, Qiang Zou, and Zihan Zhou arXiv:2209.02692, 2022. [paper][project]
	End-to-end Graph-constrained Vectorized Floorplan Generation with Panoptic Refinement Jiachen Liu, Yuan Xue, Jose Duarte, Krishnendra Shekhawat, Zihan Zhou, and Xiaolei Huang European Conference on Computer Vision (ECCV), 2022. [paper]
	Neural Face Identification in a 2D Wireframe Projection of a Manifold Object Kehan Wang, Jia Zheng, and Zihan Zhou IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [paper][project/code]
	Deep Depth from Focus with Differential Focus Volume Fengting Yang, Xiaolei Huang, and Zihan Zhou IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [paper][code]
	Iterative Design and Prototyping of Computer Vision Mediated Remote Sighted Assistance Jingyi Xie, Madison Reddie, Sooyeon Lee, Syed M. Billah, Zihan Zhou, Chun-Hua Tsai, and John M. Carroll ACM Transaction on Computer-Human Interaction (ToCHI), 2022. [paper]
	Towards Robust Human Trajectory Prediction in Raw Videos Rui Yu, and Zihan Zhou IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021. [paper][code]
	Neural Wireframe Renderer: Learning Wireframe to Image Translations Yuan Xue, Zihan Zhou, and Xiaolei Huang European Conference on Computer Vision (ECCV), 2020. [paper][code]
	Structured3D: A Large Photo-realistic Dataset for Structured 3D Modeling Jia Zheng, Junfei Zhang, Jing Li, Rui Tang, Shenghua Gao, and Zihan Zhou European Conference on Computer Vision (ECCV), 2020. [paper][project/code]
	Data-driven Distributed State Estimation and Behavior Modeling in Sensor Networks Rui Yu, Zhenyuan Yuan, Minghui Zhu, and Zihan Zhou IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020. [paper]
	Superpixel Segmentation with Fully Convolutional Networks Fengting Yang, Qian Sun, Hailin Jin, and Zihan Zhou IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020. [paper] [code]
	Single-Image Piece-Wise Planar 3D Reconstruction via Associative Embedding Zehao Yu, Jia Zheng, Dongze Lian, Zihan Zhou, and Shenghua Gao IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019. [paper] [code/data]
	Recovering 3D Planes from a Single Image via Convolutional Neural Networks Fengting Yang and Zihan Zhou European Conference on Computer Vision (ECCV), 2018. [paper] [supp. material] [code/data]
	Learning to Parse Wireframes in Images of Man-Made Environments Kun Huang, Yifan Wang, Zihan Zhou, Tianjiao Ding, Shenghua Gao, and Yi Ma IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018. [paper] [supp. material] [code/data]
	Discovering Triangles in Protraits for Supporting Photographic Creation Siqiong He, Zihan Zhou, Farshid Farhat, and James Z. Wang IEEE Transactions on Multimedia (TMM), 2018. [paper]
	Beyond Saliency: Assessing Visual Balance with High-Level Cues Baris Kandemir, Zihan Zhou, Jia Li, and James Z. Wang Engagement Workshop, ACM Multimedia Conference (ACM MM), 2017. [paper]
	Detecting Dominant Vanishing Points In Natural Scenes with Application to Composition-Sensitive Image Retrieval Zihan Zhou, Farshid Farhat, and James Z. Wang IEEE Transactions on Multimedia (TMM), 2017. [paper][project][code]
	Improving Offline Handwritten Chinese Character Recognition by Iterative Refinement Xiao Yang, Dafang He, Zihan Zhou, Daniel Kifer, and C. Lee Giles IAPR International Conference on Document Analysis and Recognition (ICDAR), 2017. [paper]
	Learning to Read Irregular Text with Attention Mechanisms Xiao Yang, Dafang He, Zihan Zhou, Daniel Kifer, and C. Lee Giles International Joint Conference on Artificial Intelligence (IJCAI), 2017. [paper]
	Label Information Guided Graph Construction for Semi-Supervised Learning Liansheng Zhuang, Zihan Zhou, Shenghua Gao, Jingwen Yin, Zhouchen Lin, and Yi Ma IEEE Transactions on Image Processing (TIP), 2017. [paper]
	Smart Library: Identifying Books in a Library using Richly Supervised Deep Scene Text Reading Xiao Yang, Dafang He, Wenyi Huang, Alexander Ororbia, Zihan Zhou, Daniel Kifer, and C. Lee Giles ACM/IEEE-CS Joint Conference on Digital Library (JCDL, short paper), 2017. [paper]
	Multi-scale FCN with Instance Aware Segmentation for Arbitrary Oriented Word Spotting In The Wild Dafang He, Xiao Yang, Chen Liang, Zihan Zhou, Alexander Ororbia, Daniel Kifer, and C. Lee Giles IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017. [paper]
	Robust Plane-based Calibration of Multiple Non-Overlapping Cameras Chen Zhu, Zihan Zhou, Ziran Xing, Yanbing Dong, Yi Ma, and Jingyi Yu International Conference on 3D Vision (3DV), 2016. [paper]
	Aggregating Local Context for Accurate Scene Text Detection Dafang He, Xiao Yang, Wenyi Huang, Zihan Zhou, Daniel Kifer, and C. Lee Giles Asian Conference on Computer Vision (ACCV), 2016. [paper]
	Detecting Arbitrary Orientated Text in the Wild with a Visual Attention Model Wenyi Huang, Dafang He, Xiao Yang, Zihan Zhou, Daniel Kifer, and C. Lee Giles ACM Multimedia Conference (ACM MM, short paper), 2016. [paper]
	Modeling Perspective Effects in Photographic Composition Zihan Zhou, Siqiong He, Jia Li, and James Z. Wang ACM Multimedia Conference (ACM MM), 2015. [paper]
	Fast L1-Minimization Algorithms For Robust Face Recognition Allen Yang, Zihan Zhou, Arvind Ganesh, Shankar Sastry, and Yi Ma. IEEE Transactions on Image Processing (TIP), 2013. [paper] [code]
	Plane-Based Content-Preserving Warps for Video Stabilization Zihan Zhou, Hailin Jin, and Yi Ma. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013. [paper] [project]
	Single-Sample Face Recognition with Image Corruption and Misalignment via Sparse Illumination Transfer Liansheng Zhuang, Allen Yang, Zihan Zhou, Shankar Sastry, and Yi Ma. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013. [paper]
	Robust Plane-Based Structure From Motion Zihan Zhou, Hailin Jin, and Yi Ma. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012. [paper]
	Towards a Practical Face Recognition System: Robust Alignment and Illumination by Sparse Representation Andrew Wagner, John Wright, Arvind Ganesh, Zihan Zhou, Hossein Mobahi, and Yi Ma. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2012. [paper][project]
	Holistic Reconstruction of Urban Structures from Low-rank Textures Hossein Mobahi, Zihan Zhou, Allen Yang, and Yi Ma. Workshop on 3D representation and recognition, IEEE International Conference on Computer Vision (ICCV-3dRR), 2011. [paper]
	Towards a Robust Face Recognition System using Compressive Sensing Allen Yang, Zihan Zhou, Yi Ma, and Shankar Sastry. InterSpeech, 2010. [paper]
	Stable Principal Component Pursuit Zihan Zhou, Xiaodong Li, John Wright, Emmanuel Candes, and Yi Ma. IEEE International Sysmposium on Information Theory (ISIT), 2010. [paper][project]
	Face Recognition with Contiguous Occlusion using Markov Random Fields Zihan Zhou, Andrew Wagner, Hossein Mobahi, John Wright, and Yi Ma. IEEE International Conference on Computer Vision (ICCV), 2009. [paper]
	Towards a Practical Face Recognition System: Robust Registration and Illumination via Sparse Representation Andrew Wanger, John Wright, Arvind Ganesh, Zihan Zhou, and Yi Ma. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009. [paper]
	Separation of A Subspace-Sparse Signal: Algorithms and Conditions Arvind Ganesh, Zihan Zhou, and Yi Ma. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2009. [paper]
	Nearest-Subspace Patch Matching for Face Recognition Under Varying Pose and Illumination Zihan Zhou, Arvind Ganesh, John Wright, Shen-Fu Tsai, and Yi Ma. IEEE International Conference on Automatic Face and Gesture Recognition (FG), 2008. [paper]

Dissertation, Thesis, and Book Chapter

Exploring Structural Regularities for Robust 3D Reconstruction of Urban Scenes [pdf]
Ph.D. dissertation, University of Illinois at Urbana-Champaign, 2013.
Advisor: Prof. Yi Ma.

Face Recognition under Varying Illumination, Pose and Contiguous Occlusion [pdf]
M.S. thesis, University of Illinois at Urbana-Champaign, 2010.
Advisor: Prof. Yi Ma.

Face Recognition by Sparse Representation [book chapter]
John Wright, Allen Yang, Arvind Ganesh, Andrew Wagner, Zihan Zhou, and Yi Ma.
In Compressed Sensing: Theory and Applications, 2012.

Professional Activities

Conference reviewer: CVPR, ICCV, ECCV, etc.

Journal reviewer: TPAMI, IJCV, TIP, TSP, TMI, TMM, etc.