Zhizhuo (Z) Zhou

I am a MSR student at Carnegie Mellon University working with Shubham Tulsiani on computer vision—sparse view 3D reconstruction.

I am thankful to receive funding from NSF GRFP. I completed my undergrad at the University of Michigan, where I was fortunate to work with David Fouhey.


Email | CV | Google Scholar | Blog | Github

News

Dec 2022 - [SparseFusion] Check out our latest work that unifies advances in neural rendering and image generation!

Oct 2022 - [Talk] Won Meta-AI CO3D Challenge few-view reconstruction track at ECCV 2022 NGR-CO3D workshop!

Jul 2022 - TA for AI4ALL@CMU 2022!

June 2021 - [Paper] Quantifying Bird Skeletons accepted at CV4Animals Workshop In conjunction with CVPR 2021!

Mar 2021 - Awarded NSF GRFP.

Jan 2021 - Won ProjectX ML research competition focused on climate change, advised by Sindhu Kutty.

Mar 2020 - Michigan Alexa Prize team entered semi-finals.

June 2019 - Co-founded one of ten university teams globally for Alexa Prize Challenge 3, advised by David Jurgens.

Sep 2018 - Started school at University of Michigan, Ann Arbor

Research

I am interested in understanding and generating 3D scenes from casual videos, images, and text.

SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstruction

Zhizhuo Zhou, Shubham Tulsiani

In submission


We propose a 3D neural mode-seeking formulation that combines probabilistic generation of unseen regions with faithful reprojection of seen regions in a consistent 3D representation.

Quantifying Bird Skeletons

Zhizhuo Zhou, Gemmechu Hassena, Brian C. Weeks, David F. Fouhey

CV4Animals Workshop in conjunction with CVPR 2021


We can measure bird skeleton specimens extraordinarily accurately and quite fast with deep learning. This system can unlock datasets of birds at unprecedented scales.

Audrey: A Personalized Open-Domain Conversational Bot

Chung Hoon Hong, Yuan Liang , Sagnik Sinha Roy, Arushi Jain, Vihang Agarwal, Ryan Draves, Zhizhuo Zhou, William Chen, Yujian Liu, Martha Miracky, Lily Ge, Nikola Banovic, David Jurgens

The Alexa Prize Proceedings (2020)


We build a chatbot that interacted with tens of thousands of real users on Alexa.


Projects

  • [Class Project] OpenGIT: Open-Domain Compositional Image Editing with Text

  • [Class Project] MasterChef: Using Instagram to Train a Text-to-Image Generator

  • [Paper] The Devil is in the Details: Spatial and Temporal Super-Resolution of Global Climate Models using Deep Learning (won projectx2020!)

  • [Hackathon Project] ZeroHero: Fruit and Vegetable Object Detection and Recipe Recommendation

  • [Hackathon Project] trAnSLate: American Sign Language Translator with Image Classification

  • [Hackathon Project] Raspberry Pi Powered Autonomous Car

  • Life RPG: Gamifying Goal Tracking with an Alexa skill

  • Fruitful: Fruit Ripeness Detection App

  • Unlimited Field: Website with EEG Brain Computer Interface

Volunteering

  • Lead TA, AI4ALL Carnegie Mellon University, 2022

  • Project Mentor, AI4ALL University of Michigan, 2021

Awards and Honors

  • NSF GRFP, 2021-2024

  • Best Paper Award, ProjectX 2020 ML for Climate Change Competition, 2020-2021

  • Undergraduate Scholarship, University of Michigan College of Engineering, 2018 - 2021