Ziyue Feng

Ziyue Feng

Multimodal Generative Modeling Researcher

Apple

Biography

I am a Video Machine Learning Researcher at Apple, focusing on Generative Modeling.

During my Ph.D. study at Clemson University, I was focused on geometric learning in 3D Computer Vision, specifically Depth Estimation, 3D Reconstruction, and Neural Radiance Fields.

Prior to Apple, I took a research internship at Google, worked with Clément Godard and Lynn Tsai on Project Starline.

Interests

  • Video Generation
  • Depth Estimation
  • 3D Reconstruction
  • NeRF & Light Field

Education

  • PhD in Computer Vision, 2019 - Present

    Clemson University

  • BEng in Computer Science, 2015 - 2019

    Xi'an Jiaotong University

Selected Publications

*
All Depth Prediction 3D Reconstruction NeRF Motion Planning

NARUTO: Neural Active Reconstruction from Uncertain Target Observations

[CVPR 2024] NeRF style active reconstruction system with uncertainty learning. Project page.
Ziyue Feng, Huangying Zhan, etc...
Preprint PDF Code Project Poster Video

CVRecon: Rethinking 3D Geometric Feature Learning For Neural Reconstruction

[ICCV 2023] Proposed a novel cost volume based 3D geometric feature representation. Project page: https://cvrecon.ziyue.cool/
Ziyue Feng, Leon Yang, Pengsheng Guo, Bing Li
Preprint PDF Code Project Slides

Disentangling Object Motion and Occlusion for Unsupervised Multi-frame Monocular Depth

[ECCV 2022] Solve the dynamic object problem in multi-frame monocular depth prediction.
Ziyue Feng, Liang Yang, Longlong Jing, Haiyan Wang, Yingli Tian, Bing Li
Preprint PDF Code Project Poster Slides Video

Advancing Self-supervised Monocular Depth Learning with Sparse LiDAR

[CoRL 2021] Use sparse LiDAR to improve depth prediction
Ziyue Feng, Longlong Jing, Peng Yin, Yingli Tian, Bing Li
Preprint PDF Code Poster Slides Video

PSE-Match: A Viewpoint-Free Place Recognition Method With Parallel Semantic Embedding

[IEEE T-ITS 2021] A viewpoint invariant point cloud global localization descriptor.
Peng Yin, Lingyun Xu, Ziyue Feng, Anton Egorov, Bing Li
Preprint PDF

Model-based decision making with imagination for autonomous parking

[IEEE IV 2018] Improved RRT for autonomous parking motion planning.
Ziyue Feng, Shitao Chen, Yu Chen, Nanning Zheng
Preprint PDF Code Video

Experience

 
 
 
 
 

Video Machine Learning Researcher

Apple

Oct 2024 – Present Cupertino, CA
  • Working in multimodal generative modeling.
 
 
 
 
 

Senior Machine Learning Engineer

Matterport

Apr 2024 – Aug 2024 Sunnyvale, CA
  • Working in 3D Computer Vision and Generative AI.
 
 
 
 
 

Research Intern

Google

Sep 2023 – Dec 2023 San Francisco, CA
  • Working on Google Project Starline with Dr. Clément Godard and Lynn Tsai.
 
 
 
 
 

Research Intern

OPPO US Research

Jun 2023 – Sep 2023 Palo Alto, CA
  • Worked with Dr. Huangying Zhan in 3D Active Neural SLAM
 
 
 
 
 

Research Assistant

Clemson University

Sep 2019 – Present South Carolina
  • Computer Vision
  • Autonomous Driving
 
 
 
 
 

Research Intern

MEGVII (FACE++) Research

Jan 2019 – May 2019
  • Computer Vision
  • Advanced Driving Asistant Systems
 
 
 
 
 

Research Intern

Institute of Artifitial Intelligence and Robotics (IAIR at XJTU)

Oct 2016 – Jan 2019
  • Computer Vision
  • Motion Planning

Contact

…