zju3dv

Make human motion capture easier.

Code for "LoFTR: Detector-Free Local Feature Matching with Transformers", CVPR 2021, T-PAMI 2022

Code for "NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Video", CVPR 2021 oral

Code for "GVHMR: World-Grounded Human Motion Recovery via Gravity-View Coordinates", Siggraph Asia 2024, TPAMI 2026

[CVPR 2024] 4K4D: Real-Time 4D View Synthesis at 4K Resolution

[SIGGRAPH Asia 2023 (Technical Communications)] EasyVolcap: Accelerating Neural Volumetric Video Research

[ECCV 2024] Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splatting

Code for "MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Training", TPAMI 2026.

Code for "Deep Snake for Real-Time Instance Segmentation" CVPR 2020 oral

[TVCG2024] PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstruction

[CVPR 2026] InfiniDepth: Arbitrary-Resolution and Fine-Grained Depth Estimation with Neural Implicit Fields

Code for "Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speed", CVPR 2024

Code for "OnePose: One-Shot Object Pose Estimation without CAD Models", CVPR 2022

Code for "Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans" CVPR 2021 best paper candidate

Code for "PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation" CVPR 2019 oral

Level of Gaussians

Code for "Detector-Free Structure from Motion", CVPR 2024

Code for "Neural 3D Reconstruction in the Wild", SIGGRAPH 2022 (Conference Proceedings)

[ICCV 2025] Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models

InfiniSplat Series: Feed-Forward 3D Gaussian Reconstruction

[CVPR 2026 (Highlight)] Scal3R: Scalable Test-Time Training for Large-Scale 3D Reconstruction

Code for "Fast and Robust Multi-Person 3D Pose Estimation from Multiple Views" (CVPR 2019, T-PAMI 2021)

Code for "Neural 3D Scene Reconstruction with the Manhattan-world Assumption" CVPR 2022 Oral

Code for "Animatable Implicit Neural Representations for Creating Realistic Avatars from Videos" TPAMI 2024, ICCV 2021

Code for "OnePose++: Keypoint-Free One-Shot Object Pose Estimation without CAD Models" NeurIPS 2022

SIGGRAPH Asia 2022: Code for "Efficient Neural Radiance Fields for Interactive Free-viewpoint Video"

Code for "PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation" CVPR 2019 oral

Code for "MeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editing", ECCV 2022 Oral

Code for "Multi-view Reconstruction via SfM-guided Monocular Depth Estimation". CVPR 2025 (Oral Presentation)

Code for "AutoRecon: Automated 3D Object Discovery and Reconstruction" CVPR 2023 (Highlight)

[ECCV 2026] Habitat-GS: A High-Fidelity Navigation Simulator with Dynamic Gaussian Splatting

[CVPR 2025] StreetCrafter: Street View Synthesis with Controllable Video Diffusion Models

A web-based 3D visualization tool for 3D computer vision.

Robust and Efficient Visual-Inertial Odometry with Multi-plane Priors

Code for "Learning Object-Compositional Neural Radiance Field for Editable Scene Rendering", ICCV 2021

[ICCV 2025] MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space

Code for "Dense Tracking and Mapping with Voxel-based Neural Implicit Representation", ISMAR 2022

This source code provides a reference implementation for ENFT-SfM.

SIGGRAPH Asia 2023: Code for "Im4D: High-Fidelity and Real-Time Novel View Synthesis for Dynamic Scenes"

[ECCV 2020] SMAP: Single-Shot Multi-Person Absolute 3D Pose Estimation

[CVPR 2025] EnvGS: Modeling View-Dependent Appearance with Environment Gaussian

Code for "Representing Volumetric Videos as Dynamic MLP Maps" CVPR 2023

An Agentic Navigation System for Any Task in Any Scene

INTACT: Isomorphic Intent-to-Action Learning for Search-Free World Models.

[CVPR 2023] PVO: Panoptic Visual Odometry

Code release for Stereo 3D Object Detection via Shape Prior Guided Instance Disparity Estimation (CVPR 2020, TPAMI 2021)

[CVPR 2025] LiDAR-RT: Gaussian-based Ray Tracing for Dynamic LiDAR Re-simulation

[SIGGRAPH 2024] Coin3D: Controllable and Interactive 3D Assets Generation with Proxy-Guided Conditioning

Code for "GIFT: Learning Transformation-Invariant Dense Visual Descriptors via Group CNNs" NeurIPS 2019

[CVPR 2021 Oral] Reconstructing 3D Human Pose by Watching Humans in the Mirror

render images for pvnet training

[ICCV2023] IntrinsicNeRF: Learning Intrinsic Neural Radiance Fields for Editable Novel View Synthesis

Code for "Modeling Indirect Illumination for Inverse Rendering", CVPR 2022

Efficient Incremental BA

Code for "DELTAR: Depth Estimation from a Light-weight ToF Sensor And RGB Image", ECCV 2022

[CVPR 2023] Code for "Learning Neural Volumetric Representations of Dynamic Humans in Minutes"

Toolkit for VI-SLAM evaluation.

[CVPR 2024 (Highlight)] Relightable and Animatable Neural Avatar from Sparse-View Video

[ICCV 2025] InstaScene: Towards Complete 3D Instance Decomposition and Reconstruction from Cluttered Scenes

Code for "SAM-guided Graph Cut for 3D Instance Segmentation" ECCV 2024

[CVPR 2025] Code for "StarGen: A Spatiotemporal Autoregression Framework with Video Diffusion Model for Scalable and Controllable Scene Generation".

Code for "Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field", CVPR 2023

A Temporal Voyage: Code for "Neural Scene Chronology" [CVPR 2023]

code for "DeFlowSLAM: Self-Supervised Scene Motion Decomposition for Dynamic Dense SLAM"

dataset for ECCV 2020 "Motion Capture from Internet Videos"

Segment based Bundle Adjustment

Code for "BoxDreamer: Dreaming Box Corners for Generalizable Object Pose Estimation", ICCV 2025.

Code for "Motion-2-to-3: Leveraging 2D Motion Data to Boost 3D Motion Generation", ICCV 2025

[CVPR 2024] Generating Human Motion in 3D Scenes from Text Descriptions

Code for "PATS: Patch Area Transportation with Subdivision for Local Feature Matching", CVPR 2023

SplatAnything: Gaussian Spacing Normalization for Feed-Forward 3DGS across Arbitrary Scenes

Code for "GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Image", CVPR 2024

VS-Net: Voting with Segmentation for Visual Localization

Code for "Learning Human Mesh Recovery in 3D Scenes" CVPR 2023

[CVPR2025] From Sparse to Dense: Camera Relocalization with Scene-Specific Detector from Feature Gaussian Splatting

Efficient Non-Consecutive Feature Tracking for Robust SfM http://www.zjucvg.net/ls-acts/ls-acts.html

[CoRL 2022] Generative Category-Level Shape and Pose Estimation with Semantic Primitives

Code for "TotalSelfScan: Learning Full-body Avatars from Self-Portrait Videos of Faces, Hands, and Bodies" (NeurIPS 2022)

[ECCV 2026] PointSplat: Compact Gaussian Splatting via Human-Centric Prediction

CoSurfGS: Collaborative 3D Surface Gaussian Splatting with Distributed Learning for Large Scene Reconstruction

Code for "StreamingTalker: Audio-driven 3D Facial Animation with Autoregressive Diffusion Model", AAAI2026 Oral

Code for "Coxgraph: Multi-Robot Collaborative, Globally Consistent, Online Dense Reconstruction System", IROS 2021 Best Paper Award Finalist on Safety, Security, and Rescue Robotics in memory of...

[ICLR 2025] Ready-to-React: Online Reaction Policy for Two-Character Interaction Generation

Rapid and Robust Monocular Visual-Inertial Initialization with Gravity Estimation via Vertical Edges

ICCV 2023, Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models

Official implementation of ICCV 2025 paper "EgoAgent: A Joint Predictive Agent Model in Egocentric Worlds".

Code for "Vox-Surf: Voxel-based Implicit Surface Representation", TVCG 2022

DATAP-SfM: Dynamic-Aware Tracking Any Point for Robust Dense Structure from Motion in the Wild