# Flow supervision for Deformable NeRF

Source: [Flow supervision for Deformable NeRF](<https://www.sota2.com/research/paper/68fa6ee21e209131cea42a19>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-01T16:31:44.785Z

Authors: Chaoyang Wang, Lachlan Ewen MacDonald, Laszlo A. Jeni, Simon Lucey

Published: 2023-03-28T22:16:15.000Z

## Abstract

In this paper we present a new method for deformable NeRF that can directly use optical flow as supervision. We overcome the major challenge with respect to the computationally inefficiency of enforcing the flow constraints to the backward deformation field, used by deformable NeRFs. Specifically, we show that inverting the backward deformation function is actually not needed for computing scene flows between frames. This insight dramatically simplifies the problem, as one is no longer constrained to deformation functions that can be analytically inverted. Instead, thanks to the weak assumptions required by our derivation based on the inverse function theorem, our approach can be extended to a broad class of commonly used backward deformation field. We present results on monocular novel view synthesis with rapid object motion, and demonstrate significant improvements over baselines without flow supervision.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Dynamic View Synthesis on NDVS Playground Scene](<https://www.sota2.com/research/sota/dynamic-view-synthesis-on-ndvs-playground-scene.md>): Dynamic View Synthesis; NVIDIA dynamic view synthesis (NDVS) Playground scene; PSNR: 22.39.

- [Dynamic View Synthesis on NVIDIA dynamic view synthesis (NDVS) Balloon1 scene](<https://www.sota2.com/research/sota/dynamic-view-synthesis-on-nvidia-dynamic-view-synthesis-ndvs-balloon1-scene.md>): Dynamic View Synthesis; NVIDIA dynamic view synthesis (NDVS) Balloon1 scene; PSNR: 24.36.

- [Dynamic View Synthesis on NDVS (Balloon2 scene)](<https://www.sota2.com/research/sota/dynamic-view-synthesis-on-ndvs-balloon2-scene.md>): Dynamic View Synthesis; NVIDIA dynamic view synthesis (NDVS) (Balloon2 scene); PSNR: 25.82.

- [Dynamic View Synthesis on NVIDIA dynamic view synthesis (NDVS) Umbrella scene](<https://www.sota2.com/research/sota/dynamic-view-synthesis-on-nvidia-dynamic-view-synthesis-ndvs-umbrella-scene.md>): Dynamic View Synthesis; NVIDIA dynamic view synthesis (NDVS) Umbrella scene; PSNR: 24.25.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2303.16333>)

[PDF](<https://arxiv.org/pdf/2303.16333.pdf>)

[Implementation](<https://mightychaos.github.io/projects/fsdnerf>)