5,336
edits
Neural Fields: Difference between revisions
→Dynamic Content
| Line 58: | Line 58: | ||
The idea here is to have an MLP which models the deformation of a canonical frame to the target frame. | The idea here is to have an MLP which models the deformation of a canonical frame to the target frame. | ||
* [https://nerfies.github.io/ Nerfies: Deformable Neural Radiance Fields] | |||
** Windowed positional encoding | |||
* [https://www.albertpumarola.com/research/D-NeRF/index.html D-NeRF (CVPR 2020)] | * [https://www.albertpumarola.com/research/D-NeRF/index.html D-NeRF (CVPR 2020)] | ||
* [https://hypernerf.github.io/ HyperNeRF (SIGGRAPH Asia 2021)] | * [https://hypernerf.github.io/ HyperNeRF (SIGGRAPH Asia 2021)] | ||
** Allows the deformation network to output 2 additional feature values which ''slice'' the canonical NeRF. | |||
====Latent code==== | ====Latent code==== | ||
| Line 68: | Line 71: | ||
====Time-axis==== | ====Time-axis==== | ||
* [https://video-nerf.github.io/ Space-time Neural Irradiance Fields for Free-Viewpoint Video (Video-NeRF)] | |||
** Adds a bunch of regularization which allows directly inputting time to the MLP. | |||
* [https://aoliao12138.github.io/FPO/ Fourier PlenOctrees] | |||
** Apply DFT to spherical harmonics in PlenOctrees. | |||
* [https://arxiv.org/pdf/2202.06088.pdf NeuVV] | |||
** Hyperspherical Harmonics | |||
* [https://arxiv.org/abs/2301.11280 Text-To-4D Dynamic Scene Generation (2023)] | * [https://arxiv.org/abs/2301.11280 Text-To-4D Dynamic Scene Generation (2023)] | ||
** Extends the tri-plane feature grid to a six-plane feature grid ({x, y, z, t} choose 2). | ** Extends the tri-plane feature grid to a six-plane feature grid ({x, y, z, t} choose 2). | ||
| Line 74: | Line 83: | ||
Segment static background and objects from dynamic background and objects | Segment static background and objects from dynamic background and objects | ||
* [https://arxiv.org/pdf/2104.14786.pdf Editable Free-Viewpoint Video using a Layered Neural Representation] | |||
** Create a scene by compositing one NeRF per actor. | |||
* [https://arxiv.org/abs/2303.03361 NeRFlets (2023)] | * [https://arxiv.org/abs/2303.03361 NeRFlets (2023)] | ||
* [https://arxiv.org/abs/2303.14536 SUDS: Scalable Urban Dynamic Scenes (2023)] | * [https://arxiv.org/abs/2303.14536 SUDS: Scalable Urban Dynamic Scenes (2023)] | ||