BlenderNeRF Versions Save

Easy NeRF synthetic dataset creation within Blender

v5

1 year ago

This release mainly focuses on fixing a bug pointed out in issue #18, in which a miscomputation of the camera intrinsics sometimes leads to mismatching fields of view between ground truth Blender renders and the corresponding NeRF renders. The mismatch is due to the wrong computation of focal lengths, when the camera sensor fit is not Horizontal.

To this end, 27 datasets have been captured for debugging purposes, in which different aspect ratios, pixel ratios and camera sensor fits have been evaluated. The dataset and respective Blender file are made available here and a thorough description of the data and capturing process is described in the contained README.txt file.

The mismatch should now have been alleviated. Below are depicted a few results in which NeRF renders (left column of each image) are compared to their respective ground truth with pixel ratio 1:1 rendered in Blender (right column). Camera parameters for each set of renders are described in the table underneath the image. The NGP renders are automatically stretched or squeezed to undo the non uniform pixel ratio in training frames. Feel free to inspect the data for further details.

debug

Left Middle Right
Sensor Fit Auto Horizontal Vertical
Aspect Ratio 1 : 1 16 : 9 2 : 3
Resolution 300 * 300 576 * 324 300 * 450
Pixel Ratio 1 : 1.5 1.5 : 1 1 : 1

Below are a two relevant observations and take aways.

  • For the middle image, the NeRF volume is partially cropped at the top and bottom of the donut. This is because the training images are stretched out (pixel ratio 1.5:1), and therefore a smaller region of the donut is only visible in these frames (see the corresponding frames in the data). As validated here, the NeRF render reshapes the scene to a uniform pixel ratio, thereby undoing the stretching effect.
  • The Vertical sensor fit often results in somewhat distorted NeRF volumes. I am however unsure of the cause, and consequently recommend avoiding it if possible.

This release additionally comprises a new functionality and a few warning/error fixes.

  1. The number of training frames used from the training camera with the TTC method can now be changed independently of the number of testing frames. The latter (number of testing frames) remains the frame range of the Blender scene.
  2. The issues highlighted in the pull request #19 have been resolved.

v4

1 year ago

New features and updated functionalities

  1. Starting frame with the COS training method is now the default scene frame start, instead of frame 1
  2. New option for outwards facing cameras with the COS training method
  3. Revised file and folder output structure: the output convention follows the original NeRF synthetic dataset structure. The output folder contains the transforms.json files directly, alongside a train folder with images
  4. Enabled support for the original NeRF transforms.json file format convention (alongside the Instant NGP file convention)
  5. Enabled option to save a log file containing all the necessary information for reproducibility on a BlenderNeRF run

v3

1 year ago

Third stable version of BlenderNeRF add-on : support for all methods (SOF, TTC and COS)

v2.0.0

1 year ago

Second stable version of Blender x NeRF add-on : support for SOF and TTC methods + simplified UI redesign

v2

1 year ago

Second stable version of BlenderNeRF add-on : support for SOF and TTC methods + simplified UI redesign

v1.0.0

1 year ago

First public release with stable version of Blender x NeRF add-on : currently only supports SOF with Instant NGP

v1

1 year ago

First public release with stable version of BlenderNeRF add-on : currently only supports SOF with Instant NGP