├── .gitignore
├── LICENSE
├── README.md
├── _config.yml
├── _includes
└── head-custom-google-analytics.html
├── _layouts
└── default.html
├── assets
└── css
│ └── style.scss
├── banner.png
├── barbershop_pano.webp
├── garden_pano.webp
├── generate_NERF_transforms.py
├── lone_monk_pano.webp
├── nerf_barbershop_spherical.gif
├── nerf_garden.gif
├── nerf_lone_monk.gif
├── sha256sums.txt
└── thumbnails
├── page-1.png
├── page-2.png
├── page-3.png
├── page-4.png
├── page-5.png
└── page-6.png
/.gitignore:
--------------------------------------------------------------------------------
1 | *.exr
2 | *.mp4
3 |
4 |
--------------------------------------------------------------------------------
/LICENSE:
--------------------------------------------------------------------------------
1 | This work is licensed under the Creative Commons Attribution 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ or send a letter to Creative Commons, PO Box 1866, Mountain View, CA 94042, USA.
2 |
--------------------------------------------------------------------------------
/README.md:
--------------------------------------------------------------------------------
1 |
13 |
14 | [](https://github.com/IDLabMedia/large-lightfields-dataset/stargazers) [](https://paperswithcode.com/dataset/silvr) [](https://cs.paperswithcode.com/paper/silvr-a-synthetic-immersive-large-volume) [](https://arxiv.org/abs/2204.09523) [](#credits)
15 |
16 | We present _SILVR_, a dataset of light field images for six-degrees-of-freedom
17 | navigation in large fully-immersive volumes. The _SILVR_ dataset is short for
18 | _"**S**ynthetic **I**mmersive **L**arge-**V**olume **R**ay"_ dataset.
19 |
20 | ## Properties
21 | Our dataset exhibits the following properties:
22 |
23 | - **synthetic**: Rendered using Blender 3.0 with Cycles, the images are
24 | perfect and do not need any calibration. Camera positions and lens
25 | configurations are known exactly and provided in the corresponding JSON
26 | files.
27 | - **large interpolation volume**: The camera configurations span a
28 | relatively large volume (a couple of meters in diameter).
29 | - **large field of view**: In order to maximize the _interpolation volume_
30 | (a.k.a: the walkable volume of light), the images are rendered using fisheye
31 | lenses with a field of view of 180°.
32 | - **immersive**: Thanks to the large field of view and positioning of the
33 | viewpoints, every point within the interpolation volume has a full panoramic
34 | field of view of light information available.
35 | - **realism**: The selected scenes have reasonable realism.
36 | - **depth maps**: As the images are computer-generated renders, we provide
37 | depth maps for every image.
38 | - **specularities** and **reflections**: The scenes exhibit some specularities
39 | or reflections, including mirrors. Reflections and mirrors always have the
40 | depth of the surface, and not the apparent depth of the reflections.
41 | - **volumetrics**: Some volumetrics are also present (fire, smoke, fog) in the
42 | `garden` scene.
43 | - **densly rendered**: The camera setup is rather dense (around 10cm spacing
44 | between cameras).
45 |
46 | ## Scenes
47 |
48 | We present light field renders with various camera setup configurations for three scenes: _Agent 327: Barbershop_, _Zen Garden_, and _Lone Monk_.
49 |
50 | ### Agent 327: Barbershop
51 |
52 | 
53 |
54 | This scene is taken from [the Blender website, under the "demo files"
55 | section](https://www.blender.org/download/demo-files/#cycles). It is licensed
56 | CC-BY, by [Blender Foundation](https://studio.blender.org).
57 |
58 | Download the original _Agent 327: Barbershop_ scene **with light field camera setups** [here (272MB)](https://cloud.ilabt.imec.be/index.php/s/anFWqc5TwW646Ex).
59 | Note that our [Blender Lightfield Addon](https://github.com/IDLabMEDIA/blender-lightfield-addon) is required to open the Blender file with light fields.
60 |
61 | ### Zen Garden
62 |
63 | 
64 |
65 | This scene is made in-house by IDLab-MEDIA. It is licensed [CC-BY 4.0](https://creativecommons.org/licenses/by/4.0/).
66 |
67 | Download the _Zen Garden_ scene **with light field camera setups** [here (231MB)](https://cloud.ilabt.imec.be/index.php/s/Moqz2e7mNs2AFcT).
68 | Note that our [Blender Lightfield Addon](https://github.com/IDLabMEDIA/blender-lightfield-addon) is required to open the Blender file with light fields.
69 |
70 | ### Lone Monk
71 |
72 | 
73 |
74 | This scene is made by Carlo Bergonzini from [Monorender](http://www.monorender.com/), licensed CC-BY.
75 | The original scene is also available for download from [the Blender website, under the "demo files"
76 | section](https://www.blender.org/download/demo-files/#cycles).
77 | Applied modifications:
78 | - Added roof geometry above the section with the chair.
79 | - Solidify modifier on the roof tiles.
80 |
81 | Download the modified _Lone Monk_ scene **with light field camera setups** [here (33MB)](https://cloud.ilabt.imec.be/index.php/s/wTwwPyD8pp4CQkp).
82 | Note that our [Blender Lightfield Addon](https://github.com/IDLabMEDIA/blender-lightfield-addon) is required to open the Blender file with light fields.
83 |
84 | ## Download
85 |
86 | All images are provided in OpenEXR format with HDR colors and depth in meters.
87 | Files are available for download from our own [storage service](https://cloud.ilabt.imec.be/index.php/s/KHWopdXmT3Dxo5P).
88 | All files can be downloaded individually. Below you can find an overview of the different files and their sizes.
89 |
90 | ```
91 | - Barbershop
92 | - barbershop_LFCuboid_1mx3mx1m.tar (16 GB)
93 | - barbershop_LFSphere_e105cm_d145cm.tar ( 7.5 GB)
94 | - barbershop_LFSphere_e110cm_d100cm.tar ( 43MB)
95 | - barbershop_LFCuboid_8panos.tar ( 172MB)
96 | - Garden
97 | - garden_LFCuboid_2x2x1.tar (25 GB)
98 | - garden_LFSphere_e100cm_d170cm.tar ( 8.7 GB)
99 | - garden_LFSphere_e100cm_d50cm.tar ( 51MB)
100 | - garden_LFCuboid_8panos.tar ( 86MB)
101 | - Lone Monk
102 | - lone_monk_LFCuboid_4mx4mx3m.tar (24 GB)
103 | - lone_monk_LFSphere_e220cm_d400cm.tar ( 6.8 GB)
104 | - lone_monk_LFSphere_e160cm_d220cm.tar ( 500MB)
105 | - lone_monk_LFCuboid_8panos.tar ( 159MB)
106 | ```
107 |
108 | Find the sha256 checksums [here](./sha256sums.txt).
109 | The letters `e` and `d` in the filenames are for 'elevation' and 'diameter'.
110 |
111 | **Update 2022-09-07**: Reuploaded `garden_LFCuboid_2x2x1.tar` after fixing issue #3.
112 | **Update 2022-09-07**: Reuploaded `garden_mmsys2022.blend` after fixing issue #4.
113 |
114 | ## Tools
115 |
116 | ### Lens Reproject
117 | As the images are rendered using equisolid fish-eye lenses, we also supply a
118 | tool (written in C++) to generate reprojected images with other lens types, as
119 | most established light field research assumes rectilinear lenses.
120 |
121 | **Project page:** [github.com/IDLabMEDIA/image-lens-reproject](https://github.com/IDLabMEDIA/image-lens-reproject)
122 |
123 | ### NeRF configuration generator
124 | We provide a Python script
125 | [`generate_NERF_transforms.py`](https://github.com/IDLabMEDIA/large-lightfield-dataset/blob/main/generate_NERF_transforms.py)
126 | that produces the required NeRF configuration to test our scenes in NeRF using
127 | [instant-ngp](https://github.com/NVlabs/instant-ngp).
128 |
129 | **Script source:** [github.com/IDLabMEDIA/large-lightfield-dataset/generate_NERF_transforms.py](https://github.com/IDLabMEDIA/large-lightfield-dataset/blob/main/generate_NERF_transforms.py)
130 |
131 | Example on the spherical rendering configuration of _barbershop_, _lone monk_
132 | and _garden_, after reprojecting it using the `lens-reproject` tool (as
133 | instant-ngp only support rectilinear images):
134 |
135 |