A Pipeline to Sample and render Multi-Task 3D Vision Datasets
Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scans
This paper introduces a pipeline to parametrically sample and render multi-task vision datasets from comprehensive 3d scans from the real world.
Changing the sampling parameters allows one to"steer"the generated datasets to emphasize specific information.
In addition to enabling interesting lines of research, we show the tooling and generated data suffice to train robust vision models.common architectures trained on a generated starter dataset reached state-of-the-art performance on multiple common vision tasks and benchmarks, despite having seen no benchmark or non-pipeline data.
Authors
Ainaz Eftekhar, Alexander Sax, Roman Bachmann, Jitendra Malik, Amir Zamir