Wide Synthetic Aperture Sampling
Wide Synthetic Aperture Sampling
Oliver Bimber
(ORCID: 0000-0001-9009-7827)
Matching Funds - Oberösterreich
Disciplines
Computer Sciences (100%)
Keywords
-
Computer Graphics,
Light Fields,
Image-Based Rendering,
Camera Drones
Drones are becoming increasingly popular for remote sensing of landscapes in archeology, cultural heritage, forestry, and other disciplines. They are more efficient than airplanes for capturing small areas of up to several hundred square meters. LiDAR and photogrammetry have been applied together with drones to achieve 3D reconstruction. With Airborne Optical Sectioning (AOS), we presented a radically different approach that is based on an old idea: Synthetic Aperture Imaging. Rather than to measure, compute and render 3D point clouds or triangulated 3D meshes, we apply image-based rendering for 3D visualization. In contrast to photogrammetry, AOS does not suffer from inaccurate correspondence matches and long processing times. It is cheaper than LiDAR, delivers surface color information, and has the potential to achieve high sampling resolutions. AOS samples the optical signal of wide synthetic apertures (30m-100m diameter) with unstructured video images recorded from a low-cost camera drone to support optical sectioning by image integration. The wide aperture signal results in a shallow depth of field and consequently in a strong blur of out-of-focus occluders, while images of points in focus remain clearly visible. Shifting focus computationally towards the ground allows optical slicing through dense occluder structures (such as leaves, tree branches, and coniferous trees), and discovery and inspection of concealed artifacts on the surface. The objective of this subsequent project is to extend the scientific findings made throughout the past two years in the context of a previous FWF project (Directional Superresolution through Coded Sampling and Guided Upsampling, PN27720-N15) to AOS with to goal to maximize spatial and directional resolutions as well as defocussing efficiency while minimizing depth of field and flying time for wide synthetic aperture sampling.
The project generated the following press: https://www.jku.at/en/institute-of-computer-graphics/press-events/press (Airborne Optical Sectioning
Research institution(s)
- Universität Linz - 100%
Research Output
- 278 Citations
- 33 Publications
- 3 Datasets & models
- 1 Software
- 13 Disseminations
- 1 Scientific Awards
- 1 Fundings
Publications
-
2024
Title Stereoscopic depth perception through foliage. DOI 10.1038/s41598-024-74666-0 Type Journal Article Author Kerschner R Journal Scientific reports Pages 23056 -
2021
Title Pose Error Reduction for Focus Enhancement in Thermal Synthetic Aperture Visualization DOI 10.1109/lgrs.2021.3051718 Type Journal Article Author Kurmi I Journal IEEE Geoscience and Remote Sensing Letters Pages 1-5 Link Publication -
2021
Title An Autonomous Drone for Search and Rescue in Forests using Airborne Optical Sectioning DOI 10.48550/arxiv.2105.04328 Type Preprint Author Schedl D -
2022
Title Inverse Airborne Optical Sectioning DOI 10.48550/arxiv.2207.13344 Type Preprint Author Nathan R -
2022
Title Inverse Airborne Optical Sectioning DOI 10.3390/drones6090231 Type Journal Article Author Amala Arokia Nathan R Journal Drones Pages 231 Link Publication -
2022
Title Combined person classification with airborne optical sectioning DOI 10.1038/s41598-022-07733-z Type Journal Article Author Kurmi I Journal Scientific Reports Pages 3804 Link Publication -
2021
Title Through-Foliage Tracking with Airborne Optical Sectioning DOI 10.48550/arxiv.2111.06959 Type Preprint Author Nathan R -
2021
Title Acceleration-Aware Path Planning with Waypoints DOI 10.3390/drones5040143 Type Journal Article Author Ortner R Journal Drones Pages 143 Link Publication -
2021
Title An autonomous drone for search and rescue in forests using airborne optical sectioning DOI 10.1126/scirobotics.abg1188 Type Journal Article Author Schedl D Journal Science Robotics Link Publication -
2021
Title Combined Person Classification with Airborne Optical Sectioning DOI 10.48550/arxiv.2106.10077 Type Preprint Author Kurmi I -
2018
Title The effect of plant identity and mixed feeding on the detection of seed DNA in regurgitates of carabid beetles DOI 10.1002/ece3.4536 Type Journal Article Author Sint D Journal Ecology and Evolution Pages 10834-10846 Link Publication -
2020
Title Airborne Optical Sectioning for Nesting Observation DOI 10.1038/s41598-020-63317-9 Type Journal Article Author Schedl D Journal Scientific Reports Pages 7254 Link Publication -
2020
Title Fast Automatic Visibility Optimization for Thermal Synthetic Aperture Visualization DOI 10.1109/lgrs.2020.2987471 Type Journal Article Author Kurmi I Journal IEEE Geoscience and Remote Sensing Letters Pages 836-840 Link Publication -
2020
Title Search and rescue with airborne optical sectioning DOI 10.1038/s42256-020-00261-3 Type Journal Article Author Schedl D Journal Nature Machine Intelligence Pages 783-790 Link Publication -
2022
Title Inverse Airborne Optical Sectioning DOI 10.5281/zenodo.6966118 Type Journal Article Author Indrajit Kurmi Link Publication -
2022
Title Inverse Airborne Optical Sectioning DOI 10.5281/zenodo.6966437 Type Journal Article Author Indrajit Kurmi Link Publication -
2022
Title Synthetic Aperture Sensing for Occlusion Removal with Drone Swarms DOI 10.5281/zenodo.7936352 Type Journal Article Author Amala Arokia Nathan R Link Publication -
2022
Title Synthetic Aperture Sensing for Occlusion Removal with Drone Swarms DOI 10.5281/zenodo.7472379 Type Journal Article Author Amala Arokia Nathan R Link Publication -
2022
Title Synthetic Aperture Sensing for Occlusion Removal with Drone Swarms DOI 10.5281/zenodo.7472380 Type Journal Article Author Amala Arokia Nathan R Link Publication -
2022
Title Synthetic Aperture Sensing for Occlusion Removal with Drone Swarms DOI 10.48550/arxiv.2212.14692 Type Preprint Author Nathan R -
2021
Title Through-Foliage Tracking with Airborne Optical Sectioning DOI 10.5281/zenodo.5680945 Type Journal Article Author Kurmi I Link Publication -
2021
Title Through-Foliage Tracking with Airborne Optical Sectioning DOI 10.5281/zenodo.5680949 Type Journal Article Author Kurmi I Link Publication -
2021
Title Through-Foliage Tracking with Airborne Optical Sectioning DOI 10.5281/zenodo.5680237 Type Journal Article Author Kurmi I Link Publication -
2021
Title Through-Foliage Tracking with Airborne Optical Sectioning DOI 10.5281/zenodo.5680238 Type Journal Article Author Kurmi I Link Publication -
2019
Title Thermal Airborne Optical Sectioning DOI 10.3390/rs11141668 Type Journal Article Author Kurmi I Journal Remote Sensing Pages 1668 Link Publication -
2019
Title A Statistical View on Synthetic Aperture Imaging for Occlusion Removal DOI 10.1109/jsen.2019.2922731 Type Journal Article Author Kurmi I Journal IEEE Sensors Journal Pages 9374-9383 Link Publication -
2019
Title A Statistical View on Synthetic Aperture Imaging for Occlusion Removal DOI 10.48550/arxiv.1906.06600 Type Preprint Author Kurmi I -
2023
Title Synthetic Aperture Sensing for Occlusion Removal with Drone Swarms DOI 10.21203/rs.3.rs-2427908/v1 Type Preprint Author Kurmi I -
2022
Title On the Role of Field of View for Occlusion Removal with Airborne Optical Sectioning DOI 10.48550/arxiv.2204.13371 Type Preprint Author Seits F -
2022
Title Through-Foliage Tracking with Airborne Optical Sectioning DOI 10.34133/2022/9812765 Type Journal Article Author Amala Arokia Nathan R Journal Journal of Remote Sensing Pages 1-10 Link Publication -
2022
Title Evaluation of Color Anomaly Detection in Multispectral Images for Synthetic Aperture Sensing DOI 10.3390/eng3040038 Type Journal Article Author Seits F Journal Eng Pages 541-553 Link Publication -
2019
Title Combined People Classification with Airborne Optical Sectioning Type Journal Article Author Kurmi I Journal IEEE Sensors Journal -
2020
Title Search and Rescue with Airborne Optical Sectioning DOI 10.48550/arxiv.2009.08835 Type Preprint Author Schedl D
Datasets & models
-
2021
Link
Title Combined Person Classification with AOS DOI 10.5281/zenodo.5013640 Type Database/Collection of data Public Access Link Link -
2020
Link
Title Data: Autonomous Drones for Search and Rescue in Forests DOI 10.5281/zenodo.4349220 Type Database/Collection of data Public Access Link Link -
2020
Link
Title Data: Search and Rescue with Airborne Optical Sectioning DOI 10.5281/zenodo.4024677 Type Database/Collection of data Public Access Link Link
Disseminations
-
2020
Title O. Bimber, Seeing through Forrest (invited talk), IST Austria, Klosterneuburg, Austria, 11/09/20 Type A talk or presentation -
2020
Title O. Bimber, Seeing through Forrest (seminar talk), JKU Linz, Linz, Austria, 10/27/20 Type A talk or presentation -
2019
Title O. Bimber, Light Field Reloaded (invited talk), Huawai R&D, Shenzhen, China, 02/13/19 Type A talk or presentation -
2020
Title O. Bimber, Seeing through Forrest (invited talk), TU Graz, Graz, Austria, 11/04/20 Type A talk or presentation -
2019
Title O. Bimber, Light Field Reloaded (invited talk), TU Munich, Munich, Germany, 01/17/19 Type A talk or presentation -
2020
Title O. Bimber, Light Field Reloaded (invited talk), James C. Wyant College of Optical Sciences, University of Arizona, Tucson, AZ, USA, 02/11/2020 Type A talk or presentation -
2019
Title O. Bimber, Light Field Reloaded (invited talk), Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany, 02/21/19 Type A talk or presentation -
2020
Title O. Bimber, Seeing through Forrest (invited talk), HM Munich, Munich, Germany, 12/21/20 Type A talk or presentation -
2020
Link
Title drones-magazin (Ausgabe 02/2020): Ich sehe was, was du nicht siehst Type A press release, press conference or response to a media enquiry/interview Link Link -
2021
Title O. Bimber, Seeing through Forrest (invited talk), Austian Institute of Technology, Austria, 2/16/21 Type A talk or presentation -
2019
Title O. Bimber, A 1mm Thin-Film Short-Distance Optical Sensor (invited talk), OSA Imaging and Applied Optics Congress, Munich, Germany, 06/27/2019 Type A talk or presentation -
2020
Title O. Bimber, Was autonome Drohnen können dürfen (invited talk), Kepler Salon, Linz, Austria, 02/25/20 Type A talk or presentation -
2019
Link
Title Airborne Optical Sectioning - a Presscollection Type A press release, press conference or response to a media enquiry/interview Link Link
Scientific Awards
-
2019
Title Editorial Board: IEEE Transactions on Visualization and Computer Graphics since 2019 Type Appointed as the editor/advisor to a journal or book series Level of Recognition Continental/International
Fundings
-
2020
Title State of Upper Austria and the Austrian Federal Ministry of Education, Science and Research via the LIT - Linz Institute of Technology under grant number LIT-2019-8-SEE-114 Type Research grant (including intramural programme) Start of Funding 2020 Funder Johannes Kepler University of Linz