Compressed Sensing Photoacoustic Tomography
Compressed Sensing Photoacoustic Tomography
Disciplines
Computer Sciences (25%); Mathematics (50%); Medical Engineering (25%)
Keywords
-
Mathematical Analysis of Computed Tomography,
Photoacoustic Imaging,
Novel Tomographic Systems,
Compressed Sensing in Inverse Problems
The development of computerized tomography (CT) has revolutionized modern medical diagnostics. In the recent years several complementary tomographic modalities have been developed including x-ray CT, magnetic resonance imaging, single photon emission CT, or photoacoustic tomography (PAT). The unifying elements of these tomographic applications are that only indirect information about the quantity of interest can be collected when scanning the patient, and that mathematical reconstruction algorithms play an essential role for creating an image of the patient. A major aim in current CT research is reducing the number of measurements while preserving high contrast and resolution. This increases the speed of data acquisition, saves system costs, and can reduce radiation exposure. In this project we address these issues for PAT by developing, analyzing, and implementing novel compressed sensing techniques. PAT is a non-invasive biomedical imaging technology that beneficially combines the high contrast of pure optical imaging with the high spatial resolution of ultrasound imaging. It is based on the generation of acoustic waves by illuminating the patient or a specimen with short optical pulses. The induced acoustic waves are measured outside of the sample, and special reconstruction algorithms are used to recover a tomographic image of the patient or specimen. Using standard measurement designs, high-quality PAT requires collecting data with high sampling rate. However, each spatial measurement requires a separate sensor and high quality detectors are often costly. The compressed sensing techniques developed in this project allow to significantly reducing the number of measurements while preserving high image quality. The basic idea in compressed sensing is collecting special non-standard measurements in the form of random combinations of individual pressure values instead of sampling the pressure point-wise. Reconstructing high-resolution PAT images from such non-standard measurements requires the development of novel efficient reconstruction algorithms. In this project we develop compressed sensing techniques for PAT that (i) can be realizable in practice, (ii) come with an efficient numerical implementation, and (iii) are based on a solid mathematical fundament. We will realize our techniques experimentally by upgrading the existing photoacoustic imaging system, and develop and analyze efficient software tools for the novel PAT systems.
In this project, we developed innovative Compressed Sensing (CS) methods for Photoacoustic Tomography (PAT). PAT is an imaging technique similar to computed tomography, but produces a different type of image by imaging light-absorbing structures such as blood vessels. The main goal of CS is to develop special measurement tools to improve image quality while reducing the amount of data to be collected. We have successfully adapted and experimentally implemented this concept for PAT. Mathematical algorithms play a central role in the reconstruction of high quality PAT images from the CS data. We have successfully developed several such algorithms, in particular those based on deep learning and artificial intelligence. These achievements have relevance and potential applications not only for CS in PAT, but also in many tomographic applications. As two examples, we mention a wavelet decomposition for CSPAT, which inspired frame decompositions for general inverse problems. Furthermore, this project developed the first deep learning based image reconstruction methods for PAT.
- Thomas Berer, Research Center for Non Destructive Testing GmbH , associated research partner
Research Output
- 1011 Citations
- 97 Publications
- 1 Patents
- 5 Scientific Awards
-
2018
Title Deep Learning Versus $\ell^{1}$ -Minimization for Compressed Sensing Photoacoustic Tomography DOI 10.1109/ultsym.2018.8579737 Type Conference Proceeding Abstract Author Antholzer S Pages 206-212 Link Publication -
2018
Title Photoacoustic image reconstruction via deep learning DOI 10.1117/12.2290676 Type Conference Proceeding Abstract Author Antholzer S Link Publication -
2018
Title Stochastic Proximal Gradient Algorithms for Multi-Source Quantitative Photoacoustic Tomography DOI 10.48550/arxiv.1801.07308 Type Preprint Author Rabanser S -
2018
Title Stochastic Proximal Gradient Algorithms for Multi-Source Quantitative Photoacoustic Tomography DOI 10.3390/e20020121 Type Journal Article Author Rabanser S Journal Entropy Pages 121 Link Publication -
2018
Title Real-time photoacoustic projection imaging using deep learning DOI 10.48550/arxiv.1801.06693 Type Preprint Author Schwab J -
2018
Title Variational regularization of the weighted conical Radon transform DOI 10.1088/1361-6420/aae9a3 Type Journal Article Author Haltmeier M Journal Inverse Problems Pages 124009 Link Publication -
2021
Title Augmented NETT regularization of inverse problems DOI 10.1088/2399-6528/ac26aa Type Journal Article Author Obmann D Journal Journal of Physics Communications Pages 105002 Link Publication -
2021
Title Photoacoustic reconstruction from photothermal measurements DOI 10.1117/12.2585358 Type Conference Proceeding Abstract Author Burgholzer P Pages 170 -
2021
Title Multidimensional Reconstruction of Internal Defects in Additively Manufactured Steel Using Photothermal Super Resolution Combined With Virtual Wave-Based Image Processing DOI 10.1109/tii.2021.3054411 Type Journal Article Author Ahmadi S Journal IEEE Transactions on Industrial Informatics Pages 7368-7378 Link Publication -
2021
Title Recovering the Initial Data of the Wave Equation from Neumann Traces DOI 10.1137/20m1362322 Type Journal Article Author Dreier F Journal SIAM Journal on Mathematical Analysis Pages 2427-2451 Link Publication -
2021
Title Multiscale Factorization of the Wave Equation with Application to Compressed Sensing Photoacoustic Tomography DOI 10.1137/20m1356154 Type Journal Article Author Zangerl G Journal SIAM Journal on Imaging Sciences Pages 558-579 Link Publication -
2020
Title Superiorized Regularization Of Inverse Problems Type Journal Article Author Gibali Journal Journal of Applied and Numerical Optimization Pages 63-70 Link Publication -
2020
Title Sparse Regularization of Inverse Problems by Operator-Adapted Frame Thresholding DOI 10.1007/978-3-030-47174-3_10 Type Book Chapter Author Frikel J Publisher Springer Nature Pages 163-178 -
2020
Title Linking information theory and thermodynamics to spatial resolution in photothermal and photoacoustic imaging DOI 10.1063/5.0023986 Type Journal Article Author Burgholzer P Journal Journal of Applied Physics Pages 171102 Link Publication -
2020
Title Deep synthesis network for regularizing inverse problems DOI 10.1088/1361-6420/abc7cd Type Journal Article Author Obmann D Journal Inverse Problems Pages 015005 Link Publication -
2019
Title Douglas-Rachford algorithm for magnetorelaxometry imaging using random and deterministic activations DOI 10.3233/jae-191106 Type Journal Article Author Haltmeier M Journal International Journal of Applied Electromagnetics and Mechanics Link Publication -
2019
Title Deep null space learning for inverse problems: convergence analysis and rates DOI 10.1088/1361-6420/aaf14a Type Journal Article Author Schwab J Journal Inverse Problems Pages 025008 Link Publication -
2019
Title Learned backprojection for sparse and limited view photoacoustic tomography DOI 10.48550/arxiv.1908.00593 Type Preprint Author Schwab J -
2019
Title Augmented NETT Regularization of Inverse Problems DOI 10.48550/arxiv.1908.03006 Type Preprint Author Obmann D -
2019
Title Deep Learning of truncated singular values for limited view photoacoustic tomography DOI 10.48550/arxiv.1901.06498 Type Preprint Author Schwab J -
2019
Title Explicit inversion formulas for the two-dimensional wave equation from Neumann traces DOI 10.48550/arxiv.1905.03460 Type Preprint Author Dreier F -
2019
Title Photoacoustic image reconstruction from full field data in heterogeneous media DOI 10.1117/12.2508541 Type Conference Proceeding Abstract Author Haltmeier M Link Publication -
2019
Title NETT regularization for compressed sensing photoacoustic tomography DOI 10.1117/12.2508486 Type Conference Proceeding Abstract Author Antholzer S Link Publication -
2019
Title Deep Learning of truncated singular values for limited view photoacoustic tomography DOI 10.1117/12.2508418 Type Conference Proceeding Abstract Author Schwab J Pages 1087836 Link Publication -
2019
Title Learned backprojection for sparse and limited view photoacoustic tomography DOI 10.1117/12.2508438 Type Conference Proceeding Abstract Author Schwab J Pages 1087837 Link Publication -
2019
Title Compressive time-of-flight 3D imaging using block-structured sensing matrices DOI 10.1088/1361-6420/aafce3 Type Journal Article Author Antholzer S Journal Inverse Problems Pages 045004 Link Publication -
2019
Title Reconstruction Algorithms for Photoacoustic Tomography in Heterogeneous Damping Media DOI 10.1007/s10851-019-00879-y Type Journal Article Author Haltmeier M Journal Journal of Mathematical Imaging and Vision Pages 1007-1021 -
2019
Title Full Field Inversion in Photoacoustic Tomography with Variable Sound Speed DOI 10.3390/app9081563 Type Journal Article Author Zangerl G Journal Applied Sciences Pages 1563 Link Publication -
2019
Title Big in Japan: Regularizing Networks for Solving Inverse Problems DOI 10.1007/s10851-019-00911-1 Type Journal Article Author Schwab J Journal Journal of Mathematical Imaging and Vision Pages 445-455 Link Publication -
2019
Title Analysis of the Block Coordinate Descent Method for Linear Ill-Posed Problems DOI 10.1137/19m1243956 Type Journal Article Author Rabanser S Journal SIAM Journal on Imaging Sciences Pages 1808-1832 Link Publication -
2019
Title Projection-Based 2.5D U-net Architecture for Fast Volumetric Segmentation DOI 10.1109/sampta45681.2019.9030861 Type Conference Proceeding Abstract Author Angermann C Pages 1-5 Link Publication -
2019
Title Sparse synthesis regularization with deep neural networks DOI 10.1109/sampta45681.2019.9030953 Type Conference Proceeding Abstract Author Obmann D Pages 1-5 Link Publication -
2019
Title Sparse regularization of inverse problems by operator-adapted frame thresholding DOI 10.48550/arxiv.1909.09364 Type Preprint Author Frikel J -
2024
Title Design, implementation, and analysis of a compressed sensing photoacoustic projection imaging system. DOI 10.1117/1.jbo.29.s1.s11529 Type Journal Article Author Haltmeier M Journal Journal of biomedical optics -
2018
Title A sparsification and reconstruction strategy for compressed sensing photoacoustic tomography DOI 10.1121/1.5042230 Type Journal Article Author Haltmeier M Journal The Journal of the Acoustical Society of America Pages 3838-3848 Link Publication -
2018
Title Deep learning for photoacoustic tomography from sparse data DOI 10.1080/17415977.2018.1518444 Type Journal Article Author Antholzer S Journal Inverse Problems in Science and Engineering Pages 987-1005 Link Publication -
2018
Title A U-Nets Cascade for Sparse View Computed Tomography DOI 10.1007/978-3-030-00129-2_11 Type Book Chapter Author Kofler A Publisher Springer Nature Pages 91-99 -
2020
Title Discretization of learned NETT regularization for solving inverse problems DOI 10.48550/arxiv.2011.03627 Type Preprint Author Antholzer S -
2020
Title Deep learning approaches for thermographic imaging DOI 10.1063/5.0020404 Type Journal Article Author Kovács P Journal Journal of Applied Physics Pages 155103 Link Publication -
2020
Title Recovering the Initial Data of the Wave Equation from Neumann Traces DOI 10.48550/arxiv.2008.11043 Type Preprint Author Dreier F -
2020
Title Laser excited super resolution thermal imaging for nondestructive inspection of internal defects DOI 10.48550/arxiv.2007.03341 Type Preprint Author Ahmadi S -
2020
Title Linking information theory and thermodynamics to spatial resolution in photothermal and photoacoustic imaging DOI 10.48550/arxiv.2008.04696 Type Preprint Author Burgholzer P -
2020
Title The conical Radon transform with vertices on triple line segments DOI 10.1088/1361-6420/abae0f Type Journal Article Author Moon S Journal Inverse Problems Pages 115005 Link Publication -
2020
Title Regularization of Inverse Problems by Filtered Diagonal Frame Decomposition DOI 10.48550/arxiv.2008.06219 Type Preprint Author Ebner A -
2020
Title Sparse Anett For Solving Inverse Problems With Deep Learning DOI 10.1109/isbiworkshops50223.2020.9153362 Type Conference Proceeding Abstract Author Obmann D Pages 1-4 Link Publication -
2020
Title Multi-Scale Factorization of the Wave Equation with Application to Compressed Sensing Photoacoustic Tomography DOI 10.48550/arxiv.2007.14747 Type Preprint Author Zangerl G -
2020
Title Superiorized regularization of inverse problems DOI 10.23952/jano.2.2020.1.04 Type Journal Article Journal Journal of Applied and Numerical Optimization Link Publication -
2020
Title Explicit Inversion Formulas for the Two-Dimensional Wave Equation from Neumann Traces DOI 10.1137/19m1260517 Type Journal Article Author Dreier F Journal SIAM Journal on Imaging Sciences Pages 589-608 Link Publication -
2020
Title Laser excited super resolution thermal imaging for nondestructive inspection of internal defects DOI 10.1038/s41598-020-77979-y Type Journal Article Author Ahmadi S Journal Scientific Reports Pages 22357 Link Publication -
2019
Title NETT regularization for compressed sensing photoacoustic tomography Type Conference Proceeding Abstract Author Johannes Schwab Conference Photons Plus Ultrasound: Imaging and Sensing 2019 Link Publication -
2019
Title Photoacoustic image reconstruction from full field data in heterogeneous media Type Conference Proceeding Abstract Author Gerhard Zangerl Conference Photons Plus Ultrasound: Imaging and Sensing 2019 Link Publication -
2019
Title Photoacoustic tomography with direction dependent data: an exact series reconstruction approach DOI 10.1088/1361-6420/ab2a30 Type Journal Article Author Zangerl G Journal Inverse Problems Pages 114005 Link Publication -
2019
Title Projection-Based 2.5D U-net Architecture for Fast Volumetric Segmentation DOI 10.48550/arxiv.1902.00347 Type Preprint Author Angermann C -
2019
Title Deep learning versus $\ell^1$-minimization for compressed sensing photoacoustic tomography DOI 10.48550/arxiv.1901.06510 Type Preprint Author Antholzer S -
2019
Title Photoacoustic image reconstruction from full field data in heterogeneous media DOI 10.48550/arxiv.1901.06503 Type Preprint Author Haltmeier M -
2019
Title Photoacoustic image reconstruction via deep learning DOI 10.48550/arxiv.1901.06506 Type Preprint Author Antholzer S -
2019
Title NETT Regularization for Compressed Sensing Photoacoustic Tomography DOI 10.48550/arxiv.1901.11158 Type Preprint Author Antholzer S -
2019
Title Sparse synthesis regularization with deep neural networks DOI 10.48550/arxiv.1902.00390 Type Preprint Author Obmann D -
2023
Title Regularization of inverse problems by filtered diagonal frame decomposition DOI 10.1016/j.acha.2022.08.005 Type Journal Article Author Ebner A Journal Applied and Computational Harmonic Analysis -
2023
Title Translation invariant diagonal frame decomposition of inverse problems and their regularization DOI 10.1088/1361-6420/accd15 Type Journal Article Author Frikel J Journal Inverse Problems -
2020
Title Breaking the resolution limit in photoacoustic imaging using non-negativity and sparsity DOI 10.1016/j.pacs.2020.100191 Type Journal Article Author Burgholzer P Journal Photoacoustics Pages 100191 Link Publication -
2020
Title Sparse aNETT for Solving Inverse Problems with Deep Learning DOI 10.48550/arxiv.2004.09565 Type Preprint Author Obmann D -
2020
Title Photoacoustic reconstruction from photothermal measurements including prior information DOI 10.1016/j.pacs.2020.100175 Type Journal Article Author Thummerer G Journal Photoacoustics Pages 100175 Link Publication -
2022
Title Photoacoustic inversion formulas using mixed data on finite time intervals* *Funding: This work has been supported by the Austrian Science Fund (FWF), Project P 30747-N32. DOI 10.1088/1361-6420/ac747b Type Journal Article Author Dreier F Journal Inverse Problems Pages 085004 Link Publication -
2022
Title Heat diffusion blurs photothermal images with increasing depth DOI 10.1063/5.0093315 Type Journal Article Author Burgholzer P Journal Journal of Applied Physics Pages 211101 Link Publication -
2022
Title Feature Reconstruction from Incomplete Tomographic Data without Detour DOI 10.3390/math10081318 Type Journal Article Author Göppel S Journal Mathematics Pages 1318 Link Publication -
2023
Title Heat diffusion blurs photothermal images with increasing depth DOI 10.48550/arxiv.2310.13943 Type Other Author Burgholzer P Link Publication -
2023
Title Breaking the Resolution limit in Photoacoustic Imaging using Positivity and Sparsity DOI 10.48550/arxiv.2310.13952 Type Preprint Author Bauer-Marschallinger J Link Publication -
2023
Title Sampling and resolution in sparse view photoacoustic tomography DOI 10.48550/arxiv.2310.09447 Type Preprint Author Haltmeier M Link Publication -
2023
Title Relaxed data-consistency for limited bandwidth photoacoustic tomography DOI 10.48550/arxiv.2310.09438 Type Preprint Author Haltmeier M Link Publication -
2023
Title Superiorized Regularization of Inverse Problems DOI 10.48550/arxiv.2310.09431 Type Preprint Author Gibali A Link Publication -
2021
Title Analysis for Full Field Photoacoustic Tomography with Variable Sound Speed DOI 10.48550/arxiv.2112.02281 Type Preprint Author Nguyen L -
2021
Title Relaxed data-consistency for limited bandwidth photoacoustic tomography DOI 10.1117/12.2615853 Type Conference Proceeding Abstract Author Obmann D Pages 1192307-1192307-3 Link Publication -
2021
Title Sampling and resolution in sparse view photoacoustic tomography DOI 10.1117/12.2615869 Type Conference Proceeding Abstract Author Haltmeier M Link Publication -
2021
Title Photoacoustic inversion formulas using mixed data on finite time intervals DOI 10.48550/arxiv.2111.02262 Type Preprint Author Dreier F -
2021
Title Discretization of Learned NETT Regularization for Solving Inverse Problems DOI 10.3390/jimaging7110239 Type Journal Article Author Antholzer S Journal Journal of Imaging Pages 239 Link Publication -
2022
Title Convergence rates for the joint solution of inverse problems with compressed sensing data DOI 10.1088/1361-6420/aca5ae Type Journal Article Author Ebner A Journal Inverse Problems Pages 015011 Link Publication -
2018
Title NETT: Solving Inverse Problems with Deep Neural Networks DOI 10.48550/arxiv.1803.00092 Type Preprint Author Li H -
2018
Title Douglas-Rachford Algorithm for Magnetorelaxometry Imaging using Random and Deterministic Activations DOI 10.48550/arxiv.1805.01605 Type Preprint Author Haltmeier M -
2018
Title Big in Japan: Regularizing networks for solving inverse problems DOI 10.48550/arxiv.1812.00965 Type Preprint Author Schwab J -
2018
Title Reconstruction algorithms for photoacoustic tomography in heterogenous damping media DOI 10.48550/arxiv.1808.06176 Type Preprint Author Nguyen L -
2018
Title Photoacoustic Tomography with Direction Dependent Data: An Exact Series Reconstruction Approach DOI 10.48550/arxiv.1812.09545 Type Preprint Author Zangerl G -
2018
Title Photoacoustic image reconstruction via deep learning Type Conference Proceeding Abstract Author Markus Haltmeier Conference Photons Plus Ultrasound: Imaging and Sensing 2018 Link Publication -
2018
Title Deep Null Space Learning for Inverse Problems: Convergence Analysis and Rates DOI 10.48550/arxiv.1806.06137 Type Preprint Author Schwab J -
2018
Title Full field inversion in photoacoustic tomography with variable sound speed DOI 10.48550/arxiv.1808.00816 Type Preprint Author Zangerl G -
2018
Title Variational regularization of the weighted conical Radon transform DOI 10.48550/arxiv.1808.01493 Type Preprint Author Haltmeier M -
2017
Title A New Sparsification and Reconstruction Strategy for Compressed Sensing Photoacoustic Tomography DOI 10.48550/arxiv.1801.00117 Type Preprint Author Haltmeier M -
2017
Title Deep Learning for Photoacoustic Tomography from Sparse Data DOI 10.48550/arxiv.1704.04587 Type Preprint Author Antholzer S -
2022
Title Analysis for Full-Field Photoacoustic Tomography with Variable Sound Speed. DOI 10.1137/21m1463409 Type Journal Article Author Nguyen L Journal SIAM journal on imaging sciences Pages 1213-1228 Link Publication -
2022
Title Feature reconstruction from incomplete tomographic data without detour DOI 10.48550/arxiv.2202.10724 Type Preprint Author Göppel S -
2022
Title Convergence rates for the joint solution of inverse problems with compressed sensing data DOI 10.48550/arxiv.2201.00338 Type Preprint Author Ebner A -
2020
Title Breaking the resolution limit for acoustic imaging using positivity and sparsity DOI 10.48465/fa.2020.0375 Type Other Author Scherleitner E Link Publication -
2020
Title Laser excited super resolution thermal imaging for nondestructive inspection of internal defects DOI 10.14279/depositonce-17998 Type Other Author Ahmadi S Link Publication -
2020
Title Unsupervised Adaptive Neural Network Regularization for Accelerated Radial Cine MRI DOI 10.48550/arxiv.2002.03820 Type Preprint Author Kofler A -
2020
Title Deep synthesis regularization of inverse problems DOI 10.48550/arxiv.2002.00155 Type Preprint Author Obmann D -
2020
Title Breaking the resolution limit in photoacoustic imaging using positivity and sparsity DOI 10.1117/12.2543515 Type Conference Proceeding Abstract Author Burgholzer P Link Publication -
2020
Title NETT: solving inverse problems with deep neural networks DOI 10.1088/1361-6420/ab6d57 Type Journal Article Author Li H Journal Inverse Problems Pages 065005 Link Publication
-
2018
Patent Id:
WO2018064397
Title HIGH RESOLUTION PHOTOACOUSTIC IMAGING IN SCATTERING MEDIA USING STRUCTURED ILLUMINATION Type Patent / Patent application patentId WO2018064397 Website Link
-
2019
Title Invited speaker for 2018 IEEE Ultrasonics Symposium (Joint Photoacoustic Session) Type Personally asked as a key note speaker to a conference Level of Recognition Continental/International -
2019
Title Invited speaker at the 2nd IMA Conference on "Inverse Problems From Theory To Application" in London Type Personally asked as a key note speaker to a conference Level of Recognition Continental/International -
2019
Title Invited as keynote speaker at the Machine Learning for Medical Image Reconstruction (MLMIR) Workshop 2019 in Shenzhen Type Personally asked as a key note speaker to a conference Level of Recognition Continental/International -
2019
Title Editorial board of the Journal Photoacoustics Type Appointed as the editor/advisor to a journal or book series Level of Recognition Continental/International -
2018
Title Associate Editor of SIAM Imaging Journal Type Appointed as the editor/advisor to a journal or book series Level of Recognition Continental/International