Resource-Efficient Deep Models for Embedded Systems
Resource-Efficient Deep Models for Embedded Systems
DACH: Österreich - Deutschland - Schweiz
Disciplines
Electrical Engineering, Electronics, Information Engineering (45%); Computer Sciences (55%)
Keywords
-
Deep learning,
Embedded systems,
Resource-efficient machine learning,
Machine Learning,
Reconfigurable computing,
Hardware/software co-design
Deep representation learning is one of the main factors for the recent performance boost in many image, signal and speech processing problems. This is particularly true when having big amounts of data and almost unlimited computing resources available as demonstrated in competitions such as for example ImageNet. However, in real-world scenarios the computing infrastructure is often restricted and the computational requirements are not fulfilled. In this research project we suggest several directions for reducing the computational burden, i.e. the number of arithmetic operations, while maintaining the level of recognition performance. This enables to use deep models in mobile devices and embedded systems with limited power-consumption and computational resources.
Deep learning is one of the main ingredients for the recent performance boost in many applications such as image and speech processing. This is particularly true when having big amounts of data and almost unlimited computing resources available. However, in real-world scenarios the computing infrastructure is often restricted and the computational requirements are not fulfilled. In this research project we worked on several directions for reducing the computational burden, i.e. the number of arithmetic operations, while maintaining the level of recognition performance. This enables to use deep models in mobile devices and embedded systems with limited power-consumption and computational resources.
- Technische Universität Graz - 100%
Research Output
- 315 Citations
- 28 Publications
-
2022
Title Lung Sound Classification Using Co-Tuning and Stochastic Normalization DOI 10.1109/tbme.2022.3156293 Type Journal Article Author Nguyen T Journal IEEE Transactions on Biomedical Engineering Pages 2872-2882 Link Publication -
2021
Title Compressing and Mapping Deep Neural Networks on Edge Computing Systems DOI 10.11588/heidok.00030166 Type Other Author Schindler G Link Publication -
2021
Title Crackle Detection In Lung Sounds Using Transfer Learning And Multi-Input Convolitional Neural Networks DOI 10.48550/arxiv.2104.14921 Type Preprint Author Nguyen T -
2021
Title On Resource-Efficient Bayesian Network Classifiers and Deep Neural Networks DOI 10.1109/icpr48806.2021.9413156 Type Conference Proceeding Abstract Author Roth W Pages 10297-10304 Link Publication -
2021
Title Resource-Efficient DNNs for Keyword Spotting using Neural Architecture Search and Quantization DOI 10.1109/icpr48806.2021.9413191 Type Conference Proceeding Abstract Author Peter D Pages 9273-9279 Link Publication -
2021
Title End-to-end Keyword Spotting using Neural Architecture Search and Quantization DOI 10.48550/arxiv.2104.06666 Type Preprint Author Peter D -
2020
Title Resource-Efficient Speech Mask Estimation for Multi-Channel Speech Enhancement DOI 10.48550/arxiv.2007.11477 Type Preprint Author Pfeifenberger L -
2020
Title Differentiable TAN Structure Learning for Bayesian Network Classifiers DOI 10.48550/arxiv.2008.09566 Type Preprint Author Roth W -
2021
Title Crackle Detection In Lung Sounds Using Transfer Learning And Multi-Input Convolutional Neural Networks DOI 10.1109/embc46164.2021.9630577 Type Conference Proceeding Abstract Author Nguyen T Pages 80-83 -
2021
Title Lung Sound Classification Using Co-tuning and Stochastic Normalization DOI 10.48550/arxiv.2108.01991 Type Preprint Author Nguyen T -
2019
Title Towards Efficient Forward Propagation on Resource-Constrained Systems DOI 10.1007/978-3-030-10925-7_26 Type Book Chapter Author Schindler G Publisher Springer Nature Pages 426-442 -
2019
Title Bayesian Learning of Sum-Product Networks DOI 10.48550/arxiv.1905.10884 Type Preprint Author Trapp M -
2019
Title Parameterized Structured Pruning for Deep Neural Networks DOI 10.48550/arxiv.1906.05180 Type Preprint Author Schindler G -
2019
Title Optimisation of Overparametrized Sum-Product Networks DOI 10.48550/arxiv.1905.08196 Type Preprint Author Trapp M -
2019
Title Deep Structured Mixtures of Gaussian Processes DOI 10.48550/arxiv.1910.04536 Type Preprint Author Trapp M -
2019
Title Acoustic Scene Classification with Mismatched Devices Using CliqueNets and Mixup Data Augmentation DOI 10.21437/interspeech.2019-3002 Type Conference Proceeding Abstract Author Nguyen T Pages 2330-2334 -
2019
Title Deep Complex-valued Neural Beamformers DOI 10.1109/icassp.2019.8683517 Type Conference Proceeding Abstract Author Pfeifenberger L Pages 2902-2906 -
2018
Title Resource Efficient Deep Eigenvector Beamforming DOI 10.1109/icassp.2018.8462503 Type Conference Proceeding Abstract Author Zohrer M Pages 3354-3358 -
2018
Title Bayesian Neural Networks with Weight Sharing Using Dirichlet Processes DOI 10.1109/tpami.2018.2884905 Type Journal Article Author Roth W Journal IEEE Transactions on Pattern Analysis and Machine Intelligence Pages 246-252 -
2018
Title Heart Sound SegmentationAn Event Detection Approach Using Deep Recurrent Neural Networks DOI 10.1109/tbme.2018.2843258 Type Journal Article Author Messner E Journal IEEE Transactions on Biomedical Engineering Pages 1964-1974 -
2020
Title Resource-efficient DNNs for Keyword Spotting using Neural Architecture Search and Quantization DOI 10.48550/arxiv.2012.10138 Type Preprint Author Peter D -
2020
Title Resource-Efficient Neural Networks for Embedded Systems DOI 10.48550/arxiv.2001.03048 Type Preprint Author Roth W -
2020
Title Training Discrete-Valued Neural Networks with Sign Activations Using Weight Distributions DOI 10.1007/978-3-030-46147-8_23 Type Book Chapter Author Roth W Publisher Springer Nature Pages 382-398 -
2020
Title On Resource-Efficient Bayesian Network Classifiers and Deep Neural Networks DOI 10.48550/arxiv.2010.11773 Type Preprint Author Roth W -
2020
Title Towards Real-Time Single-Channel Singing-Voice Separation with Pruned Multi-Scaled Densenets DOI 10.1109/icassp40776.2020.9053542 Type Conference Proceeding Abstract Author Huber M Pages 806-810 -
2018
Title Hybrid generative-discriminative training of Gaussian mixture models DOI 10.1016/j.patrec.2018.06.014 Type Journal Article Author Roth W Journal Pattern Recognition Letters Pages 131-137 Link Publication -
2018
Title Learning Deep Mixtures of Gaussian Process Experts Using Sum-Product Networks DOI 10.48550/arxiv.1809.04400 Type Preprint Author Trapp M -
2018
Title Efficient and Robust Machine Learning for Real-World Systems DOI 10.48550/arxiv.1812.02240 Type Preprint Author Pernkopf F