Sufficient Dimension Reduction Methodology in Forecasting
Sufficient Dimension Reduction Methodology in Forecasting
Disciplines
Mathematics (80%); Economics (20%)
Keywords
-
Sufficient,
Dimension,
Reduction,
Forecasting,
Factor,
Micro/Macroeconomics
Economists and policy makers have more data at their disposal than ever before. Extracting the most relevant information prevents reacting to idiosyncratic movements and can lead to more precise forecasts and macro/microeconomic analyses. However, how to use these data effectively is an open problem. Dynamic Factor Models are pervasive in macro-econometrics and financial econometrics for both measuring co-movement and forecasting time series. However, the data reduction in DFMs comprises of summarizing the information in large data sets with a few components that capture a large proportion of their total variability without considering the forecasting ability of the reduced data. Sufficient Dimension Reduction (SDR) is a collection of tools for reducing the dimension of multivariate data in regression problems without losing inferential information for modeling the response. SDR uses many noisy signals in the observable data to extract information about the underlying structural sources of comovement that can be used to inform the building of forecasting models. This project will extend existing and develop new SDR methodology in econometric modeling and forecasting. SDR methods and data analysis tools will be developed to identify and estimate exhaustive reductions, including nonlinear data reductions, which have been marginally investigated in the DFM context. Furthermore, SDR methods for (a) targeted PCA and (b) for large p-small T (many predictors, few observations) time series regressions based on Krylov subspaces will be developed. Envelope models for multivariate response forecasting, such as central banks` macro forecasts, will be also developed and applied. The proposed research intends to make a significant contribution to the development of statistical tools that reduce data complexity in order to understand and model the underlying relationships and structures that drive the economy and obtain more accurate forecasts.
The research supported in this project developed tools for the effective utilization of large datasets in many areas of human activity and, in particular, in Economics and Finance. The research contributed novel statistical methodology with new techniques for the analysis of high-dimensional data in the field of Econometrics, as well as in practically all other fields that produce large amounts of data. Statistical tools that reduce data complexity in order to understand and model the underlying relationships and structures in the data were developed. Sufficient reductions of a large dataset, where all relevant information is condensed and simplified and all irrelevant is discarded, are computed. An important and scientifically interesting, yet surprising, result, is that a single combination of macro-economic variables is underlying the workings of the economy. Another important result of this project was that it led to new formulations of dependence for complex multidimensional data structures. Two doctoral theses and many publications in first tier journals were supported by this project.
- Technische Universität Wien - 100%
Research Output
- 106 Citations
- 35 Publications
- 4 Datasets & models
- 3 Scientific Awards
- 2 Fundings
-
2024
Title Exact and Approximate Moment Derivation for Probabilistic Loops With Non-Polynomial Assignments DOI 10.1145/3641545 Type Journal Article Author Kofnov A Journal ACM Transactions on Modeling and Computer Simulation -
2024
Title Forecasting Near-equivalence of Linear Dimension Reduction Methods in Large Panels of Macro-variables DOI 10.1016/j.ecosta.2021.10.007 Type Journal Article Author Barbarino A Journal Econometrics and Statistics -
2023
Title Moment-based Density Elicitation with Applications in Probabilistic Loops DOI 10.48550/arxiv.2304.09094 Type Other Author Bartocci E Link Publication -
2023
Title High-Dimensional Dynamic Factor Models: A Selective Survey and Lines of Future Research DOI 10.1016/j.ecosta.2022.03.008 Type Journal Article Author Deistler M Journal Econometrics and Statistics -
2023
Title Moment-Based Loop Analysis DOI 10.34726/hss.2023.113863 Type Other Author Stankovic M Link Publication -
2023
Title Structured time-dependent inverse regression (STIR). DOI 10.1002/sim.9670 Type Journal Article Author Bura E Journal Statistics in medicine Pages 1289-1307 -
2023
Title Exact and Approximate Moment Derivation for Probabilistic Loops With Non-Polynomial Assignments DOI 10.48550/arxiv.2306.07072 Type Other Author Kofnov A Link Publication -
2022
Title Moment-Based Invariants for Probabilistic Loops with Non-polynomial Assignments DOI 10.1007/978-3-031-16336-4_1 Type Book Chapter Author Kofnov A Publisher Springer Nature Pages 3-25 -
2022
Title Distribution Estimation for Probabilistic Loops DOI 10.1007/978-3-031-16336-4_2 Type Book Chapter Author Karimi A Publisher Springer Nature Pages 26-42 -
2022
Title Mixed-type multivariate response regression with covariance estimation DOI 10.1002/sim.9383 Type Journal Article Author Ekvall K Journal Statistics in Medicine Pages 2768-2785 Link Publication -
2022
Title Targeted principal components regression DOI 10.1016/j.jmva.2022.104995 Type Journal Article Author Ekvall K Journal Journal of Multivariate Analysis Pages 104995 Link Publication -
2022
Title Fusing sufficient dimension reduction with neural networks DOI 10.1016/j.csda.2021.107390 Type Journal Article Author Kapla D Journal Computational Statistics & Data Analysis Pages 107390 Link Publication -
2017
Title Asymptotic theory for maximum likelihood estimates in reduced-rank multivariate generalised linear models DOI 10.48550/arxiv.1710.04349 Type Preprint Author Bura E -
2021
Title Sufficient reductions in regression with mixed predictors DOI 10.48550/arxiv.2110.13091 Type Preprint Author Bura E -
2018
Title On the Sensitivity of Granger Causality to Errors-In-Variables, Linear Transformations and Subsampling DOI 10.1111/jtsa.12430 Type Journal Article Author Anderson B Journal Journal of Time Series Analysis Pages 102-123 Link Publication -
2017
Title A Unified Framework for Dimension Reduction in Forecasting DOI 10.17016/feds.2017.004 Type Journal Article Author Barbarino A Journal Finance and Economics Discussion Series Link Publication -
2020
Title Assessment of Treatment Influence in Mobile Network Coverage on Board High-Speed Trains DOI 10.1109/access.2020.3021647 Type Journal Article Author Trindade O Journal IEEE Access Pages 162945-162960 Link Publication -
2020
Title Least squares and maximum likelihood estimation of sufficient reductions in regressions with matrix-valued predictors DOI 10.1007/s41060-020-00228-y Type Journal Article Author Pfeiffer R Journal International Journal of Data Science and Analytics Pages 11-26 Link Publication -
2020
Title Targeted Principal Components Regression DOI 10.48550/arxiv.2004.14009 Type Preprint Author Ekvall K -
2019
Title Singular arma systems: A structure theory DOI 10.3934/naco.2019025 Type Journal Article Author Deistler M Journal Numerical Algebra, Control and Optimization Pages 383-391 Link Publication -
2019
Title Least Squares and Maximum Likelihood Estimation of Sufficient Reductions in Regressions with Matrix Valued Predictors DOI 10.1109/dsaa.2019.00028 Type Conference Proceeding Abstract Author Pfeiffer R Pages 135-144 Link Publication -
2022
Title A state-space approach to time-varying reduced-rank regression DOI 10.1080/07474938.2022.2073743 Type Journal Article Author Brune B Journal Econometric Reviews Pages 895-917 Link Publication -
2022
Title Distribution Estimation for Probabilistic Loops DOI 10.48550/arxiv.2205.07639 Type Preprint Author Karimi A -
2022
Title Moment-based Invariants for Probabilistic Loops with Non-polynomial Assignments DOI 10.48550/arxiv.2205.02577 Type Preprint Author Kofnov A -
2022
Title Conditional variance estimator for sufficient dimension reduction DOI 10.3150/21-bej1402 Type Journal Article Author Fertl L Journal Bernoulli Link Publication -
2022
Title The ensemble conditional variance estimator for sufficient dimension reduction DOI 10.1214/22-ejs1994 Type Journal Article Author Fertl L Journal Electronic Journal of Statistics Pages 1595-1634 Link Publication -
2022
Title Sufficient reductions in regression with mixed predictors Type Journal Article Author Bura E. Journal Journal of Machine Learning Research Pages - -
2021
Title Ensemble Conditional Variance Estimator for Sufficient Dimension Reduction DOI 10.48550/arxiv.2102.13435 Type Preprint Author Fertl L -
2021
Title Convergence analysis of a collapsed Gibbs sampler for Bayesian vector autoregressions DOI 10.1214/21-ejs1800 Type Journal Article Author Ekvall K Journal Electronic Journal of Statistics Pages 691-721 Link Publication -
2021
Title Mixed-type multivariate response regression with covariance estimation DOI 10.48550/arxiv.2101.08436 Type Preprint Author Ekvall K -
2021
Title Fusing Sufficient Dimension Reduction with Neural Networks DOI 10.48550/arxiv.2104.10009 Type Preprint Author Kapla D -
2021
Title A Conversation with Dennis Cook DOI 10.1214/20-sts801 Type Journal Article Author Bura E Journal Statistical Science Link Publication -
2019
Title Convergence Analysis of a Collapsed Gibbs Sampler for Bayesian Vector Autoregressions DOI 10.48550/arxiv.1907.03170 Type Preprint Author Ekvall K -
2019
Title Vector autoregressive moving average models DOI 10.1016/bs.host.2019.01.004 Type Book Chapter Author Scherrer W Publisher Elsevier Pages 145-191 -
2018
Title Asymptotic theory for maximum likelihood estimates in reduced-rank multivariate generalized linear models DOI 10.1080/02331888.2018.1467420 Type Journal Article Author Bura E Journal Statistics Pages 1005-1024 Link Publication
-
2023
Link
Title R code implementing STIR Type Computer model/algorithm Public Access Link Link -
2022
Link
Title tvRRR R package Type Computer model/algorithm Public Access Link Link -
2021
Link
Title CVarE R package Type Computer model/algorithm Public Access Link Link -
2021
Link
Title R Code for "Least squares and maximum likelihood estimation of sufficient reductions in regressions with matrix-valued predictors" Type Computer model/algorithm Public Access Link Link
-
2022
Title Quantitative Evaluation of Systems (QEST) Best Paper Award Type Research prize Level of Recognition Continental/International -
2019
Title Research visit Type Attracted visiting staff or user to your research group Level of Recognition Continental/International -
2018
Title Co-editor of the Festschrift in Honour of R. Dennis Cook Type Appointed as the editor/advisor to a journal or book series Level of Recognition Continental/International
-
2020
Title ProbInG: Distribution Recovery for Invariant Generation of Probabilistic Programs Type Research grant (including intramural programme) Start of Funding 2020 Funder Vienna Science and Technology Fund -
2021
Title SecInt Doctoral College Type Studentship Start of Funding 2021 Funder Vienna University of Technology