TARU PUBLICATIONS
Journal of Interdisciplinary Mathematics cover
Open Access ·Peer-reviewed·ISSN (Online): 2169-012X·ISSN (Print): 0972-0502

Freq.: MONTHLY - Publishes the methodological and theoretical role of mathematics and mathematical applications underpinning scientific research.

Issues up to 2022 co-published with and available at:Taylor & Francis Online
submissions@tarupublications.com
Open Access Research Article

Variational Bayes analysis of the normal-gamma-exponential prior

* ,

* Corresponding author · click or hover a name for details

pp. 1–8Vol. 28Issue 1February 2025DOI: 10.47974/JIM-1766XML
Received:
05 Jun 2024
Published Online:
13 Feb 2025
Article type:
Research Article
Language:
EN
Article no.:
JIM-1766
Pages:
1–8

Abstract

The Variational Bayes (VB) method for the Normal-Gamma-Exponential (NGE) prior is derived. The relation between the VB method and the regular Gibbs sampler is shown. The factorized approximation tool is used to expand the VB method to the Mean Field Variational Bayes (MFVB) method. The predication ability and theoretical properties of this method with the NGE prior are demonstrated using simulated data and its result is compared with other methods showing that this method preforms reasonably well. 

Keywords

Subject Classifications

62N0162E2062B05

References

[1] A. Alhamzawi and G. S. Mohammad, “Statistical inference with normal-compound gamma priors in regression models,” arXiv preprint arXiv:2212.13144 (2022). [Online]. Available: https://doi.org/10.48550/arXiv.2212.13144.
[2] R. Bai and M. Ghosh, “On the Beta prime prior for scale parameters in high-dimensional Bayesian regression models,” Statistica Sinica, vol. 31, no. 2, pp. 843-865 (2021). [Online]. Available: https://doi.org/10.5705/ss.202019.0037.
[3] C. Faes, J. T. Ormerod, and M. P. Wand, “Variational Bayesian inference for parametric and nonparametric regression with missing data,” Journal of the American Statistical Association, vol. 106, no. 495, pp. 959-971 (2011). [Online]. Available: https://doi.org/10.1198/jasa.2011.tm10301.
[4] J. Fan and R. Li, “Variable selection via nonconcave penalized likelihood and its oracle properties,” Journal of the American Statistical Association, vol. 96, no. 456, pp. 1348-1360 (2001). [Online]. Available: https://doi.org/10.1198/016214501753382273.
[5] H. Jeffreys, “An invariant form for the prior probability in estimation problems,” Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences, vol. 186, no. 1007, pp. 453-461 (1946). [Online]. Available: https://doi.org/10.1098/rspa.1946.0056.
[6] R. A. Levine and G. Casella, “Implementations of the Monte Carlo EM algorithm,” Journal of Computational and Graphical Statistics, vol. 10, no. 3, pp. 422-439 (2001). [Online]. Available: https://doi.org/10.1198/106186001317115045.
[7] H. Mallick, R. Alhamzawi, E. Paul, and V. Svetnik, “The reciprocal Bayesian lasso,” Statistics in Medicine, vol. 40, no. 22, pp. 4830-4849 (2021). [Online]. Available: https://doi.org/10.1002/sim.9098.
[8] T. Park and G. Casella, “The Bayesian lasso,” Journal of the American Statistical Association, vol. 103, no. 482, pp. 681-686 (2008). [Online]. Available: https://doi.org/10.1198/016214508000000337.
[9] N. G. Polson, J. G. Scott, and J. Windle, “The Bayesian bridge,” Journal of the Royal Statistical Society: Statistical Methodology, vol. 76, no. 4, pp. 713-733 (2014). [Online]. Available: https://doi.org/10.1111/rssb.12042.
[10] S. M. Kadham, “Acute interstitial pneumonia image enhancement using fuzzy partial transforms,” Applied Geomatics, vol. 16, no. 1, pp. 35-39 (2024).
[11] Q. Song and F. Liang, “Nearly optimal Bayesian shrinkage for high-dimensional regression,” Science China Mathematics, vol. 66, no. 2, pp. 409-442 (2023). [Online]. Available: https://doi.org/10.48550/arXiv.1712.08964.
[12] R. Tibshirani, “Regression shrinkage and selection via the Lasso,” Journal of the Royal Statistical Society, Series B, vol. 58, pp. 267-288 (1996).
[13] H. Woods, H. H. Steinour, and H. R. Starke, “Effect of composition of Portland cement on heat evolved during hardening,” Industrial & Engineering Chemistry, vol. 24, no. 11, pp. 1207-1214 (1932). [Online]. Available: https://doi.org/10.1021/ie50275a002.
[14] A. M. Darweesh, R. H. Hasan and S. M. Kadham, Results of fourth-order differential superordination and subordination for univalent func­tions defined by integral operator. Mathematical Modelling of En­gineering Problems, Vol. 11, No. 2, pp. 385-392 (2024). https://doi.org/10.18280/mmep.110210
[15] H. Zou and T. Hastie, “Regularization and variable selection via the elastic net,” Journal of the Royal Statistical Society, Series B, vol. 67, pp. 301-320 (2005). [Online]. Available: https://doi.org/10.1111/j.1467-9868.2005.00503.x.
[16] W. Gao, L. Shi, and M. R. Farahani, “Szeged Related Indices of TUAC6[p, q],” J. Discrete Math. Sci. Cryptography, vol. 20, no. 2, pp. 553-563 (2017). [Online]. Available: https://doi.org/10.1080/09720529.2016.1228312.
[17] S. M. Kadham and A. N. Alkiffai, “Generalization of Fuzzy SHA-Transform with Medical Application,” Mathematical Modelling of Engineering Problems, vol. 9, no. 5, pp. 1206-1214 (2022).
[18] F. Afzal, S. Rukh, D. Afzal, M. R. Farahani, M. Cancan, and S. Ediz, “A study of non-commutative Von-Neumann regular rings,” J. Inform. Optim. Sci., vol. 42, no. 7, pp. 1425-1436 (2021). [Online]. Available: https://doi.org/10.1080/02522667.2021.1896650.
[19] M. S. Sardar, M. Alaeiyan, M. R. Farahani, M. Cancan, and S. Ediz, “Resistance distance in some classes of rooted product graphs obtained by Laplacian generalized inverse method,” J. Inform. Optim. Sci., vol. 42, no. 7, pp. 1447-1467 (2021). [Online]. Available: https://doi.org/10.1080/02522667.2021.1899210.
[20] M. Nadeem, S. Ahmad, M. K. Siddiqui, M. A. Ali, M. R. Farahani, and A. J. M. Khalaf, “On some applications related with algebraic structures through different well-known graphs,” J. Discrete Math. Sci. Cryptography, vol. 24, no. 2, pp. 451-471 (2021). [Online]. Available: https://doi.org/10.1080/09720529.2021.1885806.
[21] S. M. Kadham, “Acute interstitial pneumonia image enhancement using fuzzy partial transforms,” Applied Geomatics, vol. 16, no. 1, pp. 35–39 (May 2023), doi: https://doi.org/10.1007/s12518-023-00509-8.
[22] A.M. Darweesh, R.H. Hasan, and S.M. Kadham, “Results of Fourth-Order Differential Superordination and Subordination for Univalent Functions Defined by Integral Operator,” Mathematical Modelling and Engineering Problems, vol. 11, no. 2, pp. 385–392 (Feb. 2024), doi: https://doi.org/10.18280/mmep.110210.
[23] S. M. Kadham and A. N. Alkiffai, “Generalization of Fuzzy SHA-Transform with Medical Application,” Mathematical Modelling of Engineering Problems, vol. 9, no. 5, pp. 1378–1384 (Dec. 2022), doi: https://doi.org/10.18280/mmep.090528.

Views: 246Downloads: 6Citations: 0