Upscaling parameters for conjugate gradient method in unconstrained optimization

Hassan, Basim A.; Jabbar, Hawraz N.; Laylani, Yoksal A.

doi:10.47974/JIM-1615

Open Access Original Articles

Upscaling parameters for conjugate gradient method in unconstrained optimization

^*Basim A. HassanCorresponding authorbasimah@uomosul.edu.iqDepartment of MathematicsUniversity of MosulCollege of Computer Science & MathematicsMosul, Iraq0000-0003-3510-9818View full profile → , Hawraz N. Jabbarhawrazmath@uokirkuk.edu.iqDepartment of MathematicsUniversity of KirkukCollege of SciencesKirkuk, Iraq0000-0001-6867-8027View full profile → , Yoksal A. Laylaniyuksel@uokirkuk.edu.iqDepartment of MathematicsUniversity of KirkukCollege of SciencesKirkuk, Iraq0000-0003-4898-5083View full profile →

* Corresponding author · click or hover a name for details

pp. 1171–1180Vol. 26Issue 6September 2023DOI: 10.47974/JIM-1615XML

Published Online:: 13 Sep 2023
Article type:: Original Articles
Language:: EN
Article no.:: JIM-1615
Pages:: 1171–1180

Abstract

An effective iterative technique, conjugate gradient algorithm is based on the conjugate gradient parameters. By satisfying the conjugacy requirement, one may construct an effective parameters conjugate gradient using a second order Taylor series. After an analysis of the new algorithm’s convergence characteristics, we provide some numerical findings that demonstrate the robustness and effectiveness of the improved methods.

Keywords

Optimization techniques Conjugate-gradient Numerical results

Subject Classifications

90C3065K0549M37

Acknowledgements

FRH-P916H72

References

[1] W. W.Hager and H. Zhang, A Survey of Nonlinear Conjugate Gradient Methods, Pacific J. Optim., 2(1), 35-58 (2006), http://www.ybook.co.jp/online2/ojo/vol2/p35.
[2] J. C. Gilbert and J. Nocedal, Global Convergence Properties of Conjugate Gradient Methods for Optimization, SIAM J. Optim., 2(1), 21-42 (1992), http://doi:10.1137/0802003.
[3] P. Wolfe, Convergence Conditions for Ascent Methods. II:Some Corrections, SIAM Rev., 13(2), 185-188 (1971), http://doi:10.1137/1013035.
[4] P. Wolfe, Convergence Conditions for Ascent Methods, SIAM Rev., 11(2), 226-235 (1969) http://doi:10.1137/1011036.
[5] R. Fletcher, Function minimization by conjugate gradients, Comput. J., 7(2), 149-154 (1964), http:// doi:10.1093/comjnl/7.2.149.
[6] Y.H. Dai, Y. Yuan, A Nonlinear Conjugate Gradient Method with a Strong Global Convergence Property, SIAM J. Optim., 10(1), 177-182 (1999), http://doi:10.1137/S1052623497318992.
[7] J. W. Daniel, The Conjugate Gradient Method for Linear and Nonlinear Operator Equations, SIAM J. Numer. Anal., 4(1), 10-26 (1967), http://doi:10.1137/0704002.
[8] M. R. Hestenes and E. Stiefel, Methods of conjugate gradients for solving linear systems, J. Res. Natl. Bur. Stand. (1934)., 49(6), 409-501 (1952), http://doi:10.6028/jres.049.044.
[9] Y. Liu and C. Storey, Efficient generalized conjugate gradient algorithms, part 1: Theory, J. Optim. Theory Al., 69(1), 129-137 (1991), http://doi:10.1007/BF00940464.
[10] E. Polak and G. Ribiere, Note sur la convergence de méthodes de directions conjuguées, Rev. française d’informatique Rech. opérationnelle. Série rouge, 3(16), 35-43 (1969), http://doi:10.1051/m2an/196903R100351.
[11] B. T. Polyak, The conjugate gradient method in extremal problems, USSR Comput. Math. Math. Phys., 9(4), 94-112 (1969), http://doi:10.1016/0041-5553(69)90035-4.
[12] B.A. Hassan, H. O. Dahawi, A.S. Younus, A new kind of parameter conjugate gradient for unconstrained optimization, Indones. J. Electr. Eng. Comput. Sci., 17(1), 404-503 (2020), http://doi:10.11591/ijeecs.v17.i1.404-411.
[13] B.A. Hassan, Z.M. Abdullah, S.A. Hussein, A new family of conjugate gradient methods to solve unconstrained optimization problems, J. Inf. Optim. Sci., 43(4), 811-820 (2022), http://doi:10.1080/02522667.2022.2103299.
[14] B.A. Hassan, K. Muangchoo, F. Alfarag, A. H. Ibrahim, A. Bala Abubakar, An improved quasi-Newton equation on the quasi-Newton methods for unconstrained optimizations, Indones. J. Electr. Eng. Comput. Sci., 22(2), 997 (2021), http://doi:10.11591/ijeecs.v22.i2.997-1005.
[15] B.A. Hassan, Z.M. Abdullah, H.N. Jabbar, A descent extension of the Dai -Yuan conjugate gradient technique, Indones. J. Electr. Eng. Comput. Sci., 16(2), 661-700 (2019), http://doi:10.11591/ijeecs.v16.i2.661-668.
[16] J. Nocedal S.J. Wright. Quadratic Programming, in Numerical Optimization, Springer New York, 448-492. http://doi:10.1007/978-0-387-40065-5_16.
[17] R.Madani . Computational Methods for Nonlinear Programming, in Building and Solving Mathematical Programming Models in Engineering and Science, Hoboken, NJ, USA : John Wiley & Sons, Inc., 2011, 235-282. http://doi:10.1002/9780471225294.ch9.
[18] N. Andrei, Open problems in nonlinear conjugate gradient algorithms for unconstrained optimization, Bull. Malaysian Math. Sci. Soc., 34(2), 319-330 (2011).
[19] W. Gao , M. R. Farahani, The hyper-zagreb index for an infinite family of nanostar dendrimer, Journal of Discrete Mathematical Sciences and Cryptography, 20(2), 515-523 (2017), http://doi:10.1080/09720529.2016.1220088.
[20] W. Gao, L. Shi, M. R. Farahani, Szeged Related Indices of TUAC6[p,q], Journal of Discrete Mathematical Sciences and Cryptography. 20(2), 553-563 (2017), http://doi:10.1080/09720529.2016.1228312.
[21] W. Gao , M. R. Farahani, The Zagreb topological indices for a type of Benzenoid systems jagged-rectangle, Journal of Interdisciplinary Mathematics, 20(5), 1341-1348 (2017), http:// doi:10.1080/09720502.2016.1232037.
[22] W. Sajjad, M. S. Sardar, M. Cancan, S. Ediz, A. Q. Baig, On modified eccentric connectivity index of nanotube. Journal of Information and Optimization Sciences 41(4), 959-972 (May 2020), http://doi:10.1080/02522667.2020.1745380.
[23] S. Ediz,İdris Çiftçi,M.Cancan,M.R.Farahani, On k-total distance degrees and k-total Wiener polarity index. Journal of Information and Optimization Sciences. 42(7), 1469-1477 (2021). https://doi.org/10.1080/02522667.2021.1896652.
[24] F. Afzal, Shah Rukh, D. Afzal, M.R.Farahani, M.Cancan, S. Ediz. A study of non-commutative Von-Neumann regular rings. Journal of Information and Optimization Sciences. 42(7), 1425-1436 (2021) https://doi.org/10.1080/02522667.2021.1896650.
[25] M. Shoaib Sardar, M. Alaeiyan, M. R. Farahani, M. Cancan, S. Ediz. Resistance distance in some classes of rooted product graphs obtained by Laplacian generalized inverse method. Journal of Information and Optimization Sciences 42(7), 1447-1467 (2021). https://doi.org/10.1080/02522667.2021.1899210.
[26] M. Nadeem, S. Ahmad, M. K. Siddiqui, M. A. Ali, M. R. Farahani, A. J. M. Khalaf. On some applications related with algebraic structures through different well known graphs. Journal of Discrete Mathematical Sciences and Cryptography. 24(2), 451-471 (2021). https://doi.org/10.1080/09720529.2021.1885806.
[27] A. Alsinai, H.M.U. Rehman, Y. Manzoor, M. Cancan, Z. Taş, M.R. Farahani, Sharp upper bounds on forgotten and SK indices of cactus graph, Journal of Discrete Mathematical Sciences and Cryptography, 1-22 (2022). https://doi.org/10.1080/09720529.2022.2027605.

Views: 226Downloads: 82Citations: 1