
|
The Steepest Descent Method Using the Empirical Mode Gradient Decomposition
Abstract
The aim of the article is to study the possibility of improving gradient optimization methods. The leading approach to the chosen concept is based on the possibility of a featured description of the gradient that sets the direction of the search for a solution. A modification of the method of steepest descent of global optimization based on the Hilbert-Huang transform is proposed. The proposed solution is based on the decomposition of the gradient of the objective function into empirical modes. The main results of the work are iterative optimization methods, in which, in addition to the gradient, its empirical modes are also taken into account. New estimates of the descent step are obtained, which could not be deduced in the classical formulation of the steepest descent method. Their correctness is due to the fact that in the absence of the possibility of gradient decomposition, they are reduced to existing estimates for the steepest descent method. The theoretical significance of the results lies in the possibility of expanding the existing gradient methods by a previously not used gradient description method. The practical significance is that the proposed recommendations can help accelerate the convergence of gradient methods and improve the accuracy of their results. Using the Python language, computational experiments were carried out, as a result of which the adequacy of the proposed method and its robustness were confirmed.
Keywords
Steepest Descent Method
Gradient Descent Method
Empirical Mode Decomposition
Optimization Problem
References
|
Proceedings of the International Conference on Applied Innovations in IT
by
Anhalt University of Applied Sciences
is licensed under
CC BY-SA 4.0
·
This work is licensed under a
Creative Commons Attribution-ShareAlike 4.0 International License
All works are licensed under the Creative Commons Attribution-ShareAlike 4.0 International License (CC BY-SA 4.0), unless otherwise noted.
Published by ICAIIT in cooperation with Anhalt University of Applied Sciences.