Necessary and sufficient second-order optimality conditions on Hadamard manifolds

mathematics Article Necessary and Sufficient Second-Order Optimality Conditions on Hadamard Manifolds Gabriel Ruiz-Garzón 1,*,† , Jaime Ruiz-Zapatero 2,† , Rafaela Osuna-Gómez 3,† and Antonio Rufián-Lizana 3,† 1Instituto de Desarrollo Social y Sostenible (INDESS), Universidad de Cádiz,11003 Cádiz , Spain 2Department of Physics and Astronomy, University College London, London WC1E 6BT, UK; [email protected] 3Departamento de Estadística e I.O., Universidad de Sevilla, 41004 Sevilla, Spain; [email protected] (R.O.-G.); [email protected] (A.R.-L.) *Correspondence: gabriel.r[email protected] † These authors contributed equally to this work. Received: 12 June 2020; Accepted: 13 July 2020; Published: 14 July 2020   Abstract: This work is intended to lead a study of necessary and sufficient optimality conditions for scalar optimization problems on Hadamard manifolds. In the context of this geometry, we obtain and present new function types characterized by the property of having all their second-order stationary points be global minimums. In order to do so, we extend the concept convexity in Euclidean space to a more general notion of invexity on Hadamard manifolds. This is done employing notions of second-order directional derivatives, second-order pseudoinvexity functions, and the second-order Karush–Kuhn–Tucker-pseudoinvexity problem. Thus, we prove that every second-order stationary point is a global minimum if and only if the problem is either second-order pseudoinvex or second-order KKT-pseudoinvex depending on whether the problem regards unconstrained or constrained scalar optimization, respectively. This result has not been presented in the literature before. Finally, examples of these new characterizations are provided in the context of “Higgs Boson like” potentials, among others. Keywords: Hadamard manifold; second-order optimality conditions; generalized convexity 1. Introduction This article concerns itself with several questions, the first of which is why we study the optimality conditions of scalar mathematical programming problems. Optimality conditions are a crucial asset to solve optimization problems, which constitute some of the most ubiquitous types of problems across many scientific disciplines. Furthermore, optimality conditions and their associated optimal points play a vital role in activities as interdisciplinary as finding the best-fit parameters of a model given a set of data. In computational biology, the RNA sequence alignment problem or the evolution of median molecules has been investigated as a single-objective optimization [1]. The second and most important of these questions is the generalization and use of the notion of convexity beyond standard Euclidean geometries. Convexity conditions and their different extensions are best understood by looking at the properties they bring to an optimization problem. Hence, ensuring convexity conditions in an optimization problem guarantees that every found local optimum is indeed a global optimum. Other functions such as pseudoconvexity ensure us that every critical point is also an optimum. However, this later property does not fully characterize pseudoconvex functions as it is also shared with other types of functions. For example, the invex functions, first described by Hanson [ 2 ], are defined as any function where critical and optimal points coincide. Mathematics 2020,8, 1152; doi:10.3390/math8071152 www.mdpi.com/journal/mathematics Mathematics 2020,8, 1152 2 of 12 The equivalence between critical and optimal points makes it possible to design practical numerical methods or algorithms to find solutions to problems that satisfy this condition. Accompanying this, replacing the x - y vector in the definition of the convex function by a certain function or kernel η(x , y) makes the invex definition concept much more flexible and applicable to other fields, such as fuzzy or interval-valued environments [3,4]. In scalar mathematical programming problems with constraints, the invexity of the objective function is not sufficient to guarantee that a Karush–Kuhn–Tucker stationary point is an optimum. Thus, it is also necessary to impose conditions on the constraints of the problem. Following these ideas, Martin [ 5 ] first defined the KT-invex function. It is also well known that the first-order KKT necessary conditions only provide us with possible candidate solutions, the KKT stationary points, while the second-order necessary conditions discard some of these points to find the optimum. The importance of these second-order conditions must be stressed since optimums cannot be found making exclusive use of the first-order classical optimality conditions. An example of this is illustrated in Ginchev and Ivanov [6]. Until recently, studies have mainly explored these problems on standard Euclidean geometry. However, efforts have shifted towards developing a good understanding of them on different varieties of Riemannian manifolds such as the Hadamard manifolds considered in our study. While the Euclidean space is a linear flat space, Riemannian manifolds are non-linear curved surfaces. In convex optimization, the convexity of a set in a linear space is linked to the possibility of connecting two points of the space through segments of straight lines. Since the role of the straight lines in Euclidean space is carried out by geodesics on manifolds, translating a problem to a non-Euclidean setup partially amounts to replacing the linear segments by geodesic arcs. Studying optimization problems on Hadamard manifolds poses great advantages since generally, solving nonconvex constrained problems on Rn with a Euclidean metric can be rephrased as solving the unconstrained convex minimization problem on a Hadamard manifold feasible set with an appropriate metric [7]. In this way, we can take advantage of the convexity of the geometry. Besides the field of mathematics, Hadamard manifolds have attracted a substantial amount of interest. For example, in medicine, Hadamard manifolds are used in medical imaging analysis to quantify tumour growth and consequently infer disease progression. Furthermore, problems related to stereo vision processing [ 8 ] or the study of machine learning or computer vision cannot be solved in classical spaces and requires the help of Hadamard manifolds for their modelling [9]. In recent times, several authors have studied these topics. The invexity on Riemannian manifolds and its relationship with the monotonicity were studied by Barani and Pouryayevali [ 10 ], and the Mond–Weir dual problems for the optimization problems under invexity assumptions were also obtained on Hadamard manifolds by Zhou and Huang [ 11 ]. More closely related to our study, Ginchev and Ivanov [ 6 ] obtain second-order optimality conditions of the KKT type for a problem with inequality constraints using pseudoconvex functions and Euclidean spaces. In [ 12 ], the author utilized second-order Fréchet differentiable functions in Rn , and he defined the second-order KT-pseudoconvexity to prove that each KT point of second-order is a global minimum. Two years later, the same author, in [ 13 ], extended some of these results to invex functions, but always in Euclidean spaces. In Ruiz-Garzón et al. [ 14 ], we obtained first-order optimality conditions for the scalar and vector optimization problem on Riemannian manifolds, but not second-order conditions; this will be discussed in this article. Later, in [ 15 ], the authors proved the non-smooth version of the previous conditions. Furthermore, in Ruiz-Garzón et al. [ 16 ], we proved the existence of optimality conditions from KKT to constrained vector optimization problems on Hadamard manifolds as a particular case of equilibrium vector problems with constraints. Motivated by Ivanov’s work mentioned previously, the objective of this paper will focus on extending the second-order optimality conditions obtained in Euclidean spaces to geometries beyond Rn ; in particular, to Hadamard manifolds. Thus, we extend the concept of KT-invexity to Hadamard Mathematics 2020,8, 1152 3 of 12 manifolds. Therefore, we present necessary and sufficient optimality conditions for both unconstrained and constrained scalar optimization problems on Hadamard manifolds, looking for the function types for which the second-order critical points and the global minimum points coincide. Next, we will give the different sections of this article. In Section 2, we recall concepts related to Hadamard manifolds, and we define the second-order directional derivative function on Hadamard manifolds. In Section 3, we prove that second-order invexity and second-order pseudoinvexity functions coincide and are characterized by the fact that all second-order critical points are equivalent to optimums for unconstrained optimization problem. In Section 4, we extend the previous results to a constrained optimization problem by defining new concepts such as the second-order KKT stationary point and second-order KKT-pseudoinvex problem to characterize the global optimums of these problems on Hadamard spaces. We will end with some conclusions and references. 2. Preliminaries Let M be an n -dimensional differential manifold. We denote by TxM the n -dimensional tangent space of M at x , which is a real vector space of the same dimension as M . The collection of all tangent spaces of Mis denoted by TM =Sx∈MTxM, and it is the tangent bundle of M. Given a piecewise C1 curve α:[a , b]→M , we denote its norm by k . kx and its corresponding length as L(α) = Rb akα0(t)kα(t)dt . For any two points x , y∈M , the distance d between the points can be defined as d(x,y) = inf{L(α)|αis a piecewise C1curve joining xand y}. Furthermore, any curve α joining x and y in M such that L(α) = d(x , y) constitutes a geodesic. We will assume that the manifold is complete; in other words, that any two points x and y can be connected with a geodesic whose length is d(x,y). For differentiable manifolds, it is broadly possible to define the derivatives of the curves on the manifold. The derivative at a point x on the manifold lies in a vector space TxM . We define the Riemannian exponential map exp : ¯ TM →M as expx(v) = αv( 1 ) for every v∈¯ TM , where αv is the geodesic starting at x with velocity v (i.e., α( 0 ) = x , α0( 0 ) = v ), and ¯ TM is an open neighbourhood of TM. Moreover, expxtv =αv(t,x)for each real number t. With the goal of generalizing the concept of the convex set to Hadamard manifolds, in [ 17 ], the author proposed the following definition: Definition 1. We will say that a subset S1 of M is totally convex if S1 contains every geodesic αx,y of M whose endpoints x and y belong to S1. It is well known that a simply connected complete Riemannian manifold of non-positive sectional curvature is called a Hadamard manifold. There, the geodesic between any two points is unique. In addition to this, the exponential map at each point of the manifold, M , is a global diffeomorphism. Moreover, this exp map is defined on the whole tangent space and exp−1 x:M→TxM. Example 1. The space of symmetric n×n positive-definite matrices S(n , R) endowed with the Frobenius metric defined by <U,V>=tr(U,V)is an example of a Hadamard manifold. Let η:M×M→TM be a function defined on the product manifold such that η(x , y)∈ TyM,∀x,y∈M. Now, to achieve the objectives of this article, we will need an adequate concept of the differential and second-order differential on Hadamard manifolds: Definition 2. Let M be a Hadamard manifold. We define the differential of the function θ:M→R at the point ¯ x along the direction η(x , ¯ x) as dθ¯ x(η(x , ¯ x)) = hgrad θ¯ x , η(x , ¯ x)i for all η(x , ¯ x) in T¯ xM where grad θ¯ x is the gradient of function θat ¯ x. Mathematics 2020,8, 1152 4 of 12 Remark 1. The differential of θ at ¯ x of η(x , ¯ x) is similar to the definition of the directional derivative in the Euclidean space. If we wish to study the second-order optimality conditions, we need to take a step forward. Thus, we propose the following definition of the second-order directional derivative on Hadamard manifolds: Definition 3. Let M be a Hadamard manifold. A mapping θ:M→R is said to be a second-order directional derivative function at the point ¯ x along the direction ξ(x,¯ x)∈T¯ xM if and only if the limit: θ00(¯ x;ξ(x,¯ x)) = lim t→0+2t−2[θ(exp ¯ x(tξ(x,¯ x))) −θ(¯ x)−tdθ¯ x(ξ(x,¯ x))] exists and it is finite. The function θis called second-order directionally differentiable on M if the second-order directional derivative function exists for each point of M and any direction ξ(x,¯ x)∈T¯ xM. 3. Applications to Scalar Optimization Problems In this section, we will characterize the functions whose critical points are global optimums living on Hadamard’s spaces in the context of scalar optimization problems. 3.1. Unconstrained Case We start by considering the unconstrained scalar optimization problem (SOP): (SOP) min θ(x) subject to x∈M where Mis a Hadamard manifold and θ:M→Ris a differentiable function. Let us now introduce the notion of the invexity of a function on Hadamard manifolds, guided by the concept of convexity on linear spaces: Definition 4. Let M be a Hadamard manifold. A differentiable function θ:M→R is said to be an invex (IX) at ¯ x∈M if there exists η(x,¯ x)∈T¯ xM such that: θ(x)−θ(¯ x)≥dθ¯ x(η(x,¯ x)),∀x∈M. Remark 2. Note that if M=Rn , we have the classic and well-known invexity definition given by Hanson [ 2 ]. Thus, the previously defined inverse exponential map simplifies to the familiar form exp−1 xy=y−x. Once having introduced the concept of invexity, we can know discuss the existence of critical points. For this purpose, we will adopt the definition given by Ruiz-Garzón et al. [14]: Definition 5. Let M be a Hadamard manifold. Suppose that the function θ:M→R is differentiable at any x∈M . A feasible point ¯ x for SOP is said to be a critical point (CP) if there exists some η(x , ¯ x)∈TxM non-identically zero such that dθ¯ x(η(x,¯ x)) = 0. Theorem 1. [ 14 ] Let M be a Hadamard manifold. Suppose that the function θ:M→R is differentiable at any x ∈M. A function is invex on M if and only if every critical point is a global minimum. IX ⇔[CP ⇔global minimum SOP] Remark 3. This result is a generalization to Riemannian manifolds, a similar result to the one achieved by Craven and Glover [ 18 ]. Obviously, if a function has no critical points, so it has no global minimums, then it is invex. Mathematics 2020,8, 1152 5 of 12 Given these definitions, we are in a position in which we can tackle one of the objectives of our work. Thus, we will now propose a generalization of the concept of the two-invexity given by Ivanov [ 13 ] for Fréchet differentiable functions in dimensional finite Euclidean space Rn to Hadamard manifolds M. Definition 6. Let M be a Hadamard manifold. A differentiable and the second-order directionally differentiable θ:M→R function are said to be a two-invex (2-IX) at ¯ x∈M if there exist η(x , ¯ x) , ξ(x , ¯ x)∈T¯ xM such that the derivative θ00(¯ x,ξ(x,¯ x)) exists and: θ(x)−θ(¯ x)≥dθ¯ x(η(x,¯ x)) + θ00(x,ξ(x,¯ x)),∀x∈M. Remark 4. Note that each convex or invex function is also a two-invex function. This implies that the class of two-invex functions extends the class of invex ones. Example 2. Let M={x∈R:x> 0 } be endowed with the Riemannian metric G(x) = x−2 . Let α: [ 0, 1 ]→M be a geodesic defined as α(t) = xe(v/x)t , where v is a unit vector. Let expx(tv) = xe(v/x)t and exp−1 ¯ xx=¯ xln(x/¯ x) be the Riemannian exponential and its inverse map. Let θ:M→R be a function defined as θ(x) = (x− 1 )2 . This function is a two-invex (2-IX) function at ¯ x∈M because there exist a η(x , ¯ x) = ξ(x , ¯ x) = exp−1 ¯ xx∈T¯ xM such that the derivative θ00(¯ x , ξ(x , ¯ x)) exists and θ(x)−θ(¯ x)≥ dθ¯ x(η(x,¯ x)) + θ00(x,ξ(x,¯ x)),∀x∈M. Moreover, θis a convex function, and therefore, it is two-invex. Furthermore, we can similarly extend the concept of the stationary point: Definition 7. Let M be a Hadamard manifold. Suppose that the function θ:M→R is differentiable and second-order directionally differentiable at any ¯ x∈M and along every direction. A feasible point ¯ x for SOP is said to be a two-critical point (2-CP), if there exists some η(x , ¯ x)∈TxM non-identically zero such that dθ¯ x(η(x , ¯ x)) = 0, and if for some direction ξ(x , ¯ x)∈TxM , there exists the derivative θ00(¯ x , ξ(x , ¯ x)) , then θ00(¯ x,ξ(x,¯ x)) ≥0. Thus, we can propose and prove the following theorem that characterizes the concept of two-invex functions on Hadamard manifolds: Theorem 2. Let M be a Hadamard manifold. Let θ:M→R be a differentiable and second-order directionally differentiable function at any ¯ x∈M along any direction. The function θ is two-invex at every ¯ x∈M if and only if each 2-CP is a global minimum of θon M. Proof. We will argue this proof using reductio ad absurdum. Let us begin by making the hypothesis that θ is two-invex at every ¯ x∈M and ¯ x is a 2-CP, but it is not a global minimum. Therefore, there exists a point x∈Msuch that θ(x)<θ(¯ x). Thus, it follows that dθ¯ x(η(x,¯ x)) = 0. Moreover, θ00(¯ x,ξ(x,¯ x)) ≥0 (1) for some ξ(x,¯ x)) ∈TxMsuch that θ00(¯ x,ξ(x,¯ x)) exists. By the two-invexity of θ , there exist a µ(x , ¯ x)∈TxM and a ξ(x , ¯ x)∈TxM such that θ00(¯ x , ξ(x , ¯ x)) exists and: 0>θ(x)−θ(¯ x)≥dθ¯ x(η(x,¯ x)) + θ00(¯ x,ξ(x,¯ x)) = θ00(¯ x,ξ(x,¯ x)) which is a contradiction with (1). Now, we will prove the sufficient condition. Suppose each 2-CP is a global minimum; we need to prove that there exist η(x,¯ x),ξ(x,¯ x)∈T¯ xMsuch that the derivative θ00(¯ x,ξ(x,¯ x)) exists and: θ(x)−θ(¯ x)≥dθ¯ x(η(x,¯ x)) + θ00(x,ξ(x,¯ x)),∀x∈M. (2) Mathematics 2020,8, 1152 6 of 12 This is ensured by defining, for example, η(x , ¯ x) = tgradθ(¯ x) where t is an arbitrary positive real and ξ(x,¯ x) = 0; then, (2) holds, and θis two-invex. Therefore, we finally find that: 2-IX ⇔[2-CP ⇔global minimum SOP] This result extends Theorem 2.6 given by Ivanov [13] for the finite-dimensional Euclidean space to the Hadamard manifold. We consider now an example of a possible application of the previous characterization in Hadamard manifolds. Example 3. Let us consider the following unconstrained scalar optimization problem: (SOP) min θ(p) = 2 √3π1/4 (1−p2 2)exp (−p2 2 2)+1 subject to p = (p1,p2)∈Ω. The objective function corresponds to the Ricker wavelet, usually referred to as the Mexican hat wavelet (see Figure 1). The Ricker wavelet is a function with many applications within the field of physics such as the modelling of seismic data. Furthermore, this wavelet can be understood as the cross-section of a Higgs–Anderson potential; a potential of great relevance in explaining the inner workings of the Higgs Boson and other modern topics of condensed matter physics. Note that the tails of the original Higgs–Anderson potential diverge to infinity, while in our example, they converge to a constant value. Figure 1. Ricker wavelet. Moreover, let us further consider the set Ω={p= (p1 , p2)∈R2:p2> 0 } . Finally, let G be the Riemannian metric tensor of our Hadamard space, here chosen to be 2 × 2 matrix defined by G(p) = (gij(p)) with g11(p) = g22(p) = 1 p2 2 ,g12(p) = g21(p) = 0. Endowing Ω with the Riemannian metric, we can define the inner product of two vectors, u and v , lived on such a space as u , v=<G(p)u , v> . Furthermore, the gradient is then defined as grad θ(p) = G(p)−1∇θ(p) . Thus, we obtain a complete Hadamard manifold H2 , representative of the upper half-plane of a hyperbolic space. Mathematics 2020,8, 1152 7 of 12 Thus, we can prove that the function θ is two-invex at ¯ p , but not invex. We can show this by considering a η(p,p) = ξ(p,p) = 3p−pand η(p,p) = (0, 1)such that: dθp(η(p,p)) =< p2 2 0, 2 √3π1/4 p2(p2 2−3)exp −p2 2 2!!!, 0 1!> dθp(η(p,p)) = p2 22 √3π1/4 p2(p2 2−3)exp −p2 2 2!. On the one hand, p= ( 0, 1.87 ) is a critical point and a global maximum. On the other hand, p= (−√3 , 0.61 ) and p= (√3 , 0.61 ) are two 2-CP and global minimums. By the previous Theorem 2, θ is a second-order invex (2-IX) function since the sets of two-stationary points (2-CP) and global minimums coincide. However, the objective function is not invex (IX) because the set of CP points does not coincide with global minimums. Therefore, from Examples (2) and (3): (IX) ⇒(2-IX) 6⇐ In generalized convexity theory, it is well known that pseudoconvex functions are a generalization of convex functions in Euclidean spaces, and they ensure us that all critical points are optimal. Now, in the same way, we will concern ourselves with extending the concept of the two-invexity function to the two-pseudoinvex function on Hadamard manifolds. Definition 8. Let M be a Hadamard manifold. Moreover, let θ:M→R be a differentiable and second-order directionally differentiable function at any ¯ x∈M and along every direction. A differentiable θ function is said to be a two-pseudoinvex (2-PIX) at ¯ x∈M if there exist η(x,¯ x),ξ(x,¯ x)∈T¯ xM such that: θ(x)−θ(¯ x)<0⇒(dθ¯ x(η(x,¯ x)) ≤0 dθ¯ x(η(x,¯ x)) = 0⇒θ00(x,ξ(x,¯ x)) <0 for all x ∈M. We will now analyse the relationship between 2-IX and 2-PIX functions. Theorem 3. Let M be a Hadamard manifold. Let θ:M→R be differentiable and second-order directionally differentiable at every ¯ x∈M and along every direction such that x∈M , θ(x)<θ(¯ x) , dθ¯ x(η(x , ¯ x)) = 0. If θ is a two-pseudoinvex function at ¯ x∈M, then θis also two-invex at ¯ x∈M. Proof. In order to prove this, let us make the following assumption. Let ¯ x , x∈M be two points such that θ(x)<θ(¯ x). (a) If dθ¯ x(η(x,¯ x)) <0, then the inequality: dθ¯ x(η(x,¯ x)) + θ00(x,ξ(x.¯ x)) <0 (3) is ensured with ξ(x,¯ x) = 0. (b) If dθ¯ x(η(x , ¯ x)) = 0, then θ00(x , ξ(x , ¯ x)) exists and Inequality (3) holds since θ is two-pseudoinvex. The inequality (3) implies the two-invexity of θ since if θ is not a two-invex function, then there exist η(x , ¯ x) , ξ(x , ¯ x)∈T¯ xM such that the derivative θ00(¯ x , ξ(x , ¯ x)) exists and θ(x)−θ(¯ x)< dθ¯ x(η(x , ¯ x)) + θ00(x , ξ(x , ¯ x)) < 0, which is incompatible with all ¯ x being a minimum. That is, the 2-PIX implies 2-IX. Mathematics 2020,8, 1152 8 of 12 We can even go one step further very easily: Theorem 4. Let M be a Hadamard manifold. Let θ:M→R be differential and second-order directionally differential at every ¯ x∈M in every direction such that x∈M , θ(x)<θ(¯ x) , dθ¯ x(η(x , ¯ x)) = 0. The function θis two-pseudoinvex at ¯ x∈M if and only if θis two-invex at ¯ x∈M. Proof. On the one hand, from Theorem 3, the two-pseudoinvexity implies the two-invexity. On the other hand, it is well known that the two-invexity implies the two-pseudoinvexity. Joining the theorems 2and 4, we get the following conclusion: Corollary 1. Let M be a Hadamard manifold. Let θ:M→R be differential and second-order directionally differential at every ¯ x∈M in every direction such that x∈M , θ(x)<θ(¯ x) , dθ¯ x(η(x , ¯ x)) = 0. The function θis two-pseudoinvex at ¯ x∈M if and only if each 2-CP is a global minimum of θon M. In summary, we have that: 2-PIX ⇔2-IX ⇔[2-CP ⇔global minimum SOP] The previous results extend the results obtained by Ivanov, Theorems 2.12 and 2.14 in [ 13 ], from an environment of convexity to a more general environment of invexity. Furthermore, we generalize these notions from Euclidean space to Hadamard manifolds. Therefore, the two-pseudoinvexity coincides with the two-invexity in the same way that the pseudoinvexity coincides with the invexity, as demonstrated by Craven and Glover in [18] on Euclidean space. 3.2. Constrained Case We consider the constrained scalar optimization problem of the form: (CSOP) min θ(x) subject to gj(x)≤0, j=1, 2, . . . , m,x∈M. where M is Hadamard manifold and θ , gj:M→R , j= 1, 2, . . . , m is a set of differentiable functions. Let us consider S1={x∈M|gj(x)≤ 0, j= 1, 2, . . . , m} , and let I(x) be the set of active constraints. The equality constraints hj(x)can be considered inequality constraints as hj(x)≤0 and −hj(x)≤0. Similarly to the unconstrained case, our aim is to find the kind of functions lived on Hadamard spaces for which the Karush–Kuhn–Tucker points and the optimums coincide. For this purpose, let us consider quasiinvex functions. These functions are a generalization of quasiconvex functions, a type of function that shares most of its properties with convex and pseudoconvex functions. However, as opposed to pseudoconvex functions, the critical points of quasiconvex functions may not be optimal. Definition 9. Let M be a Hadamard manifold. Let θ:M→R be a differentiable function. Then, θ is said to be quasiinvex at ¯ x∈M if there exist η(x,¯ x)∈T¯ xM such that θ(x)≤θ(¯ x)⇒dθ¯ x(η(x,¯ x)) ≤0. We employed the following definition of critical direction: Definition 10. Let M be a Hadamard manifold. A direction η(x , ¯ x) is called critical at the point ¯ x∈S1⊆M if: dθ¯ x(η(x,¯ x)) ≤0and dgj(¯ x)(η(x,¯ x)) ≤0∀j∈I(¯ x). In the constrained case, the concept of critical point we explored in the unconstrained case is replaced by this concept. Mathematics 2020,8, 1152 9 of 12 Definition 11. Let M be a Hadamard manifold. Suppose that the functions θ , gj:S1⊆M→R , j= 1, 2, . . . , m are differentiable and second-order directionally differentiable at any ¯ x∈S1 in every critical direction η(x , ¯ x)∈T¯ xM . A feasible point ¯ x for constrained scalar optimization problem (CSOP) is said to be a two-Karush–Kuhn–Tucker stationary point (2-KKT point), if for every critical direction η(x , ¯ x) non-identically zero, there exist non-negative multipliers λ,µ1, . . . , µmwith (λ,µ)6= (0, 0)such that: grad L ¯ x=0 (4) µjgj(¯ x) = 0, j=1, 2, . . . , m(5) λdθ¯ x(η(x,¯ x)) = 0; µjdgi(¯ x)(η(x,¯ x)) = 0, j∈I(¯ x)(6) L00(¯ x;η(x,¯ x)) = λθ00(¯ x;η(x,¯ x)) + ∑ j∈I(¯ x) µjg00 j(¯ x;η(x,¯ x)) ≥0 (7) where L =λθ +∑n j=1µjgjis the Lagrange function. Note that the last two conditions have been added to the classic KKT conditions. Now, we need to introduce some new concepts that allow us to relate stationary and optimal points in the constrained scalar optimization problem (CSOP), since the invexity of the objective function by itself does not guarantee the identification of stationary and optimal points. Thus, our intention is to extend the kind of KT-invex functions created by Martin [5] to generalized invexity on Hadamard manifolds. In order to do so, let us set the following definitions: Definition 12. Let M be a Hadamard manifold. A CSOP problem is said to be 2-KKT-pseudoinvex (2-KKT-PIX) for CSOP, if θ(x)−θ(¯ x)<0, then there exists η:M×M→TM such that for all feasible points x, ¯ x: dθ¯ x(η(x,¯ x)) ≤0 (8) dθ¯ x(η(x,¯ x)) = 0⇒θ00(¯ x,η(x,¯ x)) <0 (9) dgj(¯ x)(η(x,¯ x)) ≤0, ∀j∈I(¯ x)(10) dgj(¯ x)(η(x,¯ x)) = 0, ∀j∈I(¯ x)⇒g00 j(¯ x,η(x,¯ x)) ≤0 (11) where I(¯ x) = {j=1, . . . , m:gj(¯ x) = 0}. We now can obtain the sufficient condition for global optimality: Theorem 5. Let M be a Hadamard manifold. Suppose that the functions θ , gj:S1⊆M→R , j= 1, 2, . . . , m are differentiable and second-order directionally differentiable at any ¯ x∈S1 in every critical direction. Furthermore, assume that the CSOP is a 2-KKT pseudoinvex problem. Then, each 2-KKT point is a global minimum. Proof. Suppose by hypothesis that the CSOP is a 2-KKT pseudoinvex problem and that ¯ x∈S1 is a 2-KKT point. In order to prove that ¯ x is a global minimum, let us assume the opposite and, thus, that there is a x∈S1 with θ(x)<θ(¯ x) . Thanks to the 2-KKT-pseudoinvexity, we have that dθ¯ x(η(x , ¯ x)) ≤ 0 and dgj(¯ x)(η(x,¯ x)) ≤0, j∈I(¯ x); the direction η(x,¯ x)is critical. Since x is a 2-KKT stationary point, there exist a λ> 0 and a µj≥ 0, j∈I(¯ x) such that expressions (4)–(7) hold. Then, we conclude from grad L¯ x= 0 that: dθ¯ x(η(x , ¯ x)) = dgj(¯ x)(η(x , ¯ x)) = 0, ∀i∈I(¯ x) such that µj>0. From the 2-KKT-pseudoinvexity of CSOP, we have that θ00(¯ x ; η(x , ¯ x)) < 0 and g00 j(¯ x ; η(x , ¯ x)) ≤ 0 for all j∈I(¯ x) with µj≥ 0. Thus, on the one hand, we get L00(¯ x ; η(x , ¯ x)) < 0, and on the other, hand we get Expression (7), a contradiction.