The Conjugate of the Pointwise Maximum of Two Convex Functions Revisited

The Conjugate of the Pointwise Maximum of Two Convex Functions Revisited

The conjugate of the pointwise maximum of two convex functions revisited Radu Ioan Bot¸∗ Gert Wankay Abstract. In this paper we use the tools of the convex analysis in order to give a suitable characterization for the epigraph of the conjugate of the point- wise maximum of two proper, convex and lower semicontinuous functions in a normed space. By using this characterization we obtain, as a natural con- sequence, the formula for the biconjugate of the pointwise maximum of two functions, provided the so-called Attouch-Br´ezisregularity condition holds. Key Words. pointwise maximum, conjugate functions, Attouch-Br´ezis regularity condition AMS subject classification. 49N15, 90C25, 90C46 1 Introduction and preliminaries Let X be a nontrivial normed space and X∗ its topological dual space. By ∗ ∗ σ(X ;X) we denote the weak* topology induced by X on X , by k · kX∗ the dual norm of X∗ and by hx∗; xi the value at x 2 X of the continuous linear functional x∗ 2 X∗. For a set D ⊆ X we denote the closure and the convex hull of D by cl(D) and co(D), respectively. We also use the strong quasi relative interior of a nonempty convex set D denoted sqri(D), which contains all the elements x 2 D for which the cone generated by D − x is a closed linear subspace. Furthermore, the indicator function of a nonempty set D ⊆ X is denoted by δD. Considering now a function f : X ! R = R [ {±∞}, we denote by dom(f) = fx 2 X : f(x) < +1g its effective domain and by epi(f) = f(x; r) 2 X × R : f(x) ≤ rg its epigraph. We say that f : X ! R is proper if f(x) > −∞ for all x 2 X and dom(f) 6= ;. The (Fenchel-Moreau) conjugate function of ∗ ∗ ∗ ∗ ∗ f is f : X ! R defined by f (x ) = supx2X fhx ; xi − f(x)g. The lower semicontinuous hull of f is denoted by cl(f), while the biconjugate of f is the ∗∗ ∗∗ ∗∗ ∗∗ ∗ ∗ ∗∗ function f : X ! R defined by f (x ) = (f ) (x ). ∗Faculty of Mathematics, Chemnitz University of Technology, D-09107 Chemnitz, Ger- many, e-mail: [email protected]. yFaculty of Mathematics, Chemnitz University of Technology, D-09107 Chemnitz, Ger- many, e-mail: [email protected]. 1 Definition 1.1 Let f; g : X ! R be given. The function fg : X ! R defined by fg(x) = inf ff(y) + g(x − y): y 2 Xg is called the infimal convolution function of f and g. We say that fg is ex- act if for all x 2 X there exists some y 2 X such that fg(x) = f(y)+g(x−y). Having two proper functions f; g : X ! R, we denote by f _ g : X ! R, f _ g(x) = maxff(x); g(x)g the pointwise maximum of f and g. In this paper we rediscover first the formula for the conjugate of f _ g. This formula is a classical one in the convex analysis (see, for example, [5] and [7]), but we show how it can be obtained as a nice application of the Lagrange duality theory. Then we represent epi((f _g)∗) as the closure of the reunion of the epigraphs of the conjugates of all convex combinations λf+(1−λ)g, when λ 2 (0; 1), where ∗ ∗ ∗ the closure can be taken both in (X ; σ(X ;X)) × R and in (X ; k · kX∗ ) × R. This formulae turn out to be suitable in order to show that (f _g)∗∗ = f ∗∗ _g∗∗, provided a regularity condition is fulfilled. In this way, on the one hand, we extend and, on the other hand, we give a simpler proof of Theorem 6 in [5]. Throughout this paper we assume that f; g : X ! R are proper, convex and lower semicontinuous functions fulfilling dom(f) \ dom(g) 6= ;. For all x∗ 2 X∗ we have −(f _ g)∗(x∗) = inf fy − hx∗; xig: x2dom(f)\dom(g);y2R; f(x)−y≤0;g(x)−y≤0 Since between the convex optimization problem inf fy − hx∗; xig x2dom(f)\dom(g);y2R; f(x)−y≤0;g(x)−y≤0 and its Lagrange dual sup inf fy − hx∗; xi + λ(f(x) − y) + µ(g(x) − y)g λ≥0,µ≥0 x2dom(f)\dom(g); y2R strong duality holds, we obtain −(f _ g)∗(x∗) = max inf [λf(x) + (1 − λ)g(x) − hx∗; xi]: λ2[0;1] x2dom(f)\dom(g) Throughout the paper we write max(min) instead of sup(inf) in order to point out that the supremum(infimum) is attained. With the conventions 0f := δdom(f) and 0g := δdom(g) the conjugate of f _ g turns out to be (see also [5], [7]) (f _ g)∗(x∗) = min sup hx∗; xi − λf(x) − (1 − λ)g(x) λ2[0;1] x2X = min λf + (1 − λ)g∗(x∗): (1) λ2[0;1] 2 Obviously, (1) leads to the following formula for the epigraph of (f _ g)∗ [ epi((f _ g)∗) = epi (λf + (1 − λ)g)∗ λ2[0;1] [ ∗ [ ∗ [ ∗ = epi (λf +(1−λ)g) epi (f +δdom(g)) epi (g+δdom(f)) : (2) λ2(0;1) 2 An alternative formulation for epi((f _ g)∗) In this section we assume first that the dual space X∗ is endowed with the weak* topology σ(X∗;X) and give, by using some tools of the convex analysis, ∗ a new alternative formulation for epi((f _ g) ), in case f; g : X ! R are proper, convex and lower semicontinuous functions with dom(f) \ dom(g) 6= ;. Let us start by remarking that for all x 2 X f _ g(x) = sup (λf + (1 − λ)g) (x): λ2(0;1) As for all λ 2 (0; 1) the function x ! λf(x) + (1 − λ)g(x) is proper, convex and lower semicontinuous, it must be equal to its biconjugate and so we have (the last equality follows from the definition of the conjugate function) f _ g = sup (λf + (1 − λ)g) = λ2(0;1) ∗ sup (λf + (1 − λ)g)∗∗ = inf (λf + (1 − λ)g)∗ : (3) λ2(0;1) λ2(0;1) ∗ ∗ ∗ ∗ ∗ Proposition 2.1 The function x ! infλ2(0;1)(λf +(1−λ)g) (x ), x 2 X is proper and convex. Proof. As (λf + (1 − λ)g)∗ is proper for all λ 2 (0; 1) it follows that ∗ ∗ ∗ x ! infλ2(0;1)(λf + (1 − λ)g) (x ) cannot be identical +1. If there exists an ∗ ∗ ∗ ∗ x 2 X such that infλ2(0;1)(λf + (1 − λ)g) (x ) = −∞, then f _ g must be identical +1 and this contradicts dom(f) \ dom(g) 6= ;. The properness being proved we show next the convexity. For this we con- ∗ sider the function Φ : X × R ! R defined by (λf + (1 − λ)g)∗(x∗); if x∗ 2 X∗; λ 2 (0; 1); Φ(x∗; λ) = +1; otherwise: Since the function (x∗; λ) ! (λf +(1−λ)g)∗(x∗) = sup fhx∗; xi+λ(g(x)−f(x))−g(x)g x2dom(f)\dom(g) is convex on X∗ × (0; 1), being the pointwise supremum of a family of affine functions, it follows that Φ is also convex. By a well-known result from the convex analysis, the convexity of the infimal value function of Φ x∗ ! inf Φ(x∗; λ) = inf (λf + (1 − λ)g)∗(x∗) λ2R λ2(0;1) 3 follows immediately and this concludes the proof. By a similar argument like in the proof above one can easily see that ∗ cl ∗ ∗ inf (λf + (1 − λ)g) is also a proper function, being (X ,σ(X ;X))×R λ2(0;1) in the same time convex and lower semicontinuous. Thus, in the view of the Fenchel-Moreau theorem relation, (3) implies that ∗ ∗ (f _ g) = cl(X∗,σ(X∗;X))× inf (λf + (1 − λ)g) R λ2(0;1) or, equivalently, ∗ ∗ epi((f _ g) ) = cl(X∗,σ(X∗;X))× epi inf (λf + (1 − λ)g) : R λ2(0;1) The following proposition leads to a first formulation for epi((f _ g)∗). Proposition 2.2 Let τ be a vector topology on X∗. Then one has [ epi (λf + (1 − λ)g)∗ ⊆ epi inf (λf + (1 − λ)g)∗ λ2(0;1) λ2(0;1) 0 1 [ ∗ ⊆ cl ∗ epi (λf + (1 − λ)g) : (X ,τ)×R @ A λ2(0;1) Proof. As the first inclusion is obvious, we prove just the second one. For ∗ ∗ ∗ this we consider (x ; r) 2 epi infλ2(0;1)(λf + (1 − λ)g) , V(x ) an arbitrary ∗ ∗ open neighborhood of x in τ and " > 0. As infλ2(0;1)(λf + (1 − λ)g) ≤ r, ∗ ∗ there exists an λ" 2 (0; 1) such that (λ"f + (1 − λ")g) (x ) < r + "=2. Thus ∗ S ∗ ∗ (x ; r + "=2) 2 λ2(0;1) epi (λf + (1 − λ)g) . Since (x ; r + "=2) belongs also to V(x∗) × (r − "; r + "), it follows that the intersection of this arbitrary ∗ S ∗ neighborhood of (x ; r) with λ2(0;1) epi (λf + (1 − λ)g) is non-empty. In ∗ S ∗ conclusion (x ; r) must belong to cl ∗ epi (λf + (1 − λ)g) . (X ,τ)×R λ2(0;1) Taking into account the result in Proposition 2.2 we obtain the following formula for the epigraph of (f _ g)∗ ∗ ∗ epi((f _ g) ) = cl(X∗,σ(X∗;X))× epi inf (λf + (1 − λ)g) R λ2(0;1) 0 1 [ ∗ = cl ∗ ∗ epi (λf + (1 − λ)g) : (X ,σ(X ;X))×R @ A λ2(0;1) Next we take into consideration also the strong (norm) topology on X∗.

View Full Text

Details

  • File Type
    pdf
  • Upload Time
    -
  • Content Languages
    English
  • Upload User
    Anonymous/Not logged-in
  • File Pages
    9 Page
  • File Size
    -

Download

Channel Download Status
Express Download Enable

Copyright

We respect the copyrights and intellectual property rights of all users. All uploaded documents are either original works of the uploader or authorized works of the rightful owners.

  • Not to be reproduced or distributed without explicit permission.
  • Not used for commercial purposes outside of approved use cases.
  • Not used to infringe on the rights of the original creators.
  • If you believe any content infringes your copyright, please contact us immediately.

Support

For help with questions, suggestions, or problems, please contact us