Optimal Stopping, Smooth Pasting and the Dual Problem
Total Page:16
File Type:pdf, Size:1020Kb
Introduction Preliminaries Main Theorems Questions Applications Optimal Stopping, Smooth Pasting and the Dual Problem Saul Jacka and Dominic Norgilas, University of Warwick Durham LMS-EPSRC Symposium, Durham 29 July 2017 Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries Main Theorems Questions Applications The general optimal stopping problem: Given a ltered probability space (Ω; (Ft ); F; P) and an adapted gains process G nd def ess sup St = optional τ≥t E[Gτ jFt ] Recall, under very general conditions I S is the minimal supermartingale dominating G def I τt = inffs ≥ t : Ss = Gs g is optimal I for any t, S is a martingale on [t; τt ] I when Gt = g(Xt ) (1) for some (continuous-time) Markov Process X , St can be written as a function, v(Xt ). Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries Main Theorems Questions Applications Remark 1.1 Condition Gt = g(Xt ) is less restrictive than might appear. With θ being the usual shift operator, can expand statespace of X by appending adapted functionals F with the property that Ft+s = f (Fs ; (θs ◦ Xu; 0 ≤ u ≤ t)): (2) The resulting process Y def= (X ; F ) is still Markovian. If X is strong Markov and F is right-cts then Y is strong Markov. e.g if X is a BM, t s 0 Z Z Yt = (Xt ; Lt ; sup Xs ; exp(− α(Xu)du)g(Xs )ds 0≤s≤t 0 0 is a Feller process on the ltration of X . Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries Main Theorems Questions Applications 1. When is v is in the domain of the generator, L, of X ? (Surprisingly, unable to nd any general results about this.) 2. Recall that the dual problem is to nd V = inf E[sup(Gt − Mt )]; M2M0 t where M0 is the collection of uniformly integrable martingales started at 0. Is the dual of the Markovian problem a controlled Markov Process problem? 3. The smooth pasting principle is used to nd explicit solutions to optimal stopping problems essentially by pasting together a martingale (on the continuation region) and the gains process (on the stopping region) Can we say anything about smooth pasting? Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries Some useful results Main Theorems Applications h i Dene semimartingales such that G = f E sup0≤t≤T jGt j < 1g: Theorem If G 2 G then I the Snell envelope S of G, admits a right-continuous modication and is the minimal supermartingale that dominates G. I both G and S are class (D). I G and S admit unique decompositions G = N + D; S = M − A (3) where N 2 M0;loc and D is a predictable nite-variation process, M 2 M0, and A is a predictable, increasing process of integrable variation (in IV ). Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries Some useful results Main Theorems Applications Remark It is more normal to assume that the process A in the Doob-Meyer decomposition of S is started at zero. The dual problem is one reason why we do not do so here. Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries General framework Main Theorems Markovian setting Applications Recall that 1 1 Z 1 H = fspecial semimartingales N+D where sup jNt j+ jdDt j 2 L g: t 0 The main assumption in this section is the following: Assumption 3.1 is in and in 1 . G G Hloc Under Assumption 3.1, the previous theorem's conclusions hold and, in the decomposition G = N + D, D is a predictable IVloc process. Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries General framework Main Theorems Markovian setting Applications We nally arrive to the main result: Theorem 3.2 Suppose Assumption 3.1 holds. Let D− (D+) denote the decreasing (increasing) components of D. Then A << D−, and µ, dened by dAt 0 µt := − ; ≤ t ≤ T ; dDt satises 0 ≤ µt ≤ 1. Remark As is usual in semimartingale calculus, we treat a process of bounded variation and its corresponding Lebesgue-Stiltjes signed measure as synonymous. Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries General framework Main Theorems Markovian setting Applications Proof First localise G and S so they are both in H1. Recall the characterisation of a predictable IV process V : we have: b(t−s)/δc X (4) Vt − Vs = lim E[Vs+(i+1)δ − Vs+iδjFs+iδ]; δ#0 i=0 with limit being in L1 (taking a subsequence if necessary). Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries General framework Main Theorems Markovian setting Applications Now, set def ∆ = E[Av − AujFu] = E[Su − Sv jFu] ess sup (5) = E E[Gτu jFu] − σ≥v E[GσjFv ] Fu Taking σ = τu _ v in (5), we obtain ∆ ≤ E[Gτu − Gτu_v jFu] = E[Dτu − Dτu_v jFu] + + − − − − = E[(Dτu − Dτu_v ) + Dτu_v − Dτu jFu] ≤ E[Dτu_v − Dτu jFu] − − (6) ≤ E[Dv − Du jFu]: The last inequalities following since: D+ and D− are increasing; τu ≥ u; and, on the event that τu ≥ v, the term inside the penultimate expectation vanishes. Applying (4) to inequality (6) we get that 0 − − for all , giving the result ≤ At − As ≤ Dt − Ds s ≤ t Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries General framework Main Theorems Markovian setting Applications Assumption 3.4 X is a strong Markov process with quasi continuous ltration. Remark Note that if X satises the asumption then expanding the state by a right-continuous functional F of the form in Remark 1.1, (X ; F ) also satises Assumption 3.4. If X is Feller then it satises the assumption. Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries General framework Main Theorems Markovian setting Applications Finally, Assumption 3.6 1 and , i.e. supt jg(Xt )j 2 L g 2 D(L) Z t g 0 (7) g(Xt ) = g(x) + Mt + Lg(Xs )ds; ≤ t ≤ T ; x 2 E; 0 so that G is a semimartingale and the FV process in the semimartingale decomposition of G = g(X ) is absolutely continuous with respect to Lebesgue measure, and therefore predictable. Moreover, we deduce that g(X ) satises Assumption 3.1. Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries General framework Main Theorems Markovian setting Applications The result of this section is the following: Theorem Suppose X and g satisfy Assumptions 3.4 and 3.6, then v 2 D(L). R t Proof Since Dt := g(X0) + 0 Lg(Xs )ds; 0 ≤ t ≤ T , (ignoring initial values) D+ and D− are explicitly given by Z t + + Dt : = Lg(Xs ) ds; 0 Z t − − Dt : = Lg(Xs ) ds; 0 so D− is absolutely continuous with respect to Lebesgue measure. Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries General framework Main Theorems Markovian setting Applications Applying Theorem 3.2,we conclude that Z t − v(Xt ) = v(x) + Mt − µs Lg(Xs ) ds; 0 ≤ t ≤ T ; (8) 0 where µ is a non-negative Radon-Nikodym derivative with 0 ≤ µs ≤ 1. − Setting λt = µt Lg(Xt ) , all that remains is to show that λt is σ(Xt )-measurable (since then there exists β : E ! R+, such that λ = β(X )). This is fairly elementary (by the Markov property and quasi-continuity of the ltration) and thus v 2 D(L). Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries Dual problem Main Theorems Smooth pasting Applications Recall that the dual problem is to nd V = inf E[sup(Gt − Mt )]; M2M0 t and we know that the optimal M is the martingale appearing in the decomposition of V . Since v 2 D(L), this is v def R t . It follows that the dual Mt = v(Xt ) − v(X0) − 0 Lv(Xs )ds problem is Z t V (x) = inf Ex [sup(g(Xt ) − h(Xt ) − Lh(Xs )ds)] h2D(L) t 0 and a little thought shows that this is a controlled Markov process problem, with controlled MP Y h given by Y h = (X ; F h) where Z t Z s h Ft = ( Lh(Xs )ds; sup(g(Xs ) − h(Xs ) − Lh(Xu)du)): 0 s≤t 0 Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries Dual problem Main Theorems Smooth pasting Applications We assume that X is a one-dimensional regular diusion on E, a possibly innite interval.. Let s(·) denote a scale function of X . Theorem Suppose Assumption 3.6 holds, then v 2 D(L). Let Y = s(X ). If 1 s 2 C and < Y ; Y >t is absolutely continuous with respect to Lebesgue measure, then v(·) is C1. Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries Dual problem Main Theorems Smooth pasting Applications Proof Note that Y = s(X ) is a Markov process, and let G denote its martingale generator. Then v(x) = W (s(x)), where −1 (9) W (y) = sup Es−1(y)[g ◦ s (Yτ )]: τ Then, since v 2 D(L), Z t v v(Xt ) = v(x) + Mt + Lv(Xs )ds; 0 and thus Z t v −1 0 W (Yt ) = W (y) + Mt + (Lv) ◦ s (Ys )ds; ≤ t ≤ T : 0 Saul Jacka and Dominic Norgilas, University of Warwick The Compensator of the Snell Envelope Introduction Preliminaries Dual problem Main Theorems Smooth pasting Applications Therefore, W 2 D(G), i.e.