A Service of
Leibniz-Informationszentrum econstor Wirtschaft Leibniz Information Centre Make Your Publications Visible. zbw for Economics
Todorova, Tamara
Book Part — Published Version Introduction to Dynamic Optimization: The Calculus of Variations
Suggested Citation: Todorova, Tamara (2010) : Introduction to Dynamic Optimization: The Calculus of Variations, In: Tamara Todorova, Problems Book to Accompany Mathematics for Economists, ISBN 978-0-470-59181-9, Wiley, Hoboken, pp. 702-754, http://eu.wiley.com/WileyCDA/WileyTitle/productCd-EHEP001511.html
This Version is available at: http://hdl.handle.net/10419/148412
Standard-Nutzungsbedingungen: Terms of use:
Die Dokumente auf EconStor dürfen zu eigenen wissenschaftlichen Documents in EconStor may be saved and copied for your Zwecken und zum Privatgebrauch gespeichert und kopiert werden. personal and scholarly purposes.
Sie dürfen die Dokumente nicht für öffentliche oder kommerzielle You are not to copy documents for public or commercial Zwecke vervielfältigen, öffentlich ausstellen, öffentlich zugänglich purposes, to exhibit the documents publicly, to make them machen, vertreiben oder anderweitig nutzen. publicly available on the internet, or to distribute or otherwise use the documents in public. Sofern die Verfasser die Dokumente unter Open-Content-Lizenzen (insbesondere CC-Lizenzen) zur Verfügung gestellt haben sollten, If the documents have been made available under an Open gelten abweichend von diesen Nutzungsbedingungen die in der dort Content Licence (especially Creative Commons Licences), you genannten Lizenz gewährten Nutzungsrechte. may exercise further usage rights as specified in the indicated licence. www.econstor.eu Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations
Static models aim to find values of the independent variables that maximize particular functions. Such optimization problems seek the value or values of an argument that optimize a given function at a particular point. Dynamic models aim to find not just the maximum value of some function, but rather, the actual function that provides a time path for the values of the economic variables so that some value function is maximized or minimized over a given interval of time. In dynamic optimization, we try to find a curve yt* () that will maximize or minimize a given integral. The integral, as we know, gives the area under a curve F which is a function of the independent variable t , the function yt(), dy and its derivative or yt(). Note that the independent variable t denotes time, which is why we dt speak of dynamic optimization. Therefore, if we assume a time period from to (usually zero) to t1 , the dynamic optimization problem is to maximize or minimize the integral expression
t1 IFtytytdt ,(),() to
yt()oo y yt()11 y where the function F(,tyy , ) is assumed to be continuous for tyt,(), and yt() and to be differentiable, that is, to have continuous partial derivatives with respect to y and y . Here ttyoo,,1 and y1 are given parameters. An integral that assumes a numerical value for each of the class of functions yt() is called a functional. As opposed to ordinary calculus that deals with functions, the calculus of variations is a special field of mathematics that deals with functionals. Those are generally integrals involving an unknown function and its derivatives. We refer to the integral I as a functional because it is a function of the functions yt() and yt(), but we are more interested in an extremal, the function that finds the maximum or minimum value of the functional. More specifically, an extremal is the curve that optimizes the value of the functional. In order for the class of functions yt() to be extremals, they should be continuously differentiable on the defined interval and should satisfy some fixed endpoint (boundary) conditions.
Perhaps the simplest example of such an optimization problem is to find the length of a nonlinear curve giving the shortest distance between two points on a plane. Such two points are (,tyoo ) and
(,ty11 ) where we have the function yft (). Although nonlinear, the distance between them can be approximated easily using the Pythagoras theorem. Given the diagram in Figure 1, for very small distances dt, dy and ds we have the dependence
()ds22 () dt () dy 2
ds() dt22 ( dy )
Factoring out the term dt from the right side,
2 dy ds1 dt dt 702 Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 703
ds1() y 2 dt
Summing up all the distances, we obtain the arc length of the entire curve from point to to t1 as
t1 Ay 1() y 2 dt to Furthermore, to find the shortest distance between these two points, we have to minimize the integral found.
y(t)
y1 ds dy
dt yo
to t1 t
Figure 1
Dynamic optimization studies the optimal time path of a particular function and often deals with stock-flow relationships among the variables at successive points in time. Some of the variables involved are stock concepts, also called state variables in dynamic optimization, while flow concepts are often referred to as control variables. For instance, in the context of production theory, stocks change from one period to another and their increase depends on both the stocks and flows within this interval.
With optimization over time the objective function can be expressed as the sum, difference or product of functions that are also changing over time. For example, a firm maximizing the present value of its stream of revenues would account for its total revenue but would also consider the interest rate r as the discount factor. With optimal time path the optimization problem usually begins with an initial moment to and ends at a finite moment t1 . The initial state variable yo is taken as given and, in addition, some terminal condition is specified. More specifically, for the firm trying to maximize its stream of revenues R from time to to t1 it may be that this stream depends on the own price of the product p and on the rate of change of price with respect to time p()t . Thus, the optimization problem for the firm can be written as
t1 max Rtpt,(),() pte rt dt to
subject to p()tpoo and p()tp11 where total revenue is discounted at the interest rate r and the two constraints, the initial and the terminal one, are the boundary conditions.
Euler’s Equation
The mathematical problem of finding a function that minimizes or maximizes some integral got its systematic solution by Leonhard Euler and Joseph Louis Lagrange1 who in the 1750s first introduced a general differential equation necessary to solve such problems. This lay the foundation of the
1 Leonhard Paul Euler (1707-1783) and Joseph-Louis Lagrange (1736-1813).
704 Problems Book to Accompany Mathematics for Economists calculus of variations, which seeks to find a curve, path, or surface that gives an optimum (or stationary) value for a given function.
In the 1950s, L. S. Pontryagin and his colleagues in the Soviet Union developed optimal control theory, a special branch of which is the classical calculus of variations. In parallel with Pontryagin, whose focus was on the physical sciences, a team of scholars led by Richard Bellman developed dynamic programming for the purpose primarily of economics and management science. In view of the advanced level and rigor of optimal control theory and dynamic programming, which go beyond the scope and aims of this book, we will cover only the simple techniques of the calculus of variations and take a brief glance at optimal control theory. Although the three approaches have different relevance to, and usefulness in, analytical economics, they all lead to the same solution.2
The so-called Euler’s equation gives a necessary condition for dynamic optimization. It is a differential equation for the solutions of which a given functional is stationary. In order for the curve connecting two points (,tyoo ) and (,ty11 ) to qualify as an extremal, that is, to optimize the functional
t1 IFtytytdt ,(),() to
yt()oo y yt()11 y a necessary but not a sufficient condition is that
F dF dy dt y which represents the Euler’s equation. Alternatively, the equation can be written in the form
d dF F (,tyy , ) F (, tyy , ) or simply F y yydt y dt and, given that ty, and y are all functions of t , by taking the total derivative of the right-hand side with respect to t and using the chain rule, we obtain
FyytyyyyFFyFy() () dy2 where y . The differential equation we obtain is of the second order. The exact way to solve dt 2 the Euler’s equation is illustrated best with numerical examples, which follow later in the chapter. Not every curve Ityy(, , ) connecting two points is suitable for an extremal. In order to find such a curve that optimizes a given functional subject to some fixed boundary conditions in dynamic optimization, we just follow several simple steps:
1. For the integrand F Ftyy(, , ), we take the partial derivatives of F with respect to y and
y or Fy and Fy . dF 2. We substitute these two values in the Euler’s equation F y . y dt
3. Then we take the derivative of Fy with respect to t . 4. In the absence of any derivatives such as y or y, we solve directly for y . If there are such terms, we integrate until all the derivatives disappear and again we solve for y .
2 Adapted from Leonard, Daniel and Ngo Van Long, Optimal Control Theory and Static Optimization in Economics, 5th edition, Cambridge University Press, 1992, and Silberberg, Eugene and Wing Suen, The Structure of Economics: a Mathematical Analysis, 3rd edition, McGraw-Hill, Economic Series, 2001.
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 705
This does not yet prove that we indeed have the needed maximum or minimum. In the elementary calculus of a single variable we resort to the second derivative yt() as a test for the extremum and check whether it is positive or negative which implies a minimum or a maximum for yt(), respectively. The calculus of variations is not interested in small changes of the argument t but, rather, in the integral of the function F(,tyy , ). Just as with second-order conditions in static optimization, we have second-order conditions for dynamic optimization problems that allow us to determine a maximum or a minimum, but deeper knowledge of the subject is needed. In the case of shortest distance given by the arc length Ay , the integral Ityy(, , ) is a functional and we formulate the task of the minimization problem as finding a minimum in the I -space, given the parameters y and y . Since we can always find a curve the path’s length of which is greater than some finite path length Io , the stationary point found would represent a minimum. We now prove that since the slope of the curve giving the shortest path between two points is a constant, this curve must be a straight line. For the arc length of the curve connecting the two points (,tyoo ) and (,ty11 ), we found
t1 Ay 1() y 2 dt to where the integrand is F(,tyy , ) 1 ( y )2 evaluated at tyt,(),() yt . The partial derivatives of F are
Ftyy(, , ) Ftyy(, , ) y Fy 0 and Fy y y 1() y 2 Substituting in the Euler’s equation,
F dF dy dt y
dy 0 dt 2 1() y y or Fy c must be a constant in order for its derivative with respect to t to be zero. But 1() y 2 if the parental function Fy has a constant slope of c given by its first derivative Fy , then it must be a straight line. Hence, a straight line would always give the shortest distance between two points.
1 2 Example: Given the functional 24yt 2( y ) 4 t dt subject to y(0) 1 and y(1) 3 , find yt() 0 following the conditions for dynamic optimization.
1. Since the integrand is F 24yt 2( y )2 4 t , we have
Fy 24t and Fy 4y
2. Substituting in Euler’s equation,
d 24ty (4 ) dt ddydy 2 3. Since y, we have dt dt dt 2
706 Problems Book to Accompany Mathematics for Economists
24ty 4
4. We have the second-order derivative y, and in order to drop it we integrate both sides:
24tdt 4 y dt
2 12tc1 4 y
And integrating further,
(12tcdtydt2 ) 4 1
3 44tctc12 y which gives
ct c yt3 12 44
With the help of the boundary conditions, we can definitize the constants c1 and c2 . c y(0)2 1 or c 4 4 2 c y(1) 11 1 3 or c 4 4 1
So, finally for y ,
yt() t3 t 1
The Ramsey Growth Model
Frank Ramsey3 in 1928 developed a neoclassical growth model alternative to that advanced by Solow. Neoclassical growth models generally assume that gross investment is the difference between national income and aggregate consumption. Given that gross investment is also the sum of net investment and depreciated capital, we have
IIgn KKK and
IYKCg () or net investment can be expressed as
KYKKC () where consumption, investment and capital stock are all assumed to be functions of time. If the variables are taken on a per worker basis, the equation transforms into kfkkc () which represents the fundamental differential equation of neoclassical economic growth4. Here k is the well known capital-labor ratio, f ()k is output per worker, c is consumption per worker and is the depreciation rate that can take values between 0 and 1. Net investment or the increase in capital per worker thus is the part of output saved less the depreciation in capital. Seeking an optimal time path for economic growth neoclassical growth models express utility as a function of consumption, either
3 Ramsey, Frank P., "A Mathematical Theory of Saving," Economic Journal, vol. 38, no. 152, December 1928, pp. 543–559 4 Accounting for the growth rate of the labor force the equation becomes kfk () ( ) kc .
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 707 aggregate UCt() or individual Uct() , and maximize dynamically the discounted value of this utility function. For instance, the optimization problem could be
t1 maxUCt ( ) ert dt to where the discount rate is r and utility is maximized from moment to to t1 . This allows obtaining an optimal time path for capital stock Kt() and, from there on, of consumption, labor force, investment, etc. Being familiar with the Solow growth model, we already know that in order for the economy to be in a steady state all those variables should grow at the same rate. Recall the outcome of the Solow t model that if population grows at the rate as in the exponential function Lt() Leo , investment, capital, etc. should also grow at that rate in order for the economy to be stable and not on the “razor’s edge” (as the Domar growth model predicted).
Like Solow, Ramsey studies the capital-labor ratio k and its time path. However, in addition to k, Ramsey analyzes the saving ratio s, giving the share of investment in aggregate output Y or I st() 01s Y
Unlike Solow, Ramsey assumes that the saving ratio changes with time and the convergence of the economy to its steady state is not uniform. This assumption transforms the saving rate from exogenous into endogenous and the task is to find its optimal time path. The model concludes that at the optimum the saving rate is at its golden rule level, that is, the level that maximizes the sustainable level of consumption per worker. Thus, the model is consumption oriented, rather than production oriented.5 A convenient class of utility functions consistent with the steady state of the economy is the class of Ct()1 functions known as CRRA functions6 of the type UCt() such that the marginal utility 1 of consumption is UC . Thus, the optimization problem becomes 1 tt11Ct() maxUCt ( ) ert dt e rt dt 1 ttoo Households maximize their consumption dynamically, whereby at each point in time they set their intertemporal marginal benefit of consumption equal to their marginal cost. Furthermore, they set optimal consumption at the level where it pays to substitute present consumption with future. Both decisions depend on the optimal result that obtains
Cr C by which the growth rate of consumption is the product of the intertemporal elasticity of substitution 1 between consumption in two periods and the difference of the interest rate and the intertemporal discount rate r . While the interest rate is the reward for postponing consumption and stimulates its growth, r is the cost of consuming presently and reduces consumption. A high elasticity of
5 We should also note that initially Ramsey designed the model as a central-planner’s problem of optimizing the consumption levels intertemporally, that is, over successive generations. Only later was the model developed to fit a decentralized dynamic economy. Ct()1 6 CRRA stands for constant relative risk aversion functions for which UCt() if 1 and 1 UCt() ln Ct () for 1.
708 Problems Book to Accompany Mathematics for Economists
1 substitution also stimulates the growth of consumption. Both the elasticity of substitution and the trade-off between the interest and the discount rate are mechanisms working in the direction of the substitution effect, that is, convincing the consumer that future consumption is a good substitute for current consumption.
A Cost-Minimizing Firm
A firm’s total costs depend on the level of output qt() and its rate of change with time qt() according to the function
TC aq b() q 2 ab,0
The firm wishes to minimize its costs of production where the endpoint conditions are q(0) 0 and 3a q(2) . Formulate the dynamic optimization problem and find a candidate for an extremal that 2b will minimize the firm’s costs. The optimization problem is 2 2 min aq b ( q ) dt 0 3a subject to q(0) 0 q(2) 2b
2 The functional, therefore, is Ftqt,(),() qt aqbq ( ) . We can easily find the partial derivatives Fq a and Fq 2bq . Substituting in the Euler’s equation, d abq (2 ) which transforms into dt
abq 2 or a q 2b
We can easily solve for qt() by integrating twice. This will give at qc 2b 1 and integrating once more,
at 2 qt() ct c 4b 12
To definitize the constants, we use the endpoint conditions
a(0) qcc(0) (0) 0 or c 0 4b 12 2
aa(2)2 3 a qc(2) (2) 0 or c 42bb1 1 4b
Thus, the candidate for extremal is
at2 at qt() 44bb
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 709
We now need to prove that the output level found is indeed a minimum, which requires further knowledge. As we can easily see, the output function of the firm is increasing with time.
Constrained Dynamic Optimization
So far, we have optimized unconstrained functionals. Often, though, we may have to apply the techniques of calculus of variations and optimize an integral subject to some functional constraint. Given the integral
t1 IFtytytdt ,(),() to
yt()oo y yt()11 y we may seek an extremal that maximizes or minimizes it subject to the constraint
t1 Ctyt,(),() y t dt c to where c is a constant. Problems such as this, where the constraint is an integral that is held constant, are known as isoperimetric problems. Here Ctyy(, , ) is a continuously differentiable function in the given parameters. There could as well be constrained dynamic optimization problems where the constraints are one or several equality or inequality constraints connecting the state variables, their rate of change and time. We shall deal only with integral constraints in the examples that follow. Similar to static optimization, we can apply the Lagrange multiplier method. In order to do that, we multiply the constraint by and add it to the objective function such that
t1 ()F Cdt to
A necessary, though not a sufficient, condition to have an extremal for dynamic optimization is the Euler-Lagrange equation where
Ld L and LF C ydty
Constrained optimization of functionals is often used in the calculus of variations to find a curve the perimeter of which encloses the largest area.
Example: Find the curve of a given length m that encloses a maximum area A given by the expression
1 Atyydt() 4 where the length of the curve is
t1 1()ydtm 2 to
Following the steps of dynamic optimization subject to functional constraints, we form the Lagrangian.
t1 1 2 ()1()ty y y dt m 4 to
710 Problems Book to Accompany Mathematics for Economists
1 Therefore, the integrand is Ltyy()1() y2 and 4
L 1 Ly1 t y 4 y 4 1() y 2
Substituting in the Euler-Lagrange equation,
Ld L ydty 11dy t 44dt 2 1() y 11dy 44dt 2 1() y dy 1 dt 2 2 1() y
We integrate both sides with respect to t, which gives
y 1 ()tc 1 1() y 2 2
Raising both sides of the equation to the second power and rearranging,
4()22ytcy ( )1() 2 2 1
22 22 2 4()( ytcytc11 )() ( )
()tc 2 2 1 ()y 22 4() tc1 tc y 1 22 4() tc1
2 Integrating again both sides where on the right we use integration by substitution and set utc()1 du and, therefore, 2(tc ) , we obtain dv 1 22 yc214() tc
222 ()()4tc12 yc
which is an expression for a circle and the parameters cc12, and are determined with the help of the endpoint conditions to and t1 and the constant m .
A Glimpse of Optimal Control Theory
Dynamic optimization finds application in economics when it comes to allocating scarce resources over competing purposes within a given time interval (say, between the initial moment to and the
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 711
terminal one t1 ). Optimal control theory seeks to find optimal time paths for control (flow) variables among a class of optimal time paths called a control set. The optimal time path for the control variable is chosen with the help of a set of differential equations known as the equations of motion. This optimal time path further determines a time path for the state (stock) variables describing the system. The time path of the control variable is such that it maximizes a given functional formulated in accordance with the optimization problem and set by the time paths of both the control and the state variables. Optimizing such an objective functional equivalent to an extremal in the calculus of variations gives the so-called control problem.
A simple control problem would involve time, state variables, control variables, the equations of motion, the endpoint (transversality) conditions, and the extremal (objective functional). The general form of the control problem would be
t1 max F tyt , ( ), utdt ( ) to subject to yt() ftytut , (),() with endpoint conditions yt()oo y and yt()11 y
This looks very similar to the problem of the classical calculus of variations. In fact, the calculus of variations problem can be considered a special case of the general control problem in which there is only one state variable and one control variable and the control variable is simply the rate of change of the state variable with time rather than a more general function involving the state variable or time as well. Thus, the equation of the motion (or state equation) for the calculus of variations problem is
yftyuu (, , )
To solve the general control problem, given the constraint, we have max(,,)F tyu ftyu (,,) y where is a Lagrange multiplier that takes care of the constraint given by the equation of the motion. Thus formulated, the control problem gives rise to the following Hamiltonian
HF f and optimum equations
H HFf 0 (maximum principle) uuuu H HFf or Ff 0 (costate equation) yyyy yy
The first equation sets the so-called maximum principle of optimum control theory, while the second is called a costate or adjoint equation. These equations serve as first-order conditions for optimizing the control problem. They, together with the state equation, are the necessary conditions for the optimal path of the state and control variables over the given time span.
To illustrate how a calculus of variations problem can be converted into a control problem, we use the fundamental equation of neoclassical growth models discussed previously
Kt() YKt () Kt () Ct ()
We know from our first economics classes that capital stock Kt() is a stock variable, while its time rate of change investment Kt() is a flow variable. In the context of dynamic optimization, capital stock is a state variable, while consumption affected by investment is the control variable. Furthermore, with a utility function UCt () (assuming diminishing marginal utility or UC() 0) where the rate of discount is r, the optimization problem of the calculus of variations would be
712 Problems Book to Accompany Mathematics for Economists
tt11 maxU C ( t ) ert dt U Y ( K ) K K e rt dt ttoo In optimal control theory, the equation of the investment flow would be the equation of the motion so that the control problem would be formulated as
t1 maxUCt ( ) ert dt to subject to Kt() YKt () Kt () Ct () where Kt()oo K and Kt()11 K. This gives rise to the Hamiltonian
H UCe()rt YK () K C with the following maximum and adjoint equations:
rt HUCeC () 0
HYKK()
Differentiating the maximum principle equation further with respect to t gives
rt rt rt UCe rUe 0 where ()YUeYKK () and
rt rt rt UCe rUe Ue ()0 YK
UC rU U ()0 YK
Thus, at the optimum, we have
UC rY U K
The left-hand side again gives the proportional increase with time of the marginal utility of consumption. Being the marginal benefit of additional consumption at any point in time, it must be equal to the marginal cost of increasing consumption given here by the discount rate r , the depreciation rate , and the loss of additional aggregate output given here by the marginal product of capital YK . Finally, the assumption that the nation experiences diminishing marginal utility or UC() 0 implies a concave utility function. In the language of optimal control theory, this means that the Hamiltonian is concave in the state and control variables, which ensures that the solution of this control problem is indeed a maximum.
Now that we are somewhat familiar with the tools of optimal control, we can go back to the classical calculus of variations and provide an elegant proof to the Euler’s equation. Transformed in calculus of varations terms, the control problem becomes
t1 max F tyt , ( ), yt ( ) dt to where yt() ftytut , (),() u and yt()oo y and yt()11 y Thus, the Hamiltonian is
HF f 0 and
HHuyy F f y 0 (maximum principle)
HFyy f y 0 (costate equation)
Since yt() ftytut , (),() u, we have f y 1 and f y 0 . Thus, the two equations reduce to
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 713
Fy and Fy
d() dF Since , we must have F as the time derivative of F , that is, F y , which is dt y y y dt F dF nothing but the Euler’s equation or . Hence, we obtain that an important condition for dy dt y finding an optimal time path for the state and control variables and solving a dynamic optimization problem using the calculus of variations is for the Euler’s equation to hold.
Problems
1. A firm’s total costs of production depend on the level of output qt() and its rate of change with time qt() according to the function TC aq2 bq ( ab,0 ). The firm wishes to minimize the present value of its costs of production where the discount rate is r and the costs would be incurred at time t1 . Find a candidate for the extremal that will minimize the firm’s costs.
Solution:
t1 We have min (aq2 bq ) ert dt to The functional is F tqt,(),() q t ( aq2 bqe )rt . We have the partial derivatives rt rt Fq 2aqe and Fq be Substituting in the Euler’s equation, d 2()aqert be rt dt 2aqert rbe rt rb qt() 2a
We see that the suitable candidate for an extremal is a constant function of time that depends positively on the discount rate.
2. A monopolist is faced with the following demand function qt() apt () bpt () c where the number of units produced by the monopolist qt() depends both on the price of the good p()t and its rate of change with time p()t . The firm wishes to maximize the present value of its future stream of revenues from the sale of its product. Assuming the discount rate is r , find the suitable pricing policy for this monopolist. Solution:
t1 We have the problem max p (tqte ) ( ) rt dt to Solving further,
tt11 t 1 p()t q () t ert dt p () t ap () t bp () t c e rt dt ( ap2 bpp cp ) e rt dt ttoo t o The functional, therefore, is F t,(),() p t p t ( ap2 bpp cp ) ert and
714 Problems Book to Accompany Mathematics for Economists
rt rt Fp (2ap bp c ) e and Fp bpe
Substituting in the Euler’s equation, d (2ap bp c ) ert ( bpe rt ) dt
2apert bp e rt ce rt bp e rt rbpe rt
2apert ce rt rbpe rt or
2ap c rbp and c pt() 2arb gives the proper pricing policy for the monopolist.
3. A firm wishes to minimize the discounted value of its total costs of producing n units to be delivered at time t1 where the discount rate is r . The costs of the firm are given by the function TC aq b() q 2 where qt() is the level of output and qt() is its rate of change with time and a and b are constants. Find an output function of time that is a suitable candidate for an extremal minimizing the firm’s costs.
Solution:
The optimization problem is
t1 2 rt min aq b ( q ) e dt to subject to qt()o 0 and qt()1 n
2 rt The functional is F tqt,(),() q t aq bq ( ) e and the partial derivatives are rt rt Fq ae and Fq 2bq e Substituting in the Euler’s equation, d aert (2 bq e rt ) dt aert22 bq e rt rbq e rt abqrbq22
Rearranging and normalizing the equation gives a qt() rqt () 2b which is a second-order differential equation. We can solve it using the formula for the particular integral and the complementary function of a second-order linear equation. For the parameters, we a have ar , a 0 and c . Thus, for the particular integral, we have 1 2 2b ca qtp t abr1 2
We also need to find the complementary function which gives two characteristic roots using the well- known formula.
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 715
aaa2 4 rr2 4(0) rr r 112 1,2 222
Thus, r1 0 and r2 1. According to the formula,
rt12 r t qt() Ae12 Ae qp or a qt() Aert A t 122br
To definitize the constants, we use the constraints qt()o 0 and qt()1 n. Substituting to 0 and t1
qAA(0)12 0 and a qt() Aert1 A t n 11 22br 1 a Aert1 A t n 112br 1 a Ae(1)rt1 n t 112br a a nt nt 2br 1 2br 1 A1 and A2 ert1 1 ert1 1 which gives the final form of the output function
aa nt11 nt 22brrt br a qt() e t eert1111 rt 2br a nt 1 2br rt a qt() ( e 1) t where 0 tt 1 ert1 1 2br The output function found is a good candidate for extremal, but further knowledge is needed to prove that it represents a minimum.
4. The quantity demanded of a firm qt() depends on the own price of the good p()t and the rate of change of the price with time p()t according to the function qt() apt () bpt (). On the other hand, the production costs of the firm are given by ct() mq2 nq k. If the price in the initial moment is po and the price at time t1 is p1 , find the optimal price function that maximizes the firm’s profits over the period 0 tt1 .
Solution:
The optimization problem is
t1 maxp (tqt ) ( ) cq ( ) dt 0 subject to p(0) po and p()tp11
Solving for the objective function,
716 Problems Book to Accompany Mathematics for Economists
tt11 2 ptqt() () cq ( ) dt pap ( bp ) ( mq nq k ) dt 00
t1 22 ap bpp m()() ap bp n ap bp k dt 0 t1 22222 ap bpp ma p2() mabpp mb p nap nbp k dt 0
t1 222 a(1 ma ) p (1 2 ma ) bpp mb ( p ) nap nbp k dt 0
Thus, the integrand gives F tpt,(),() pt where the partial derivatives are
2 Fp 2(1a ma ) p (12 ma ) bp na and Fp (1 2ma ) bp 2 mb p nb
Substituting in the Euler’s equation,
d 2(1)a ma p (12) ma bp na (12) ma bp 2 mb2 p nb dt
2a (1 ma ) p (1 2 ma ) bp na (1 2 ma ) bp 2 mb2 p
Rearranging,
22(1)mb2 p a ma p na gives a second-order linear differential equation that could be solved by the well-known procedure. Normalizing the equation, we obtain
amana(1 ) pp mb222 mb
ama(1 ) na a 0 a c 1 2 mb2 2mb2
The particular integral is
cnambn2 pp 2 ama2 2(1)mb a ma 2(1 )
For the complementary function, we find the characteristic roots
aaa2 4 004(1)/amamb 2 ama(1) r 112 1,2 22mb2
Hence, the price function which optimizes the profit of the firm becomes
n pt() Aert12 Ae rt 122(1 ma ) ama(1) ama(1) where r and r 1 mb2 2 mb2 Since it could be expected that for the firm a 0 (quantity demanded and price are negatively ama(1) related) and m 0 (costs increase rapidly with the level of output), then the term is mb2
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 717 positive, which means that the price function has equal distinct real roots with opposite signs. Therefore, its time path is dynamically unstable. Assuming further that n 0 , the particular integral that gives the intertemporal equilibrium for the price takes a positive value and becomes meaningful. However, given that one characteristic root is positive, the time path of price is divergent and this intertemporal equilibrium cannot be achieved.
5. For the firm in the previous problem, assume the same demand and cost functions. However, assume further that the costs are incurred now, as output is produced in the present moment, but revenues are to be received in the future when an order is made. Thus, the present value of the future revenues of the firm depends on the rate of interest r . Solve again the optimization problem for the proper price function of the firm that maximizes its profit considering the time factor in receiving revenues.
Solution:
Again, we have the demand function qt() apt () bpt () and the cost function
2 ct() mq nq k over the interval 0 tt 1
Discounting the future revenues, we get a slightly modified optimization problem
t1 rt max p (tqte ) ( ) cq ( ) dt 0 subject to p(0) po and p()tp11
Substituting the respective functions,
tt11 rt rt 2 p() t q () t e c ( q ) dt p ( ap bp ) e ( mq nq k ) dt 00
t1 22rt rt ap e bpp e m()() ap bp n ap bp k dt 0 t1 22222rt rt ap e bpp e ma p2() mabpp mb p nap nbp k dt 0
t1 rt2 rt 22 ae()(2) map e mabpp mb() p nap nbp k dt 0
For the functional F tpt,(),(), pt the partial derivatives are
rt rt rt 2 Fp 2(ae map ) ( e 2 mabp ) na and Fp (2)2emabpmbpnb
Using the Euler’s equation, d 2(a ert ma ) p ( e rt 2 ma ) bp na ( e rt 2 ma ) bp 2 mb2 p nb dt 2(a ert ma ) p ( e rt 2 ma ) bp na ( e rt 2 ma ) bp rbe rt p 2 mb2 p
Rearranging,
22()mb2 p a ert ma p rbe rt p na
718 Problems Book to Accompany Mathematics for Economists
2 rt rt 22()mb p a e ma rbe p na
Normalizing the equation
rt rt 2(ae ma ) rbe na pp where the parameters are 22mb22 mb rt rt 2(ae ma ) rbe na a 0 a c 1 2 2mb2 2mb2
The particular integral is cnambna2 2 p p a 2 rt rt 2(aert ma ) rbe rt 2 22()mb a e ma rbe
For the complementary function we find
2 0042(aert ma ) rbe rt / mb2 aaa112 4 r1,2 22 2(ama ert ) rbe rt mb2
The final form of the price function that maximizes the firm’s profit is
na pt() Aert12 Ae r t 122(aert ma ) rbe rt
2(ama ert ) rbe rt 2(ama ert ) rbe rt where r and r 1 mb2 2 mb2
Upon analyzing the particular integral, we conclude that the intertemporal equilibrium price is positive when ab,0 and mn,0 . This implies, as can be expected from economic theory, that quantity demanded and own price are negatively related and costs increase rapidly with the level of output. However, the fact that b 0 also means that consumers expect price to fall in the future as they observe it rise at present, so they would reduce current demand.
With these predicted parameters, we also obtain that the expression under the square root of each of the characteristic roots is positive. (Can you see why?) This means that the two characteristic roots are equal in value but have opposite signs. With one root positive the time path of price cannot be dynamically stable, which implies that the intertemporal equilibrium cannot be reached as time passes.
6. Consider a firm facing a simple demand function where the quantity demanded qt() is negatively related to the own price of the good p()t such that qt() apt () b where a and b are parameters. 2 On the other hand, the firm’s costs include production costs mq () t and inventory costs nq() t where m and n are positive constants. The inventory accumulated by time t is qt(), while the rate of change of inventory with time is the production rate qt(), such that mq() t is the per unit cost of production. If the price in the initial moment is po and the price at time t1 is p1 , find the optimal price function that maximizes the firm’s profits over the period 0 tt 1 .
Solution:
The total costs of the firm are
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 719
2 cq() mq () t nqt ()
Furthermore, from the demand function, we have qt() apt (). Expressing the profit function of the firm, p()t q () t c () t p ( ap b ) m ap () t2 n ( ap b ) ap222 bp ma ( p ) nap nb
ap222() b na p ma () p nb
Thus, the optimization problem becomes
t1 maxp (tqt ) ( ) cq ( ) dt 0 subject to p(0) po and p()tp11
Alternatively, the objective function is
tt11 222 p()t q () t c ( q ) dt ap ( b na ) p ma ( p ) nb dt 00 2 The integrand gives F tpt,(),() pt where Fp 2ap b na and Fp 2ma p . From the Euler’s equation, d 2(2)ap b na ma2 p dt 22ap b na ma2 p
22ma2 p ap na b or
1 na b pp ma 2ma2
The particular integral is
()na b ma na b p p 2ma2 2a
We see that with a 0, the particular integral is meaningful only when b 0 . Furthermore,
004/ma rma 1,2 2
Accounting for the fact that a 0 and m 0 , we have a positive value under the square root and we have one positive and one negative characteristic root. Thus, the optimal price function is
na b pt() Aemat Ae mat 12 2a Because of the presence of one positive root, again we exclude dynamic stability for the price function.
7. Consider the standard case of a firm operating in the short run with a production function qKL(,) where LLt (). The price of labor is w , the price of capital is r , the price of the finished product of the firm is p, and the rate of discount is . The firm maximizes the discounted present value of its profit obtainable infinitely. Use the techniques of the calculus of variations to prove that at the optimum the firm would pay for the variable input a price equal to the value of its marginal product.
720 Problems Book to Accompany Mathematics for Economists
What happens when the firm starts operating in the long run, that is, the production function changes to qKL(), L?
Solution:
We can express the short-term profit of the firm as
pqKL(,) wL rK
Thus, the optimization problem for the firm is tt max (te ) dt pqKL ( , ) wL rKe dt 00 t F pq(,) K L wL rK e where by Euler’s equation dF F ()pq w et F 0 and F L LL L L dt dF Since F is a constant function, we have F L 0 and L L dt t FpqweLL()0
Thus, at the optimum, we must have pqL w 0 and
VMPLL pq w or the firm would pay for labor a price (wage) exactly equal to the value of its marginal product. This result is consistent with what we get under static optimization. In a long-run situation, the profit can be expressed as
pqKL(), L wLrKL () and the new optimization problem is max (te )tt dt pqKL ( ), L wL rKL ( ) e dt 00 The integrand now is
F pq K(), L L wL rK () L et
dK dK t FLKLpq q w r e and FL 0 dL dL dF Thus, F L 0 and L dt
dK dK t FpqqwreLKL 0 dL dL where the parenthesized expression must be zero for an optimum to hold.
dK dK pqKL q w r 0 dL dL
Transforming the left side,
dK dK pq pq w r 0 KLdL dL
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 721
dK ()pq r pq w 0 ()dL KLdL and multiplying both sides by dL ,
()()0pqKL r dK pq w dL
Since the firm is operating in the long run, both labor and capital vary. Hence, we have nonzero values for the differentials dK and dL . Therefore, the only possibility for the left-hand side expression to be equal to zero is for both parenthesized terms to be zeros as well, that is, at the optimum we must have
pqL w 0 and pqK r 0 and consequently
VMPLL pq w and VMPKK pq r
Even in the long run the firm would pay for inputs exactly as much as the values of their marginal products. This result confirms what we obtained previously when we discussed the optimal input decisions of the firm using the techniques of static optimization.
8. An industry represents a near monopoly. The total industry demand at time t is qt() a bpt (), ( ab,0 ) where qt() is the quantity demanded in the industry and p()t is the price. The near monopoly is one large firm that sets the industry price and behaves monopolistically. A competitive fringe of small firms exists that behave competitively – they take the monopolist’s price as given. New small firms enter if the near monopolist charges a price higher than p *. Thus, the output of the fringe f ()t increases if p()tp *, and decreases otherwise. This results in the differential equation
f ()tkptp () * k 0
If the average cost of the near monopolist is c where p* c and the interest rate is r , express the discounted present value of the profit of the large firm. Then maximize this present value, assuming f ()t to be the stock variable and p()t the control variable.
Solution:
The present value of the profit function of the large firm can be expressed as
()tert pt () c a bpt () f () t e rt
We have to maximize it. No endpoint conditions are given, so max (t ) ert dt p ( t ) c a bp ( t ) f ( t ) e rt dt 00 Furthermore, from the differential equation f ()tkptp () *, we have ft() p()tp * k So, substituting for p()t and simplifying,
ff p **cab p fedtrt kk 0
Thus, the functional in this dynamic optimization problem is
ffrt F tft,(),() f t p * c a b p * f e where kk
722 Problems Book to Accompany Mathematics for Economists
f rt Ff pce* k
1 fbfrt rt Ff ab p** fe p ce kk kk and from Euler’s equation,
fdfbfrt1 rt rt pce*** ab p fe pce kdtkkkk
fbffbfrt rt rt p * ce e e kkkk22
f bf f bf pc* kkkk22
2bf p * c k 2 (*p ck )2 f 2b This is a simple second-order differential equation, the solution of which is
(*pckt )22 f ()tct where 4b 1
(*pckt )2 f ()tc 2b 1
So, the industry price is
ft() ( p * ckt ) c p()tp * 1 p * kbk2 and the output of the monopolist is
22 bp(* ckt )bc1 (* p ckt ) abptft() () a bp * ct1 24bk b cb() kt (*pcktbkt )(2 ) a 1 kb4
9. The aggregate output of a county YK() is a function of the stock of capital accumulated in the nation Kt() at a particular moment in time. If the investment rate is the increase of the capital stock with time Kt(), use the simple Keynesian model to maximize the level of total utility UCt() the nation achieves from its aggregate consumption. Assume that KK(0) o and KT() KT .
Solution:
According to the simple Keynesian model,
Ct() YK ( ) K () t or
Ct() Y Kt () K () t
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 723
Thus, the total utility function becomes
UCt() UYKt () K () t and the optimization problem is TT maxUCt ( ) dt UYKt ( ) K ( t ) dt 00 subject to KK(0) o and KT() KT where the integrand is F tKt, (), K () t U Y Kt () K () t . From UCt () we also have dU dC dC U and YKt() and 1. Therefore, the partial derivatives are dC dK dK
FK UCtYKt() () and FK UCt () dC Using the chain rule, we get CYKtKK() . Substituting in the Euler’s equation, dt d UCtYKt() () UCt () dt UCtYKt() () UCtC () UCtYKt() () UCt (). YKtK () K
With specific forms of the above functions, we can solve this second-order differential equation in K and find the Kt() function that maximizes the given extremal.
10. The flow of output of a county is given by the production function YK() which depends on the stock of capital Kt(). Gross investment is the sum of net investment Kt() and the replacement rate of capital K where capital depreciates at a proportional rate for 01 . Express the consumption flow Ct() and the utility the nation achieves from that flow of consumption UCt() . Maximize the discounted stream of utility over the interval 0 tT , assuming that the discount rate is r .
Solution:
From the simple Keynesian model, we have
Ct() Y Kt () Ig () t
We know that gross investment is the sum of net investment and the rate of replacement, or
Itgn() I KtKt () () Kt ()
Thus, for the consumption function, we have
Ct() Y Kt () Ig () t Y Kt () K () t Kt ()
And further for the utility function
UCt() UYKt () K () t Kt ()
Thus, the optimization problem becomes
724 Problems Book to Accompany Mathematics for Economists
TT maxUCt ( ) ert dt U Y Kt ( ) K ( t ) Kt ( ) e rt dt 00 subject to KK(0) o and KT() KT with a functional F tKt, (), K () t U Y Kt () K () t Kt () ert . We also have the derivatives dU dC dC U and YKt() and 1. Therefore, dC dK dK
rt rt FK U Ct(). Y Kt () e U Y Kt () K () t Kt (). Y Kt () e and
rt rt FK U Ct() e U Y Kt () K () t Kt () e
dC Using the chain rule, we get CYKKK . Substituting in the Euler’s equation, dt d UY.( ). ert ( Ue rt ) UCe rt rUe rt dt UY.( ). ert U .( YKK Ke ). rt rUe rt
Cancelling the exponential term,
UY.( ) U .( YKK K ) rU
We can solve this second-order differential equation if we are given some specific form of the utility function. Transforming the previously obtained equation,
d UY.( ). ert ( Ue rt ) dt dU UY.( ). ert e rt rUe rt dt dU UY.( ) rU dt dU Ur() Y dt dU / dt rY U dU / dt where the term gives the marginal function over the total function of the marginal utility of U consumption of the nation U , that is, the rate of growth of the marginal utility. With total utility maximized, we obtain that the rate of growth of marginal utility should be equal to the sum of the dY discount rate and the depreciation rate less the marginal product of capital YK() Y. The rate dK K of growth of marginal utility is often referred to in economic theory as capital gains. We get that the optimal time path requires capital gains to be exactly equal to the term on the right. If capital gains exceed the sum of the discount rate and the depreciation rate less the marginal product of capital, then the marginal product of capital is too high and there are high returns to capital. Therefore, more capital should be applied, and, as a result of its increase, consumption would increase too. In the opposite case, when capital gains are too small, there is too much capital applied and, hence, capital accumulation and consumption should be decreased.
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 725
11. Maximize the discounted stream of utility from consumption of a nation that has a linear production function YKt() Kt () where 0 , if the utility from the flow of consumption takes the form UCt() ln Ct () over the interval 0 tT . Gross investment is the sum of net investment Kt() and linear depreciation and is given by the equation
Itg () Kt () Kt () 01 0
Assume a discount rate of r .
Solution:
For the flow of consumption, we have
Ct() Y Kt () Ig () t Kt () K () t Kt ()
We have the optimization problem TT maxUCt ( ) ert dt ln Kt ( ) K ( t ) Kt ( ) e rt dt 00 subject to KK(0) o and KT() KT where the functional is simply F tKt,(),()ln( K t K K Ke )rt . We also need some essential derivatives:
dU 11 U dC C K K K dY YY dK K dC dC and 1 dK dK
Therefore, () 1 F ert and F ert K KK K K KK K
Using the Euler’s equation,
() rtd 1 rt ee KK K dt KK K
() (KK K ) r eeert rt rt KK K()KK K2 KK K
() (KK K ) r KK K()KK K2 KK K
KK K r KK K
First, we can easily check that this is equivalent to the result
dU / dt rY U
726 Problems Book to Accompany Mathematics for Economists so again, at the optimum, capital gains should equal the sum of the discount rate and the depreciation rate minus the marginal product of capital, here equal to . Cross-multiplying
()()()()() rK rKr KK
KrKrKr(22)()()() which is a linear second-order differential equation in Kt(). Therefore, the particular integral giving the intertemporal equilibrium value of the capital stock is K p
Equilibrium capital stock will only make sense if , since by definition 0 . To solve for the complementary function it is convenient to set m . Then the equation becomes
K(2 m rK ) ( m2 mrK ) ( m r )
The characteristic roots are
2(2)4()mr mr 22 m mr 24444mr m222 mrr m mr r1,2 22 22mr r2 mrr 22
Hence, rm1 and rmr2 . Since for a positive intertemporal equilibrium we assumed , which means m 0 , we have at least one root positive. The optimal time path of the capital function that would maximize the nation’s total utility is, therefore,
Kt() Aemt Ae() m r t 12 m In view of the positive characteristic root, we conclude that the time path of capital is divergent. Using the endpoint conditions that KK(0) o and KT() KT , we can find the arbitrary constants A1 and
A2 . KAAK(0) or AK A 12m o 21o m
KT() AemT Ae() m r T K 12 m T
mT() m r T Ae11 KoT A e K mm
mT () m r T () m r T Ae11 KoT e Ae K mm
mT() m r T () m r T Ae1 e KTo K e mm KKe ()mrT Tomm A 1 eemT () m r T KKe ()mrT Tomm AK AK 21oommeemT () m r T
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 727
KeKemT() m r T K Ke () m r T oomm To mm eemT () m r T
KeKmT oTmm eemT () m r T
12. For the nation described in the previous problem, assume everything is the same except the utility n from the flow of consumption is given by the function UCt () Ct () where 01n .
Solution:
Again, for the flow of consumption, we have
Ct() Y Kt () Ig () t Kt () K () t Kt ()
We optimize TT n maxUCt ( ) ert dt Kt ( ) K ( t ) Kt ( ) e rt dt 00 subject to KK(0) o and KT() KT
The functional is F tKt,(),()( K t K K K )nrt e . Therefore,
nrt1 nrt1 FK nKKKe()( ) FK nKK() K e
Using the Euler’s equation,
d nKKKenKKKe()()() nrt11 nrt dt
To differentiate the right-hand side, we need to apply the product rule.
n()( KKKennKKKKKKe )nrt12 (1)( )( n ) rt
nr() K K Knrt1 e and cancelling out the common terms on the left and on the right,
(1)(nKKKKKKr )(1 )
(1nKK )( K ) r KK K
For simplicity, we can set m , which gives
(1nmKK )( ) mr mK K
Cross-multiplying and rearranging,
(1)(1)()nmK nK m rmK () m rK () m r
(1)(2)()nK m mn rK m rmK () m r
Normalizing the equation,
728 Problems Book to Accompany Mathematics for Economists
(2)()()mn r m m2 mr m r KKK where the parameters are 111nnn
mn r2 m mmr2 ()mr a a and c 1 1 n 2 1 n 1 n
The particular integral is
()(1)mr n K p (1nmm ) ( r ) m
Again, this intertemporal equilibrium value for the capital stock will be meaningful only if , that is, if the marginal product of capital exceeds the rate of depreciation or the output produced by adding one more machine exceeds the rate at which this machine wears out. For the characteristic roots, we substitute the parameters in the well-known formula. We omit some of the more tedious arithmetic computations here. 2 (2)(2)4()mn r m mn r m m2 rm 2 aaa 4 11(1)nnn r 112 1,2 22 (2)(2)(44)(1)mn r m mn r m22 m rm n 1 n (1 n ) 2 2 mn r22 m m22 n mnr r 2 mn r 2() m mn r 2(1)nn 2(1)
Thus, this long process of computing yields two simple roots
mn r22(1) m mn r m n rm and 1 2(1)nn 2(1)
mn r2 m mn r m r r 2 2(1nn ) 1
Hence, the optimum time path for the capital function is
()mrt ( rt ) K() t Aert12 Ae r t Aemt Ae11nn Ae() t Ae 12mm 1 2 1 2
Since at least one characteristic root ( m ) is positive, the time path of capital is dynamically unstable.
Using the endpoint conditions that KK(0) o and KT() KT , we can find the arbitrary constants
A1 and A2 .
KAAK(0) or AK A 12m o 21o m
()mrT KT() AemT Ae1n K 12 m T
()mrT mT 1n Ae11 KoT A e K mm
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 729
()mrT () mrT mT 11nn Ae11 KoT e Ae K mm
()mrT () mrT mT 11nn Ae1 e KTo K e mm
()mrT 1n KKeTo mm A1 ()mrT eemT 1n ()mrT KKe 1n Tomm AK AK 21oomm ()mrT eemT 1n ()mrT () mrT mT 11nn KeKeoo K To Ke mm mm ()mrT eemT 1n
mT KeKoT mm ()mrT eemT 1n
Thus, the time path of capital is fully definitized.
13. Maximize T UCt() ert dt 0 0.5 of a country that has the utility function UCt () Ct () if the discount rate is r 0.09 , the aggregate production function is YKt() 0.15 K , and the investment function is It() K () t 20 0.05 Kt (). Assume boundary conditions K(0) 240 and K(5) 500 .
Solution:
We can solve by following the well-known steps of maximization and the Euler’s equation, but a faster way to solve would be by direct substitution in the result obtained previously. We know that in its final form the differential equation in capital is
(2)()()mn r m m2 mr m r KKK 111nnn where the parameters are, respectively, r 0.09 n 0.5 0.15 0.05 20
Therefore, we have m 0.15 0.05 0.1 . Substituting in this equation,
2 0.1(0.5) 0.09 2(0.1) (0.1) 0.1(0.09) 20(0.1 0.09) KKK 1 0.5 1 0.5 1 0.5
730 Problems Book to Accompany Mathematics for Economists
(0.05 0.09 0.2) (0.01 0.009) 20(0.01) KKK 0.5 0.5 0.5
KK0.12 0.002 K 0.4
0.4 K 200 p 0.002 0.12 ( 0.12)2 4(0.002) 0.12 0.0064 0.12 0.08 r 1,2 222
r1 0.1 and r2 0.02
0.1tt 0.02 Hence, Kt( ) Ae12 Ae 200
Since both characteristic roots are positive, the time path of capital diverges from the equilibrium value of 200 with the passage of time. To find the arbitrary constants A1 and A2 , we use the boundary conditions K(0) 240 and K(5) 500 .
KAA(0)12 200 240 or AA21 40
0.1(5) 0.02(5) KAeAe(5)12 200 500
0.5 0.1 Ae12 Ae 300
0.5 0.1 Ae11(40 A ) e 300
0.5 0.1 0.1 Ae1( e ) 300 40 e
300 40e0.1 255.79 A 470 A 40 470 430 1 ee0.5 0.1 0.54355 2
Therefore, the final form of the optimal capital function is
Kt( ) 470 e0.1tt 430 e 0.02 200
14. For the country presented in the previous example, assume that all the functions and parameters are the same but the utility function is logarithmic of the type UCt () ln Ct ().
Solution:
The problem is again T maxUCt ( ) ert dt 0 with parameters r 0.09 20 0.15 0.05 m 0.15 0.05 0.1
With the logarithmic utility function, we previously obtained the second-order differential equation:
K(2 m rK ) ( m2 mrK ) ( m r )
Substituting in it,
2 KK2(0.1) 0.09 (0.1) 0.1(0.09) K (0.1 0.09)20
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 731
KK(0.2 0.09) (0.01 0.009) K 20(0.01)
KK0.11 0.001 K 0.2
0.2 K 200 p 0.001 0.11 ( 0.11)2 4(0.001) 0.11 0.0081 0.11 0.09 r 1,2 222
r1 0.1 and r2 0.01
0.1tt 0.01 Hence, Kt( ) Ae12 Ae 200
For the arbitrary constants A1 and A2 ,
KAA(0)12 200 240 or A21 40 A
0.1(5) 0.01(5) KAeAe(5)12 200 500
0.5 0.05 Ae12 Ae 300
0.5 0.05 Ae11(40 A ) e 300
0.5 0.05 0.05 Ae1( e ) 300 40 e
300 40e0.05 257.949 A 432 A 40 432 392 1 ee0.5 0.05 0.5974 2
Therefore, the final form of the optimal capital function is
Kt( ) 432 e0.1tt 392 e 0.01 200
15. For a country with a logarithmic utility function of the type UCt () ln Ct (), find the optimal time path of the capital function assuming the following parameters: r 0.08 50 0.25 0.05
The boundary conditions are given to be K(0) 280 and K(5) 430 . How does the time path of capital change, if the rate of depreciation increases from 5% to 10%?
Solution:
For m, we have m 0.25 0.05 0.2 . The problem is again T maxUCt ( ) ert dt 0 Again, we use the previously obtained second-order differential equation:
K(2 m rK ) ( m2 mrK ) ( m r )
Substituting the parameters,
2 KK2(0.2) 0.08 (0.2) 0.2(0.08) K (0.2 0.08)50
KK(0.4 0.08) (0.04 0.016) K 50(0.12)
732 Problems Book to Accompany Mathematics for Economists
KK0.32 0.024 K 6
6 K 250 p 0.024 0.32 ( 0.32)2 4(0.024) 0.32 0.0064 0.32 0.08 r 1,2 222
r1 0.2 and r2 0.12
0.2tt 0.12 Hence, Kt() Ae12 Ae 250
For the arbitrary constants A1 and A2 ,
KAA(0)12 250 280 or AA21 30
0.2(5) 0.12(5) KAeAe(5)12 250 430
0.6 Ae12 Ae 180
0.6 Ae11(30 A ) e 180
0.6 0.6 Ae1()18030 e e
180 30e0.6 A 140 A 30 140 110 1 ee 0.6 2
Thus,
Kt( ) 140 e0.2tt 110 e 0.12 250
If the proportional rate of depreciation is increased to 10%, we have 0.1 . Then, m 0.25 0.1 0.15
Substituting again,
2 KK2(0.15) 0.08 (0.15) 0.15(0.08) K (0.15 0.08)50
KK(0.3 0.08) (0.0225 0.012) K 50(0.07)
KK0.22 0.0105 K 3.5
3.5 1,000 K p 0.0105 3 0.22 ( 0.22)2 4(0.0105) 0.22 0.0064 0.22 0.08 r 1,2 222
r1 0.15 and r2 0.07
1,000 Hence, Kt() Ae0.15tt Ae 0.07 12 3
For the arbitrary constants A1 and A2 ,
1, 000 160 KAA(0) 280 or AA 12 3 213
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 733
1, 000 KAeAe(5)0.15(5) 0.07(5) 430 12 3 290 Ae0.75 Ae 0.35 12 3
0.75160 0.35 290 Ae11 A e 33 290 160 Ae()0.75 e 0.35 e 0.35 1 33 10(29 16e0.35 ) 160 A 247 A 247 300 1 3(ee0.75 0.35 ) 2 3 1, 000 Kt( ) 247 e0.15tt 300 e 0.07 3
One easily detectable effect of the increase in the depreciation rate is the increase of the intertemporal equilibrium value of capital. When the capital stock depreciates faster, more capital is necessary to sustain the economy in equilibrium. Because the characteristic roots are all positive, the time path of capital in both cases is divergent. However, with a greater depreciation, the divergence seems to be slower and take longer.
Ct()1 16. The utility a nation extracts from its aggregate consumption Ct() is UCt() so that 1 the marginal utility of aggregate consumption is UC . The size of the population is given by the t equation Lt() Leo . The investment function of the country is KYKmLC (, ) K where m is the share of the labor force in the population and is the share of capital that depreciates. The rate of discount is known to be r . Maximize the discounted utility function of the nation from the initial moment to infinity. Analyze the growth rate of aggregate consumption. Write the differential equation for Kt().
Solution:
For aggregate consumption,
CYKmLKK(, ) YKmL(, ) K K 1 maxUCt ( ) ert dt e rt dt 1 00 YKmL(, ) K K 1 F(,tKK , ) ert 1 rt FKKYKmL(, ) K K ( Y ) e
rt dFK F YKmL(, ) K K e and using FK K dt d Y(, K mL ) K K ( Y ) ert Y (, K mL ) K K e rt K dt rt YKmL(, ) K K ( YK ) e
1 rt rt Y(, K mL ) K K ( YKL K mY L K K ) e r Y (, K mL ) K K e
734 Problems Book to Accompany Mathematics for Economists
()YK mYL K K Yr KL where LLe t K YKmL(, ) K K o
YK mYLet K K Yr KLo K YKmL(, ) K K
The left-hand side represents the rate of growth of aggregate consumption or
C Yr K C
The rate of growth of aggregate consumption is positively related to the marginal product of capital
YK . Furthermore, it is adversely related to both the interest rate and the rate of depreciation. As capital depreciates faster, it has to be replaced faster, which slows down the growth of consumption. A high interest rate would stimulate the population to substitute present consumption with future one for the sake of savings, thus again slowing the growth of consumption. Finally, the intertemporal elasticity of 1 substitution also has a positive effect on the increase in consumption. Again, it justifies the substitution of present consumption with future consumption. We can set aY K :
aK mY L et K ar Lo YKmL(, ) K K
t ()()()aK mYLo L e K a r Y K K t aK mYLeLo K ()() a rY a r K () a rK
t K()() a arK ar K mYLeLo () arY
()()aar ar mYLet () a rY KKK Lo
Notice that this second-order differential equation in K is one with a variable term on the right involving functions of time t .
17. Referring to the previous problem, assume now that the optimization problem is to maximize the utility of an individual member of society from per capita consumption ct() where the individual’s ct()1 utility function is Uct() . Everything else is the same. Maximize the discounted utility of 1 the individual. Write the differential equation for Kt().
Solution:
From the investment equation
KYKmLLcK (, )
YKmL(, ) K K c L 1 1(,)YKmL K K maxUct ( ) ert dt e rt dt 1 L 00
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 735
1 1(,)YKmL K K rt F(,tKK , ) e 1 L
1 F YKmL(, ) K K ( Y ) ert KKL1
1 rt dFK F YKmL(, ) K K e and using FK K L1 dt
d LYKmLKK11(, ) ( Y ) ert LYKmLKKe (, ) rt K dt
1 rt LYKmLKK(, ) ( YK ) e (1) LLYKmLKK21 (,) ert rLYKmLKK (,) e rt 1 1 rt LYKmLKK(, ) ( YKmYLKKeKL )
()YK mYL K K YLLr(1)1 KL K YKmL(, ) K K L ()YK mYL K K L Yr(1) KL where LLe t and K LYKmLKK(, ) o L
YK mYLet K K Yr (1) KLo K or YKmL(, ) K K
C Yr (1) K C
The rate of growth of aggregate consumption is positively related to the marginal product of capital
YK . Interest rate and the rate of depreciation affect the growth of aggregate consumption negatively. We also see that the higher the growth rate of population , the higher the growth of consumption (for 1). Developing the expression further,
C Yr K C CcL Since CLc , we have or rrr . Therefore, the growth rate of aggregate CcL CcL consumption is the sum of the rates of growth of per capita consumption and of population. Since rL , we have for the growth rate of per capita consumption
c Yr K c
Like aggregate consumption, per capita consumption is positively related to the marginal product of capital and negatively to interest rate and depreciation. However, it is negatively affected by the growth of the population. As the size of the population increases, the individual’s consumption grows more slowly. We can set aYK :
aK mY L et K ar(1) Lo YKK
t ()(1)()aK mYLo L e K a r Y K K
736 Problems Book to Accompany Mathematics for Economists
t aK mYLeLo K a r(1) Y a r (1) K a r (1) K
t K a ar(1) K ar (1) K mYLeLo ar (1) Y
aar(1) ar (1) mYLeart (1) Y KKK Lo Again we obtain a second-order differential equation in K where the variable term involves functions of time t .
18. A worker’s life span is assumed to be T over which he obtains a fixed wage rate w . He will receive a constant interest rate on his accumulated life savings St() or pay the same rate on his accumulated debts (that will represent negative savings). If this worker’s consumption flow is Ct(), express his capital (savings) accumulation. Suppose the worker does not have any initial endowment or inheritance, so the boundary conditions are SST(0) ( ) 0 . If his instantaneous utility function is UCt() ln Ct () and it is discounted at the utility discount rate r , maximize the discounted value of the utility function of the worker. What happens when, over the course of time, the utility discount rate and the interest rate on savings equalize?
Solution:
Here the worker’s flow income is his wage plus the increase in his savings, that is, wSt (). Thus, when he has positive savings, his flow income increases. With negative savings (debt), his total flow of income declines. Furthermore, the worker’s capital (savings) accumulation can be expressed as the difference between his flow income and his spending on consumption, that is,
St() w St () Ct ()
Therefore, his consumption function is
Ct() w St () S () t
We want to optimize TT maxUCtedt ( )rt ln w St ( ) Stedt ( ) rt 00 where SST(0) ( ) 0
We have F tSt,(),() S t ln( w S S ) ert . 1 F ert and F ert S wSS S wSS
Using the Euler’s equation,
rtd 1 rt ee wSS dtwSS
()SS r eeert rt rt wSS()wSS 2 wSS
Cancelling the repetitive terms,
()SS r wSS
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 737
()SS r wSS
Upon analyzing this result, we can easily see that it is equivalent to
dU / dt r , U that is, the rate of growth of the marginal utility of consumption is the difference between the interest rate on savings and the utility discount rate. Thus, when the two interest rates become equal the growth rate of marginal utility is zero – the worker does not extract any additional utility from his flow CdCdt / of consumption. The left-hand term is also equal to , that is, CC dC/ dt r C or the rate of growth of consumption is the difference between the two interest rates. This means that the worker will have a positive consumption growth rate (his consumption will grow) when his savings grow faster than his utility. His consumption will decline if the utility discount rate exceeds the savings rate, that is, savings grow more slowly than utility. Finally, when the two rates are equal, the worker’s consumption will not grow at all. Solving the equation further,
()SS r wSS
S S() rw ()() rS rS
SrSrSrw(2 ) ( ) ( )
We can solve this linear second-order differential equation in St() by the well-known steps. The particular integral is
wr() w S p () r
2(2)4()rr 22 r24444rrrr222 r1,2 22 22rr2 rr 22
Hence, r1 and rr2
w St() Aetrt Ae() 12 Since at least one root ( ) is positive, the time path of the savings function is dynamically unstable.
Using the endpoint conditions, we can find the arbitrary constants A1 and A2 .
19. For the worker described in the previous example, assume that his utility function is n UCt() Ct () . Furthermore, the worker’s wage w is taxed with a unit tax rate . Maximize the discounted value of the worker’s utility function. What is the effect of the tax on the consumption and the savings function of the worker?
738 Problems Book to Accompany Mathematics for Economists
Solution:
This time, accounting for the tax rate, we have
St() (1 ) w St () Ct ()
Hence, the consumption function is
Ct() (1 ) w St () S () t
We optimize TT n maxU C () t ert dt (1 ) w S () t S () t e rt dt 00 where SST(0) ( ) 0 and
n F tSt,(),() S t (1) w S S ert
n1 rt n1 rt FS nwSSe(1 ) and FS nwSSe(1 )
Using the Euler’s equation,
nn11d nwSSenwSSe(1 ) rt (1 ) rt dt
n(1 ) w SSnn12 ert nn ( 1) (1 ) w SS ( S Se ) rt
nr(1 ) w S S n1 ert
Simplifying,
1 (1)(1)nwSSSSr ( )
(1nSS )( ) r (1 )wSS
(1nSS )( ) r (1 )wSS
(1n ) S (1 nS ) ( r )(1 ) w ( rS ) ( rS )
(1nS ) (2 n rS ) ( rS ) ( r )(1 ) w
Normalizing the equation,
(2 nr ) (2 r ) ( r )(1 ) w SSS 111nnn
()(1)(1)(1) rwn w S p (1nr ) ( )
2 (2nr ) 2 nr 4( 2 r ) 111nnn r 1,2 2 2(2)(44)(1)nr nr22 r n 2(1 n )
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 739
2()nr nr 2 2()nr nr 2(1)nn 2(1) r Hence, r and r and the time path of the savings function is 1 2 1 n
() rt (1 )w St() Aet Ae1n 12 Since at least one root ( ) is positive, the time path of the savings function is divergent. The effect of the unit tax is to reduce the consumption of the worker, as can be seen from the consumption function, and change the equilibrium value of the savings function.
Ct()1 20. For the worker in problem 18, assume that his utility function is UCt() so that the 1 marginal utility of consumption is UC . Maximize the discounted value of the worker’s utility function. How does the result change when the worker has some initial assets to the amount of So and wants to leave an inheritance of S1 , both positive?
Solution:
Again the consumption function is
Ct() w St () S () t
Thus, TTwStSt () ()1 maxUCt ( ) ert dt e rt dt 1 00 where initially SST(0) ( ) 0
()wSS 1 F tSt,(),() S t ert 1 rt rt FS ()wSSe and FS ()wSSe
Using the Euler’s equation,
d ()wSSert () wSSe rt dt
()()()()wSSert wSS 1 SSerwSSe rt rt
()()wSS 1 SSr
()SS r which gives wSS
()()() rrrw 2 SSS () rw w S p () r
740 Problems Book to Accompany Mathematics for Economists
2 ()rrr 4() 2 rr() 2 r 1,2 22 rr() 2 r r and r and the time path of the savings function is 1 2 () rt w St() Aet Ae 12 Because initially the worker does not get or leave any inheritance, we have the endpoint conditions
SST(0) ( ) 0 . This would result in particular values of the arbitrary constants A1 and A2 . Thus, we have
w SAA(0) 0 and at the end of his life 12 () rT w ST() AeT Ae 0 12 As he receives and leaves inheritance, his endpoint conditions change to
w SAAS(0) 12 o () rT w ST() AeT Ae S 12 1
Thus, the presence of inheritance would change the value of the parameters A1 and A2 and consequently, the time path of the savings function.
21. An individual wants to maximize the discounted value of his lifetime utility from consumption
UC1() as well as the utility from leaving a one time bequest to his children US2 () at death. He obtains income I . The interest rate on savings is , while the rate of discount is r . Express the individual’s flow budget constraint. Maximize his total utility.
Solution:
For the individual’s flow of income, we have
St() St () I Ct () where the increase in savings comes from the interest earned on it plus the share of income not spent on consumption. Therefore,
Ct() St () I S () t
The optimization problem is T maxUCedtU ( )rt ( Se ) rt 12 0 T To maximize UCedt()rt , we use the calculus of variations, that is, 1 0
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 741
TT maxUCedt ( )rt U ( S I Se ) rt dt 11 00 rt F USISe1() and
dU F Ue rt and F Ue rt where U 1 and from Euler’s equation S 1 S 1 1 dC dF F S or S dt d Ue rt() Ue rt 11dt dU2 Uert U() S Se rt rUe rt where U 1 11 1 1 dC 2
UUSSrU11 () 1 or
USS() 1 r U1
dU dt 1 r U1
We again obtain that the growth rate of the marginal utility of consumption is the difference between the interest rate on savings and the utility discount rate, so that when the two rates are equal, the individual does not extract any additional utility from further consumption.
rt We maximize the second term USe2 () separately, using the techniques of static optimization. By the first-order condition where we differentiate the term with respect to time, we get
d dU USe()rt USe rt rUe rt 0 where U 1 dt 222 2 dS
US22 rU Therefore,
US 2 r or U2
dU dt 2 r U2 This time we obtain that, at the optimum, the utility the individual extracts from leaving a bequest to his children grows exactly at the rate of discount r . He will experience an increase in his utility if the real discount rate is positive. His utility will decline with a negative real discount rate. If the real rate happens to be zero, there will be no change in the individual’s utility. When the discount and the interest rate are the same, the individual would not extract any further utility from consumption; but the higher the interest rate, the faster his savings will grow and, hence, his utility from leaving a larger sum to his successors will increase. Thus, the individual will choose to substitute consumption with savings.
22. In his neoclassical growth model, Ramsey assumes that the savings rate is not constant but follows a particular time path. If the saving rate is s st() (where 01 s ), a simple national-income model would be CsYs(1 ) ( ) where national income Ys() is itself a function of the savings rate. Consumption is national income less aggregate savings. If instead Ys(), we assume that national
742 Problems Book to Accompany Mathematics for Economists income depends also on the rate of change of the saving rate such that Yss(, ) and the nation experiences a general utility function UCt () , maximize the discounted value of aggregate utility from moment to to moment t1 . Assume a discount rate of r .
Solution:
We have
tt11 maxUCt ( ) ert dt U (1 sYss ) ( , ) e rt dt ttoo The integrand is
F(,,)tss U (1)(,) sYss ert
rt dU Y F UY(1 sYe ) where U and Ys ss dC s
rt Y F UsYe(1 ) where Y ss s s dF Following the Euler’s equation, we have F s or s dt
rtd rt UY(1 sYe ) U (1 sYe ) ssdt rt rt UY(1 sYeU )ssss ( sY ) (1 sYsYs )( ) (1 sYe )
rt rt UsYss (1 sYserUsYe ) (1 ) s dU2 2Y where we assume U and Y dC 2 s ()s 2 U Y(1 sY ) ( s ) Y (1 s )( Ys Ys ) (1 sY ) sY (1 sYs ) r (1 sY ) s U ss s s s s U (s )Y (1 s )( Ys Ys ) (1 sY ) Y (1 sY ) sY (1 sYs ) r (1 sY ) U s ss ssss
U YsYYYs sss ()sYsYsYs (1)(ss ) r UsYY (1 ) ss If we assume s 0 , that is, the savings rate to be increasing at a constant rate s , we obtain
U YsY ss (1 sY ) ()sYsYs (1)s r UsY (1 ) s
dU dt YsY (1 sY ) ss r UsY (1 ) s
The left side is nothing but the growth rate of the marginal utility of consumption. The assumption s const. implies that the economy is in a steady state and, therefore, in such a state the growth of marginal utility would depend positively on the discount rate. The higher the discount rate, the more stimulated people would feel to consume. An additional term showing the effect of the savings rate on national income influences the growth rate of marginal utility. Depending on the value of this term the growth rate could be equal to, higher or smaller than the discount rate. From the equation we can immediately see that the faster the savings ratio grows, that is, the higher s , the faster the marginal utility of consumption grows.
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 743
23. The consumption function of a country depends both on the marginal propensity to consume of the nation ct() and its rate of change with time ct() such that Ct() 7.5 c22 9 c 6() c . Suppose that the goal of the government is to maximize total consumption over some time horizon 0,T . Find and analyze the optimal time path of the marginal propensity to consume.
Solution:
The optimization problem for the government is
TT 22 maxCtdt ( ) 7.5 c 9 c 6( c ) dt 00 22 where F tct, ( ), c ( t ) 7.5 c 9 c 6( c ) and Fcc 15 9 and Fc 12c . Furthermore, from the Euler’s equation,
d 15cc 9 (12 ) dt
15cc 9 12
12cc 15 9 cc 1.25 0.75 which gives
0.75 c 0.6 p 1.25
For the complementary function, we have
0 0 4( 1.25) 5 r 1,2 22
52tt 52 ct() Ae12 Ae 0.6
With specific values for the endpoint conditions, we can definitize the arbitrary constants A1 and A2 . The particular integral gives the intertemporal equilibrium value for the marginal propensity to consume. Here the value is 0.6, which means that, in equilibrium, 60% of the national income should 5 go to consumption. But since we have one positive characteristic root, that is, r , we have a 1 2 divergent time path for the marginal propensity to consume.
24. Aggregate consumption Ct() is positively related to national income Yt() in equilibrium as is consistent with economic theory. However, it also increases in times of economic growth, that is, when national income grows. Therefore, the specific form of the consumption function is
Ct() (1 ) Y Y ,0 0,1 where is autonomous consumption, is the marginal propensity to consume, is the percentage income tax rate, and is a positive parameter that relates aggregate consumption to the rate of change of national income. Using the calculus of variations, maximize the utility from aggregate consumption UCt() ln Ct () over the interval 0 tT . Assume that national income is autonomous and independent of aggregate consumption.
Solution:
We have to solve
744 Problems Book to Accompany Mathematics for Economists
TT maxUCt ( ) dt ln (1 ) Y Y dt 00 subject to YY(0) o and YT() YT
Thus, F tYt,(),() Y t ln (1) Y Y
(1 ) F and F Y (1 )YY Y (1 )YY
(1 ) d (1 )YYdt (1 ) YY
(1 ) (1 )YY (1 )YY (1 )YY 2
(1 )YY (1 ) (1 )YY
(1 ) 22 (1 )YY (1 ) (1 ) YY 2
222YYY2(1) (1) (1)
2(1) 22 (1) (1) YY Y 22 (1 ) 2 Y p 222(1 ) (1 )
2(1)4(1)4(1) 2222 22 (1 ) r 1,2 2 (1 ) t Yt() Ae (1 )
25. The government of a country collects tax from the population that depends on actual national income Yt() and the business cycle. When the economy experiences a boom, so that actual national income increases above its potential level, the government collects more tax in order to alleviate a preheated economy. On the contrary, in times of recession when aggregate output declines, the government reduces the amount of tax collected aiming to stimulate the economy. Thus, the tax function takes the form
TYt() Y Y ,0 01 where is tax collected from nonincome sources, is income tax, and is a parameter relating tax policy to the business cycle. It is also known that the government wishes to optimize its expenditures where GTY(). Maximize the government spending function, given the total tax collected. Assume that national income is autonomous and independent of any of the other variables. What is the optimal time path of national income with a specific form of the government spending function GT() TY () where is a positive parameter?
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 745
Solution:
Since TYt() Y Y , we have for government spending
GTY() G Yt () Y () t and the optimization problem becomes TT maxGTY ( ) dt G Yt ( ) Y ( t ) dt 00
subject to YY(0) o and YT() YT where F tYt, (), Y () t G Yt () Y () t . From GTY () we also have dG ddG dT G G TYY dT dT dT dt
From the integrand,
FY GTYTY() () G and FY GTYTY () ( ) G
d GG () dt
GGTGYY () which gives a second-order ordinary differential equation in Yt() or
G YY G
G YY 2G
From the specific form of the government spending function GT() TY (), we have
GT() TY () from which G and G . Substituting in the differential 2 T 4TT equation for Y ,
4TT YY 2 2 T
2T YY 2
2(YY ) YY 2 22 2YY 2 YY 22
32 2Y 2 YY 22
22 Y p 222
746 Problems Book to Accompany Mathematics for Economists
398223 22 r 1,2 22
2 r r 1 2
Thus, the optimal time path of national income is
2 tt Yt() Ae Ae 12 Since both characteristic roots in the solution are negative, given the specific government spending function, the time path of national income is convergent. To specify the arbitrary constants, we can use the boundary conditions YY(0) o and YT() YT .
26. The stock of fish in a private lake is x()t at any time t where the initial stock is x()txoo . It is assumed that the only value of the lake is the value of the fish in it. The owner is trying to use the lake sustainably by harvesting only the increase in the fish stock x()t resulting from the biological growth of the fish as a replenishable resource. Thus, x()t is the natural, sustainable level of the stock. The fish is sold in the market at a constant price p, and the costs of harvesting are given by the general function Cxt() . Furthermore, the owner has calculated that his unit cost of maintaining the entire fish stock is c . He wishes to maximize the discounted value of his wealth between moments to and t1 where the interest rate of discounting is r . Formulate and solve generally the optimization problem for the lake owner.
Solution:
The wealth of the owner can be expressed as the total revenue minus the total costs. Hence,
Wxt() pxt () Cxt () cxt () where pxt() is the total revenue from the lake. Total cost comprises the costs of harvesting Cxt() and the costs of maintaining the resources, cx() t . Thus, the optimization problem for the owner is
tt11 maxWxtdt ( ) pxt ( ) Cxt ( ) cxte ( ) rt dt ttoo subject to x()txoo and x()tx11
F txt, (), xt () pxt () Cxt () cxt () ert dC F cert F ()pCe rt where C x x dx and from the Euler’s equation,
d cert() p C e rt dt
cert C x e rt r() p C e rt cCxrpC () which can be solved further with a specific form of the cost of harvesting function.
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 747
27. Consider a slightly modified model of fish harvesting where fish is harvested at the rate ut() and sold in the market at some constant price p . The fish stock in the lake is x()t . It is also known that the rate of change of the stock of fish depends on some biological rate of growth g()x and the rate of harvest ut() such that x()tgxtut () (). Furthermore, the costs of harvesting are given by the general function Cut(), and the unit cost of maintaining the entire fish stock is c . Maximize the discounted value of the fish as a source of wealth between moments to and t1 where the rate of discount is r . What does the growth of fish depend on?
Solution:
This time, we have a wealth function
WputCutcxt() () () where from the growth equation we obtain ut() g xt () x () t . Hence, the wealth function can be expressed alternatively as
W p.() gx x Cgx () x cxt ()
Now the optimization problem is
tt11 maxW xtdt ( ) p . gx ( ) x Cgx ( ) x cxt ( ) ert dt ttoo subject to x()txoo and x()tx11
F txt,(),() xt p . gx () x Cgx () x cxt () ert
rt rt Fx ()pg C g c e Fx ()pCe
dg dC ddC where g C C and from the Euler’s equation, dx du du du d ()()pg C g c ert C p e rt dt
()()()pgCgceCgxert rt rpCe rt
pgCgcCgx ()() rpC which is a second-order differential equation in the state variable x()t . It can be solved with a specific form of the cost and growth functions. However, some interesting results can be analyzed further by rearranging the equation
()p Cg Cg ( x ) c rpC ()
Cx() g c gt() r p CpC where gt() is the rate of growth of the fish stock and represents the benefit of waiting and giving up the present consumption of fish. In static optimization, this marginal benefit of waiting would equal the opportunity cost of using the resource (that is, capital) in the present which is represented here by the interest rate r . However, in dynamic models, decisions in the present affect the future and the consumption of fish affects the rate of change of the marginal value of the fish. Thus, there is an additional loss, called capital loss, that must be added to the direct cost of waiting. If we let p Cv , then v is the marginal current value of the stock and represents the net current benefit of
748 Problems Book to Accompany Mathematics for Economists fish extraction. It is equivalent to price minus marginal cost where the opportunity costs of future events are capitalized into present decisions. It is easy to check that the derivative of p C with time is Cx() g . Hence,
Cx() g v p Cv v where is exactly the capital loss that must be added to the direct cost of waiting. Thus, the v growth equation becomes
vc gt() r vv c Finally, the term shows the effect on the cost of fishing of an increase in the fish stock since a v larger stock of fish lowers the costs of fishing at any level of harvesting or extraction efforts. To summarize, the last equation gives a dynamic optimum condition – similar to nondynamic models, it equates the marginal benefit of an activity (on the left) to the marginal cost (on the right).
28. A firm utilizes some stock of capital Kt() at time t that generates a stream of rents for the firm R()K . Capital is assumed to depreciate at a linear rate Kt() where is a constant rate of depreciation of capital and 01 . The firm appropriates new capital ut(), while the cost of investing in new capital is Cu(). The firm wishes to maximize the discounted value of its wealth from capital accumulation over an infinite time horizon. Formulate the optimization problem and interpret the results. Assume a fixed market interest rate r .
Solution:
For the change in the capital stock (or the investment rate), we have
Kt() ut () Kt (), that is, the net increase in capital is the difference between new capital and the loss of old capital. Hence, ut() K () t Kt ()
The optimization problem for the firm is maxRKt ( ) Cut ( ) ert dt max RK ( ) CK ( K ) e rt dt 00 F tKt,(),() K t RK () CK ( K ) ert
rt rt FK ()RCe FK Ce dR dC ddC where R C C dK du du du and again following the Euler’s equation,
d ()RCe rt () Ce rt dt
()RCert rCe rt C ( K Ke ) rt
RCrCCK() K
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 749
If we rearrange slightly,
RCK()() K rC and
RCK() K r CC
The derivative C here is the capital gain, that is, the rate of change in the marginal value of the capital occurring at time t , which results from the future wealth-maximizing use of capital. This is an additional gain that attributes due to the optimal usage of the capital stock. We can just as well let Cv , the derivative of which with respect to time is the expression CK() K v . Thus, the equation can be rewritten as
Rv r vv
We can interpret it in the following terms: the left-hand side illustrates the marginal benefits that result R v from the marginal profits of an additional increment of capital , and the capital gain from the v v increase in the marginal value of capital used optimally. Clearly, on the right side we have the opportunity cost of capital, which involves the rate of depreciation of the capital stock plus the opportunities forgone on alternative investment r . The equation can alternatively be written as
Rvrv() which denotes the same relationship, only in cumulative terms; for example, the term on the right side shows the cumulative opportunity cost of funds of the value of capital. In summary, the equation denotes the relationship between marginal revenue and cost, even though we are dealing with dynamics rather than statics. As with all dynamic models, though, the effect of current actions on future outcomes is taken into account.
29. For a firm with a total cost function TC aq b() q 2 , ( ab,0 ), where qt() is the level of output and qt() is its rate of change, minimize the costs of production subject to the constraint
t1 qtdtN() to where N is the number of units the firm should deliver at time t1 . Thus, the endpoint conditions are qt()o 0 and qt()1 N.
Solution:
The optimization problem is
t1 2 min aq b ( q ) dt to
t1 subject to qtdtN() to where qt()o 0 and qt()1 N
Following the Euler-Lagrangian method, we set the Lagrangian function
t1 2 aq b() q q dt to
750 Problems Book to Accompany Mathematics for Economists
2 which gives the integrand Laqbq() q . Hence, Laq and Lbqq 2 . From the Euler- Lagrange equation,
d abq(2 ) dt abq 2 a q 2b
And the solution can be obtained through double integration. First,
at qc 2b 1 and integrating once more,
at 2 qt() ct c 4b 12
If we have precise values for the endpoint conditions, we can definitize the constants c1 and c2 and specify the time path of the output function.
30. For the firm in the preceding problem, minimize the discounted value of its total costs subject to the given constraint. Assume a discount rate of r .
Solution:
The optimization problem is now
t1 2 rt min aq b ( q ) e dt to
t1 subject to qtdtN() to where qt()o 0 and qt()1 N
Setting the Lagrangian,
t1 2 rt aq b() q e q dt to So, the integrand is Laqbqe()2 rt q where rt and rt . Using the Laeq Lbqeq 2 Euler-Lagrange equation,
d aert(2 bq e rt ) dt aert22 bq e rt rbq e rt abqrbq22
Rearranging and normalizing, a qrq 2b
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 751
a Since ar , a 0 and c , the particular integral is 1 2 2b ca qtp t abr1 2
aaa2 4 rr2 4(0) rr r 112 0;1 1,2 222
Therefore, a qt() Aert A t 122br
To definitize the constants, we use the constraints qt()o and qt()1 .
31. A worker will receive a fixed wage rate w over his lifetime T . He will also receive a constant interest rate on his accumulated life savings St(). The worker’s consumption flow is Ct(), while his instantaneous utility function is UCt () ln Ct (). Furthermore, the worker receives an endowment of So from his ancestors and wishes to leave a bequest of S1 to his children. If a fixed rate of discount r is applied, maximize the discounted value of the worker’s utility function subject to the constraint
T StdtS() S 1 o 0
Solution:
The worker’s inflow of income is his wage plus the increase in his savings, that is, wSt (), while the outflow is his consumption. Therefore, the worker’s net flow of income is
St() w St () Ct ()
Hence, the consumption function is
Ct() w St () S () t
We need to optimize TT maxUCtedt ( )rt ln w St ( ) Stedt ( ) rt 00 T subject to StdtS() S where SS(0) and ST() S 1 o o 1 0 The Lagrangian is
T lnwStSte () ()rt Stdt () 0 and the integrand is LwStSteStln () ()rt (). Hence, 1 Le rt and Le rt S wSS S wSS
From the Euler-Lagrange equation,
752 Problems Book to Accompany Mathematics for Economists
rtd 1 rt ee wSS dtwSS
()SS r eeert rt rt wSS()wSS 2 wSS
()SS r which gives wSS
SrSrSrw(2 ) ( ) ( )
wr() w S p () r
2(2)4()rr 22 r24444rrrr222 r1,2 22 22rr2 rr 22
Hence, r1 and rr2 w St() Aetrt Ae() 12 Since at least one root ( ) is positive, the time path of the savings function is dynamically unstable.
From SS(0) o and ST() S1 , we also have w w SAAS(0) so ASA and 12 o 21o p w ST() AeTrT Ae() S 12 1
TrTww() Ae11 So A e S 1 p
TrTww() rT Ae11(1 e ) So e S p p
ww() rT wwT SSe1 o SeSo 1 pp p p A and A 1 eeTrT(1 ) 2 eeTrT(1 )
Ct()1 32. For the worker in the previous problem, assume his utility function is UCt() . 1 Maximize the discounted value of the worker’s utility function. Discuss the growth rate of the worker’s consumption. Express the time path of his asset function, given the endpoint conditions.
Solution:
Again the consumption function is
Ct() w St () S () t
Chapter 12. Introduction to Dynamic Optimization: The Calculus of Variations 753
TTwStSt () ()1 maxUCt ( ) ert dt e rt dt 1 00 T subject to StdtS() S where SS(0) and ST() S 1 o o 1 0 Given the asset constraint, the Lagrangian is
T 1 ()wSS rt eSdt where 1 0
()wSS 1 LeSrt 1 rt rt LwSSeS () and LwSSeS ()
d ()wSSert () wSSe rt dt
()()()()wSSert wSS 1 SSerwSSe rt rt
()()wSS 1 SSr
()SS r wSS
Rearranging,
()SS r , that is, wSS
Cr C An optimal time path dictates that the growth rate of the worker’s consumption be equal to the product 1 of the intertemporal elasticity of substitution and the difference of the interest rate and the rate of intertemporal discount. Here, is the reward to the worker for his patience in postponing consumption. At the same time, r is the cost of consuming in the present and works as a punishment for the worker if he is eager to consume now. Such a great impatience reduces the rate of growth of the worker’s consumption. Thus, the savings rate stimulates the growth rate of consumption, while the rate of discount reduces it. Finally, a high elasticity of substitution also stimulates the growth of consumption and implies that future consumption is a good substitute for current consumption.
()()() rrrw 2 SSS
() rw w S p () r
2 ()rrr 4() 2 2 rr() r 1,2 22
754 Problems Book to Accompany Mathematics for Economists
rr() 2 r r and r 1 2 and the time path of the savings function is
() rt w St() Aet Ae 12 From the endpoint conditions,
w w SAAS(0) ASA 12 o 21o p () rT w ST() AeT Ae S 12 1
() rT T ww Ae11 So A e S 1 p
()rT () rT T ww Ae11 e So e S p p () rT () rT ww T ww SSe1 o Seo S1 e pp pp A1 () rT and A2 () rT eeT eeT