Post Econometric Policy Evaluation: A Critique
Abstract
An increasingly popular approach to policy evaluation involves applying the parameters calibrated for a real business cycle model that does not include policy to a different model, where policy does affect private decisions. This technique, in effect, estimates a model that misspecifies how private behavior depends on policy. The calibrated parameters depend on policy behavior, but calibrators overlook this dependence when projecting policy effects. This procedure repeats the "Keynesian" errors that Lucas (1976) noted in his influential critique of (then) standard methods of econometric policy evaluation and produces predictions of policy consequences that may be no more useful than ones from traditional econometric models.
Board of Governors of the Federal Reserve System International Finance Discussion Papers Number 393
December 1990
POST ECONOMETRIC POLICY EVALUATION: A CRITIQUE
Beth Ingram and Eric M. Leeper
NOTE: International Finance Discussion Papers are preliminary materials circulated to stimulate discussion and critical comment. References in publications to International Finance Discussion Papers (other than an acknowledgement that the writer has had access to unpublished material) should be cleared with the author or authors.
ABSTRACT
An increasingly popular approach to policy evaluation involves applying the parameters calibrated for a real business cycle model that does not include policy toa different model, where policy does affect private decisions. This technique, in effect, estimates a model that misspecifies how private behavior depends on policy. The calibrated parameters depend on policy behavior, but calibrators overlook this dependence when Projecting policy effects. This procedure repeats the “Keynesian” errors that Lucas (1976) noted in his influential critique of (then) standard methods of econometric policy evaluation and produces predictions of policy consequences that may be no more useful than ones from
traditional econometric models.
Post Econometric Policy Evaluation: A Critique Beth Ingram and Eric M. Leeper"
Robert Lucas (1976) uses a few simple examples to expose a fault in the foundations of econometric policy analysis. He argues that traditional Keynesian econometric models misspecify how private behavior depends on policy. This misspecification implies that the objects the modelers interpret as describing private behavior depend on both private and policy behavior. Therefore, analyses of policy changes that hold these objects fixed "are of no value ir: guiding policy" [Lucas and Sargent (1978, p. 50) emphasis in original]. To address Lucas’s criticisms, modern policy analysis is conducted in general equilibrium models with maxirnizing private agents. This paper shows that, ironically, these maximizing models invite and often entail committing precisely the same "Keynesian" sins.
One constructive response to Lucas’s critique has been the development of the rational expectations econometrics program. At the general level described by Lucas and Sargent (1981), the program requires estimating the dependence of private agents’ optimal decision Tules on tastes, technology, and the decision makers’ environment. Alternative policies
correspond to different environments, and policy analysis consists of tracing out the decisions
“Department of Economics, University of Iowa, and staff economist, International Finance Division, Board of Governors of the Federal Reserve System. Ingram acknowledges the financial assistance of NSF grant No. SES-8909376 and a College of Business Summer Grant. This paper represents the views of the authors and should not be interpreted as reflecting those of the Board of Governors of the Federal Reserve System or other members of its staff.
We thank John Coleman, Neil Ericsson, Dale Henderson, Andy Rose, Chuck Whiteman and the participants at seminars at the University of Virginia, the Federal Reserve Board, and the University of Iowa for helpful suggestions. Mike Leahy’s careful reading improved the paper’s exposition. We are especially grateful to Dave Gordon for many thoughtful conversations and constructive suggestions.
of individual agents for various policy environments.
In practice, after adopting parameterizations of preferences, technology, and the environment, rational expectations econometricians proceed in several steps. First, they specify how private behavior depends on policy. Second, they identify and estimate the aspects of private behavior that can reasonably be held fixed when the policy environment changes (i.e., parameters of tastes and technology), separating private parameters from policy parameters. Finally, they evaluate the economic effects of alternative policies that are characterized by changes in policy parameters. Note that failure to execute the firs: two steps correctly prevents the last step from being useful.
An increasingly popular approach to the first two steps is the calibration technique pioneered by Kydland and Prescott (1982). In the original real business cycle (RBC) model, Kydland and Prescott use a simple structure without policy (and in which policy is irrelevant) to match data. To calibrate the model, they find values for parameters of private behavior that allow their equilibrium to mimic certain comovements of variables over the business cycle." Recent work adds monetary and fiscal policies to versions of Kydland and Prescott’s’ setup (or Hansen’s (1985) modification) with two objectives in mind: (a) to explore whether
adding policy helps the model to match observed correlations more closely;? and (b) to
"Long and Plosser (1983) also use a simple model without policy to reproduce certain features of business cycles. Their calibration procedures differ substantially from Kydland and Prescott’s and do not seem to have been followed as widely.
*Some examples that add policy and compare the fit to data are Braun (1989), (Cassou (1989), Giovannini and Labadie (1989), Kydland (1989), Labadie (1989), McGrattan (1989), Baxter and Crucini (1990), Christiano and Eichenbaum (1990), Den Haan (1990), Greenwood and Hercowitz (1990), and Huh (1990).
obtain welfare comparisons of various policies.*
In the recent work, the authors choose values for the parameters of individual behavior, and then solve and simulate the model. A finding that the empirical patterns emerging from the model are "close" to those observed in actual data is interpreted as prima facie evidence that the model’s welfare implications for policy should be taken seriously.
Frequently, RBC modelers transport the parameter values Kydland and Prescott used in their model without policy to the new models with policy.* This procedure leads to the following paradox. Kydland and Prescott’s model assumes that policy doesn’t affect private decision rules. There is no policy evaluation to perform.’ Alternatively, if policy does affect
private behavior, then the parameters Kydland and Prescott calibrate are reduced-form
*Papers that evaluate the welfare consequences of various policies include Danthine, Donaldson, and Smith (1987), Cooley and Hansen (1989,1990), Cassou (1990), Greenwood and Huffman (1990), Hansen and Imrohoroglu (1990), Imrohoroglu (1990), King and Rebelo (1990), anc: McGrattan (1990).
“We use Kydland and Prescott (1982) as an example. Cassou (1990), Cooley and Hansen (1989,1990), Greenwood and Huffman (1990), and Hansen and Imrohoroglu (1990) use parameters from Kydland and Prescott or Hansen (1985). But researchers also transport parameters from other models that have been calibrated ignoring policy. For example: McGrattan (1989) borrows some parameters from Kydland and Prescott and some from Altug’s (1989) maximum likelihood estimates of a version of Kydland and Prescott without policy variables; Baxter and Crucini (1990) use King, Plosser, and Rebelo’s (1988) parameter settings; Imrohoroglu (1990) uses parameters from Imrohoroglu (1989); King and Rebelo (1990) import parameters from their 1989 model without policy.
*Sargerit (1984) points out a logical problem inherent in rational expectations econometrics. If policy behavior has been purposeful historically, then there again is no policy evaluation to conduct. He argues modelers must sidestep the problem and should instead treat policy historically as being “arbitrary,” that is, sub-optimal. Also see Sims’s (1986, 1987) remarks.
parameters for some underlying model embedding monetary and fiscal policies.® Thus, if there is any policy evaluation left to perform, Kydland and Prescott’s calibrated parameters must be functions of policy behavior and should change systematically with policy. When RBC modelers evaluate alternative policies, however, the calibrated parameters are held fixed.
This is precisely the sort of procedure that Lucas criticized. But the modern manifestation of Lucas’s critique has a twist. Even if RBC modelers correctly specify the decision rules of the private sector, they forecast the effects of a contemplated policy change using incorrect values for private parameters. Thus, applying Kydland and Prescott’s parameter values to models in which policy matters effectively continues the traditional misspecification of the dependence of private behavior on policy. Although the modern error is more subtle, there is no guarantee it is less severe.
This leads us to update Lucas’s critique: We "shall argue that the features which lead to success in [matching business cycle correlations} are unrelated to quantitative pclicy evaluation, that the [calibrated RBC] models are (well) designed to perform the former task only, and that simulations using these models can, in principle, provide no useful information as to the actual consequences of alternative economic policies. These contentions will be based not on deviations between estimated and ‘true’ structure prior to a policy change but on the deviations between the prior ‘true’ structure and the ‘true’ structure prevailing afterwards" {Lucas (1976, p. 20), emphasis in original].
We illustrate the problem by constructing a hypothetical monetary growth economy,
*By misspecifying how private decisions depend on the policy functions, RBC modelers incorrectly execute the first two steps of the rational expectations econometric program when they estimate private parameters.
which is a simplified version of models being used to evaluate policy. In this economy, agents hold money to satisfy a transactions constraint. Since the optimal savings rate depends on the expectation of money growth tomorrow relative to all future money growth, the parameters of the money process enter the decision rules of private agents.
Maintaining the hypothetical economy as "truth," we retrace the steps taken by modelers who transport parameters from one model to another model. RBC calibrators who insert Kydland and Prescott’s parameters into this monetary model have (implicitly) estimated a different rnodel that ignores money and monetary policy.’ Consequently, policy parameters do not enter their estimated savings function. By forcing all the variation in savings to be accounted for by private behavioral parameters alone, the procedure confounds the response of savings to money growth with the response of savings to other shocks. Our example displays the resulting bias in the parameter estimates as a function of policy behavior.
Within the hypothetical economy we conduct rational expectations policy experiments. Given some historical behavior of policy, we suppose there is an unanticipated permanent change in policy today, and calculate the true path of the savings rate under the new policy. This path is then compared to the paths predicted by an RBC calibrator and a naive time series modeler. The calibrator’s biased estimates of private parameters produce biased forecasts of the new level of the savings rate when policy changes.
Since the true savings rate depends on the conditional expectation of future money
growth, both the actual change in savings and the RBC calibrator’s predicted change vary
7Our example characterizes calibration as a type of moments estimator. Thus, this paper is silent on the controversy over calibration versus estimation [see Singleton (1988) and Watson (1990)].
with this expectation. We illustrate both of these changes in the savings rate as a function of the current state. The two exercises show that, as popularly implemented, the RBC calibration approach may be inferior to naive time series models. This demonstrates the well-known fact that fully specified theories impose stringent restrictions, which, if false, produce false
empirical predictions.
I. An Illustrative Monetary Model.
As our hypothetical "true" model, we use a variant of the cash-in-advance economies in Lucas (1980,1982), Svensson (1985), and Lucas and Stokey (1987). Two considerations guided our choice of model. First, it is a simplified version of the setup that Kydland (1989), Cooley and Hansen (1989,1990), and others use to match data and study the welfare implications of monetary policy. Our simpler model abstracts from labor/leisure choices and assumes that capital depreciates fully each period. This has the benefit that it understates the real effects of monetary policy, and, thereby, understates the biases produced by RBC calibration procedures. Second, the simpler model has analytical solutions, which are derived in Coleman (1989), enabling our example to show explicitly how the private sector’; decision rules depend on policy behavior. In more complicated models, this dependence can get obscured because the equilibria must be approximated and solved numerically.
The model has a representative agent and a monetary authority. Capital held from period t-1 to period t, k,, yields output of the single consumption good equal to Okt, ae (0,1), where ®, is an exogenous stochastic technology shock. Capital depreciates completely each period. The consumer discounts utility at rate B € (0,1). At time t, the agent chooses
consumption, c,, pre-transfer nominal balances, m,,,, and capital, k,,,, to solve:
max £E, > B' in¢c,)
t=0 subject to p,(c, + k,,,) + m,,,/M, = p,O,k* + m/M,, (1) | Pc, < m/M,, In(@,) = p In(6,,) + €, & ~ N(0,0°), |p| <1, given ky and Mb. p, is the price at time t of the consumption good in terms of money, m, represents nominal balances held from t-1 to t, and M, is the aggregate nominal money stock at t. To make the agent’s problem stationary, we use the aggregate money stock to normalize nominal variables. The cash-in-advance constraint in equation (1) imposes the condition that nominal purchases of the consumption good cannot exceed the quantity of nominal balances carried into the period. Ceteris paribus, if the agent chooses higher nominal balances today, m,,;, She can consume more tomorrow.
After making decisions at time t, the agent receives a lump-sum monetary transfer equal to (1/z,,,-1)M,, so that post-transfer money holdings are m,,,= m,,, + (1/Z,,,-1)M,. This ensures that any seigniorage collected by expanding the money supply is rebated to the consumer in a way that does not affect her decisions. The evolution of the nominal aggregate
money stock is z,,,M,,; = M,. Therefore, m,,,/M, = m,,,/M, 7 1/244 +1, The: budget constraint can now be rewritten as:
(2) . p(c, + k,,,) + m,,/M, + 1 - 1/z,,; = p,Okt + m/M,.
Monetary policy is a specification of the stochastic process governing z,, the inverse of the growth rate of the aggregate money stock. The agent knows this process, but the realization of z,,, is not revealed until the end of period t. The policy rule in effect in the hypotheti-
cal economy allows money growth to respond to technology shocks: (3) Zu1 =p + 6 In(6).
The steady state (inverse) growth rate of money is p, which is positive.
The appendix shows that this policy specification implies the equilibrium consumption
and savings decisions:
p + 51n(@) =f kt,
1-of ° 1 - aBp
p + 81n(6) p, 81n@) | ' ‘ 1-aB 1-aBp
(5) k., = 1 ~
Note that the stochastic processes governing consumption and capital depend on the policy parameters p and 6.° In this economy, monetary policy affects real allocations by altering the intertemporal
rate of return on cash balances. These real effects arise only if realized shocks today change
8An equilibrium for this model requires that the return on holding money is less than 1/8 for all states of the world, otherwise the optimal choice of capital is negative. In all the simulation results reported below, we check that the realized rates of inflation and money growth exceed B.
expected future money growth and inflation relative to their normal values. Expressions (4) and (5) show that a higher than average technology shock has both direct and indirect effects on consumption and capital decisions. If 5 is negative, these effects work in opposite directions. The direct effect raises consumption (and the capital stock) by the marginal propensity to consume (and invest) out of current income. The indirect effect arises because a higher than average technology shock leads the agent to predict a lower value for z next period, according to the policy rule (3). The lower z represents a larger lump-sum transfer at the end of the period and, therefore, a higher expected inflation tax next period. The higher tax induces the agent to hold fewer real balances today, which, via the financing constraint, drives up the current price level. This reduces consumption and increases investment. Thus, when 6 is negative, monetary policy induces a smoother consumption path by counteracting the direct effect of the technology shock on consumption. It also produces a more variable capital stock series by reinforcing the direct effect on investment.
To reproduce the RBC calibration procedures, we estimate the private agent’s preference and technology parameters using a stochastic growth economy without money. When monetary policy is irrelevant and preferences and technology are the same as in the true hypothetical model, the equilibrium decision rules reduce to the well-known Levhari and
Srinivasan (1969) rules:
(6) c, = (1 - oB)Oki,
(7) ky. = oB6,k¢.
A calibrator who estimates & and B using (6) and (7), when the true decision rules are
(4) and (5), will obtain calibrated parameters that are a composite of o, B, the policy parameters, and the technology shock. This is exactly the type of bad inference that Lucas
(1976) criticized.
Il. The Calibration Experiment
To proceed with our experiment, we generate a target data set using the true monetary model (decision rules (4) and (5)). The calibrator, using a model in which policy is irrelevant (decision rules (6) and (7)), chooses parameter settings for a and B so that certain statistics calculated from the model without policy are equal to the values of the statistics calculated in the target data set.
More specifically, the calibrator generates simulated time series from decision rules (6) and (7) and calculates the variances of consumption and capital. He then adjusts o and B until the variances in the simulated series are equal to the variances in the target dzta set. The experiment formalizes calibration as the "simulation estimator" discussed in Lee and Ingram (1990). We do this formal estimation to emphasize that the problem lies ir. transporting parameters estimated in a model without policy to a model with policy, not in the algorithm used to obtain the initial parameter estimates.
For each of the 100 replications of the experiment, we generate realizations of the technology shock according to its assumed distribution. The true values of the calibrated
parameters are @ = 0.36 and B = 0.96.° To eliminate sampling error, the calibrator is given
°The other parameter settings are: the variance of the disturbance to technology, 0” = .00721 and the unconditional mean of the inverse of money growth, p = .4073. The experiments we conduct consider various settings of the serial correlation parameter for the (continued...)
10
the realizations of the technology shock that occurred in the actual data set. This ensures that any deviation of the estimates from the true values can be attributed directly to bias in the estimation procedure arising from misspecifying the private agent’s decision rules.’
Figure 1 contains the estimation results for p = 0 and for four values of 5. When p = 0, there is no persistence in the technology shock. Figure 2 contains the results for p = 0.95, which is the value Hansen (1985) and other RBC modelers give to the autoregressive coefficient in the technology process. Each figure shows the histograms of the estimates for 100 replications of simulations of length 160, which is approximately the number of observations available in quarterly time series since World War II. Table 1 reports the mean values of the estimiated parameters for both values of the serial correlation parameter, p, and for each of the four values of the policy parameter, 5.
When p = 0, the estimates of a are decisively biased away from the true value, a = 0.36. The lias is positive when 6 is negative and negative when 4 is positive. In all cases, the skewness of the empirical distribution implies that none of the replications produces an estimate equal to the true value. (The estimates for B are close to 0.96, so we do not report the histograms for this parameter.)
The results are similar when p is increased to 0.95, where we graph the estimates of B
9(...continued) technology shock, p, and the feedback of technology shocks to money growth, 6. The values of a and 6’ come from Hansen (1985). To interpret his model on a quarterly frequency, Hansen sets B = .99, which implies an annual (steady state) real interest rate of 4 percent. We chose « smaller value for B because of the tendency for estimates of the discount rate to exceed unity. The value of p is chosen arbitrarily.
With two, free parameters, two target statistics, and no sampling error, the calibrator will choose a and B to match the variances of consumption and capital exactly.
11
only. In that case, as illustrated in Figure 2, some of the estimates of B exceed unity. In three cases (5 = -0.2, -0.1, and 0.2), none of the replications produces an estimate equal to the true value. Since the calibrator uses the same random draws of the technology shock that generated the true data, these deviations from truth arise solely from the calibrator’s misspeci-
fication of how private decisions depend on policy.
III. Some Implications of Bad Parameter Estimates
We now conduct two rational expectations policy experiments that involve changing the responsiveness of monetary policy to the technology shock, as described by 8 ir: the policy rule. Suppose that policy 5, has been in effect historically, and we wish to forecast the savings rate from today onward if policy is changed to 6, today."’ It is convenient to express the outcomes cf the experiments in terms of the savings rate. The true savings rate function is obtained by dividing decision rule (5) through by output: p + 51n(6)
y din(®) — — FL 1-of 1-aBp
The exact procedure that Lucas criticized would evaluate the effect of a change in 8 using the decision rules from the estimated model without policy. Since the savings rate from
. . AA . . . . . this model is s = of (see equation (7)), it is clear that the predicted savings rate would be the
“We follow the standard practice and assume that the announced policy changes are wellunderstood and perfectly credible.
To avoid notational clutter, we suppress the dependence of this function on the parameters p and p, which are not central to the present exposition.
12
same under both policies, even though savings would actually change according to (8).
The modern error is more subtle than this traditional error. To forecast the effect of the policy change, the calibrator uses the correct savings function, (8), with the correct value of 5, inserted. He also uses the calibrated private parameters, a and 8 that were estimated from the model without policy (decision rules (6) and (7)). Thus, the calibrator predicts that the new savings rate function is s(0,;,,8,5,). He then forecasts future savings rates by forming forecasts of the future technology shock, the 6’s.’* Conditional on information available at the time of the contemplated policy change, time T, he forms the predicted time
series:
s(E, [6,,, 1; 6,8, ) fork > 1. An econometrician, who takes a naive forecasting approach and has a time series on
the savings rate under the initial monetary policy, {s,(6,),t=1,2,....T}, might model savings as
a univariate autoregressive process. The econometrician estimates:
(9) s(5,) =% + ¥8.,6) +n,, t= 1,2,..T,
where 1), is a mean zero i.i.d. process with finite variance. The econometrician has no
knowledge of the true economic structure. To forecast savings after the change in policy, he
"Using the incorrect parameter estimators in the correct savings rate function is equivalent to using the correct estimators in some incorrect decision rule. To see this, simply define the new function s'(6,;0,B,5,) = s(®;0,B,5,).
“We assume the calibrator knows the correct process for the technology shock. This gives the calibrator the benefit of the doubt that he has not miscalibrated this process, as well as the private parameters. Eichenbaum (1990) presents arguments, which are different from ours, for being very uncertain about the standard RBC specification of the process for technology shocks.
13
simply sets all future n’s to zero and uses the estimated law of motion for savings, (9), to project savings conditional on the time T observed rate.
Figure 3 shows sample time paths of the actual new savings rate and the predictions produced by the calibrator and the time series econometrician.’” The paths are 200 periods long, representing a 50-year forecast horizon for quarterly data. As seen in the figure, the biased calibrated private parameters cause the calibrator to systematically over-predict the savings rate.
Because the contemplated policy change does not alter the steady state savirgs rate, forecasts from the time ~eries model are unbiased predictors of the savings rate. On average, the naive approach dominates the procedure that transports parameters estimated in the model without policy. The figure shows that having the correct decision rule does not ensure accurate forecasts of policy effects if the private parameters have been poorly estimated.
The second experiment exploits the fact that the private agent’s savings decision depends on the expectation of future monetary policy, conditional on current information. Therefore, the predicted change in the savings rate, due to an unanticipated change in monetary policy today, will depend on the current realization of the technology shock. Figure 4 displays the actual and the calibrator’s predicted percent changes in the savings rate induced by a hypothetical change in policy today as a function of the current technology shock.'®
We assume the forecaster knows today’s realized technology shock exactly. The figure shows
‘In the experiment, the initial monetary policy was 5, = -0.2 and the new policy was 5, = -0.1. The serial correlation parameter is p = 0.95.
‘Policy was 5, = -0.2 and is changed to 8, = 0.2 today; p = 0.0.
14
that the bias, given by the vertical distance between the two lines, increases with the
magnitude of the technology shock.
IV. Concluding Remarks
Kydland and Prescott’s (1982) findings are remarkable because they emerge from an extraordinarily simple economic model. Precisely because of its simplicity, however, the model (including its associated parameter values) cannot be expected to be structural with respect to a broad class of changes in the environment.’’ It’s not hard to think of changes in the envircnment that would force the modeler to alter the parameter values used. For example, if another consumption good were introduced, it wouldn’t be sensible to transport Kydland and Prescott’s preference and technology parameters to the new model. Adding policy variables to Kydland and Prescott’s setup is a conceptually identical exercise: Their model with policy is a different model (including its associated parameter values).
The practice of transporting parameters that were estimated in one model to another, completely different model, is widespread and growing. We have argued that the practice is also logically flawed. Many of the calibrated parameters of private behavior that RBC modelers ‘reat as invariant are actually reduced-form parameters like those prevalent in traditional Keynesian models. Exercises that hold these parameters fixed when policy changes repeat the errors of traditional econometric analysis that Lucas (1976) so neatly
pointed out. Our example shows that there is no reason to believe the modern errors are
"This point is not new. Researchers at the Cowles Commission showed that certain aspects of economic behavior will be structural (or invariant) for only particular classes of changes in the environment [see, for example, Marschak (1953) and Hurwicz (1962)].
15
smaller than those that Lucas and Sargent (1978) argue contributed to the poor econornic policies (and consequent performance) of the American economy in the 1970’s.
In our example, calibration procedures result in biased estimators of private behavior. _ We cannot tell whether the biases that show up in actual calibration exercises tend to over- or underpredict policy effects, since the direction of bias depends on what policy behavicr was during the estimation period, Even though the biases appear to be "small," they can have profound consequences for forecasting policy effects. Surprisingly, large mistakes emerge even in the example in this paper where monetary policy is relatively unimportant for private decisions. Still more surprising, by imposing severe (and false) restrictions on private behavior, the practice of transporting parameters may do worse than atheoretical time series
models.'®
“This is one aspect of Sims’s (1982, p. 334) general contention that "the positive 2rogram of rational expectations econometrics . . . reproduces the main faults of standard policv evaluation in exaggerated form."
16
References
Altug, Sumru, "Time to Build and Aggregate Fluctuations: Some New Evidence," International Economic Review, November 1989, 30, 889-920.
Baxter, Marianne and Crucini, Mario J., "Explaining Saving/Investment Correlations," Rochester University Working Paper No. 224, March 1990.
Braun, R. Anton, "The Dynamic Interaction of Distortionary Taxes and Aggregate Variables in Postwar U.S. Data," unpublished manuscript, University of Virginia, November 1989.
Cassou, Steven, Stochastic Dynamic Tax Analysis, unpublished dissertation, University of Minnesota, November 1989.
, "Welfare Costs of Stabilization," unpublished manuscript, State University of New York at Stony Brook, June 1990.
Christiano, Lawrence J. and Eichenbaum, Martin, "Current Real Business Cycle Theories and Aggregate Labor Market Fluctuations," Institute of Empirical Macroeconomics Discussion Paper No. 24, January 1990.
Coleman, W. John, "Money, Interest, and Capital in a Cash-in-Advance Economy," unpublisaed manuscript, Board of Governors of the Federal Reserve System, September 1989.
Cooley, Thomas F. and Hansen, Gary D., "The Inflation Tax in a Real Business Cycle Model," American Economic Review, September 1989, 79, 733-48.
, "Tax Distortions in a Neoclassical Monetary Economy," unpublished manuscript, University of Rochester, July 1990.
Danthine, Jean-Pierre, Donaldson, John B., and Smith, Lance, "On the Superneutrality of Money in a Stochastic Dynamic Macroeconomic Model," Journal of Monetary Economics, December 1987, 20, 475-99.
Den Haan, Wouter J., "Leisure, Money and the Term Structure of Interest Rates," unpublished menuscript, Carnegie-Mellon University, June 1990.
Eichenbaum, Martin, "Real Business Cycle Theory: Wisdom or Whimsy?" unpublished menuscript, Northwestern University, July 1990.
Giovanniri, Alberto and Labadie, Pamela, "Asset Prices and Interest Rates in Cash-in- Acivance Models," NBER Working Paper No. 3109, September 1989.
17
Greenwood, Jeremy and Hercowitz, Zvi, "The Allocation of Goods and Time Over the Business Cycle,” Institute for Empirical Macroeconomics Discussion Paper No. 26, March 1990.
Greenwood, Jeremy and Huffman, Gregory W., "Tax Analysis in a Real Business Cycle Model: On Measuring Harberger Triangles and Okun Gaps," Federal Reserve Bank of Minneapolis Working Paper No. 457, May 1990.
Hansen, Gary D., "Indivisible Labor and the Business Cycle," Journal of Monetary Economics, March 1987, 19, 103-28.
Hansen, Gary D. and Imrohoroglu, Ayse, "The Role of Unemployment Insurance in an Economy with Liquidity Constraints and Moral Hazard," University of Southern California Discussion Paper No. 90-10, January 1990.
Huh, Chan G., "Output, Money and Price Correlations in a Real Business Cycle Model," Federal Reserve Bank of San Francisco Working Paper No. 90-02, May 1990.
Hurwicz, Leonid, "On the Structural Form of Interdependent Systems," in Ernest Nagel, Patrick Suppes, and Alfred Tarski, eds., Logic and Methodology in the Social Sciences Stanford: Stanford University Press, 1962, 232-39.
>
Imrohoroglu, Ayse, "Cost of Business Cycles with Indivisibilities and Liquidity Constraints," Journal of Political Economy, December 1989, 97, 1364-83.
. "The Welfare Cost of Inflation Under Imperfect Insurance," University of Southern California Discussion Paper No. 90-3, January 1990.
King, Robert G. and Rebelo, Sergio T., "Transitional Dynamics and Economic Growth in a
Neoclassical Model," University of Rochester Working Paper No. 206, November 1989.
, "Public Policy and Economic Growth: Developing Neoclassical Implications," Journal of Political Economy, October 1990, 98, Part 2, $126-50.
King, Robert G., Plosser, Charles I. and Rebelo, Sergio T., "Production, Growth and Business
Cycles," Journal of Monetary Economics, March/May 1988, 21, 195-232.
Kydland, Finn E., "The Role of Money in a Business Cycle Model." Institute for Empirical Macroeconomics Discussion Paper No. 23, December 1989.
Kydland, Finn E. and Prescott, Edward C., "Time to Build and Aggregate Fluctuations,” Econometrica, November 1982, 50, 1345-70.
18
Labadie, Parnela, "Stochastic Inflation and Equity Prices," Journal of Monetary Economics, March 1989, 24, 277-98.
Lee, Bong-Soo and Ingram, Beth F., "Simulation Estimation of Time Series Models," Forthcoming, Journal of Econometrics, 1990.
Levhari, D. and T.N. Srinivasan, "Optimal Savings Under Uncertainty,” Review of Economic Studies, April 1969, 36, 153-64.
Long, John B,. Jr. and Plosser, Charles I., "Real Business Cycles,” Journal of Political Economy, February 1983, 91, 39-69.
Lucas, Robert E., Jr., "Econometric Policy Evaluation: A Critique," in Karl Brunner and Allan H. Meltzer, eds., The Phillips Curve and Labor Markets, Vol. 1, Carnegie-Rochester
Conference Series on Public Policy, Journal of Monetary Economics, Suppl. 1976, 19- 46.
__, "Equilibrium in a Pure Currency Economy," Economic Inquiry, April 1980, 18, 203-20.
__, "Interest Rates and Currency Prices in a Two-Country World," Journal of Monetary Economics, November 1982, 10, 335-59.
Lucas, Robert E. Jr. and Sargent, Thomas J., "After Keynesian Macroeconomics," in After the Phillips Curve: Persistence of High Inflation and High Unemployment, Federal Reserve Bank Boston Conference No. 19, Federal Reserve Bank of Boston, 1978, 49- 72.
__, "Rational Expectations and Econometric Practice" (introductory essay), in Robert E. Lucas, Jr. and Thomas J. Sargent, eds., Rational Expectations and Econometric Practice, Minneapolis: University of Minnesota Press, 1981, xi-xl.
Lucas, Robert E. Jr. and Stokey, Nancy L., "Money and Interest in a Cash-in-Advance Economy,” Econometrica, May 1987, 55, 491-514.
Marschak, Jacob, "Econometric Measurements for Policy and Prediction,” in William C. Hood and Tjalling C. Koopmans, eds., Studies in Econometric Methods, New York: Wiley, 1953, 1-26.
McGrattan, Ellen R., "Computation and Application of Equilibrium Models with Distortionary Taxation," unpublished dissertation, Stanford University, 1989.
__, "The Macroeconomic Effects of Distortionary Taxation," unpublished mar.uscript, Duke University, 1990.
19
Sargent, Thomas J., "Autoregressions, Expectations, and Advice," A.E.A. Papers and Proceedings, May 1984, 74, 408-15.
Sims, Christopher A., "Scientific Standards in Econometric Modeling,” in M. Hazewinkel and A.H.G. Rihnooy Kan, eds., Current Developments in the Interface: Economics, Econometrics, Mathematics, Dordrecht, Holland: D. Reidel Publishing Co., 1982, 317- 37.
, Are Forecasting Models Usable for Policy Analysis?" Federal Reserve Bank of Minneapolis Quarterly Review, Winter 1986, 10, 2-16.
, 'A Rational Expectations Framework for Short-Run Policy Analysis,” in William A. Barnett and Kenneth J. Singleton, eds., New Approaches to Moneiary Economics, Cambridge: Cambridge University Press, 1987, 293-308.
Singleton, Kenneth J., "Econometric Issues in the Analysis of Equilibrium Business Cycle Models," Journal of Monetary Economics, September 1987, 21, 361-86.
Svensson, Lars E. O., "Money and Asset Prices in a Cash-in-Advance Economy," Journal of Political Economy, October 1985, 93, 919-44.
Watson, Mark W., "Measures of Fit for Calibrated Models," unpublished manuscript, Northwestern University, September 1990.
20
Appendix: Solving the Model
The constraints that define the solution to the optimization problem are:
(A.1) pc, < m/M,
(A.2) p,(c, + k,,) + m,,,/M, + 1 - We, - m/M, - p,8,kt = 0 (A.3) Lp, = Ay, + Ay
(A4) 1p. = OBKT IE (iePe + Aout}
(A.5) AJM, = BECO + Aoe)/Mua}-
(4.1) is the cash-in-advance constraint and (A.2) is the budget constraint. 1,, is the Lagrange multiplier associated with the budget constraint at t and A, is the Lagrange multiplier associated with the cash-in-advance constraint at t. In equilibrium, (A.1) implies that pc, = 1. Combining this with (A.3) and (A.5) yields an expression for A,,:
(A.6) Ay, = BE,{z,,.;}.
Combining p,c, = 1 with (A.4) and (A.6) implies: (A.7) PE {21} = Okt EOP Eni lZuo)}. The budget constraint yields the feasibility condition: (A.8) c, + k,,, = Ok¢
The solution to this problem is completely characterized by (A.1), (A.6), (A.7), and (A.8). Following Coleman (1989), we guess and verify that the solution to this problem is a
set of functions of the form:
(A.9) c, = ¥,8,kt (A.10) k, = (1 - y)OKT (A.11) | Pr = [y.9,kt "
21
(A.12) m, = M,
(A.13) % = A,/o, (A.14) ®, = Ay, + OBEO,,; (A.15) An = BE,{Z,.1}
The policy authority chooses the stochastic process {z,,,} 2 according to the rule in equation (3) in the text. (A.1) is satisfied since m, = M, and cp, = 1. Adding together c, and k, shows that (A.8) is satisfied. Finally, substitution of the expression for p, in (A.7), and using the expressions for y,, @, and A,, shows that (A.7) holds.
Deriving the optimal decision rules in equations (4) and (5) is straightforwarc!. Use the policy rule in (3) to obtain the expression for 4, = p + 5 In(®,). Since by assumption, laBl < 1, (A.14) is a contraction. Solving this in the usual fashion, and using the expression for A,,, we obtain the dependence of @,, and hence the marginal propensity to consume
out of current income, on expected future money growth:
& "
t B > (aB} E, Ziaje
j=0 A.16) ( hoy 51n(6,)
l-of8 1-afp
_ Combining this expression for @, with the solution for Ay, and substituting the result
into (A.9) and (A.10) gives equations (4) and (5) in the text.
22
Table |. Calibrated Private Parameters. True values are o = 0.36 and B = 0.96.
Note: The reported estimates of @ and 6 are the mean values of the estimates from 100 replications of the data set. p is the serial correlation parameter for the technology shock and 6 is the response of (inverse) money growth to the technology shock. The calibrated parameters coming from fitting the model without money to a data set in which monetary
policy affects private decisions.
23
Fraction of Cases
Fraction of Cases
Figure 1. Estimates of Alpha rho = 0.0, 100 replications
true alpha
mean = .462
true alpha
a
3 36 42 .48
24
delta = -.1
6
true alpha
&
true alpha
42 -48
Fraction of Cases
Fraction of Cases
Figure 2. Estimates of Beta rho = 0.95, 100 replications
delta=~.2 . delta=-.1
e- 57
true beta true beta a
mean = .978 mean
delta= .1 delta= .2 S7 5-
true beta ea L true beta
1 ‘ .98 1.04
mean = .951 mean = .942
25
Savings Rate Under New Policy
Figure 3. Actual and Predicted Monetary Policy Effects Effect of a policy change from delta=-.2 to delta=-.1 when rho = .95
352 “ Prediction using calibrated parameters “ Actual savings rate .347 AR(1) Prediction 342 I T 1 200 Period
26
Percentage Change in Savings Rate
Figure 4. Predicted Effects of a Change in Monetary Policy
24
Etfect on savings of a change from delta=-.2 to delta=.2 when rno=0.0
Predicted change a (using calibrated parameters)
Actual change \ (using true parameters)
T T T 025 05 075 1
Log of Technology Shock
27
IFDP NUMBER
393
392
391 390 389
388
387 386 385 384 383 382 381 380 379
378
International Finance Discussion Papers
TITLES 1990
Post Econometric Policy Evaluation: A Critique
Mercantilism as Strategic Trade Policy: The Anglo-Dutch Rivalry for the East India Trade
Free Trade at Risk? Perspective
An Historical
Why Has Trade Grown Faster Than Income?"
Pricing to Market in International Trade: Evidence from Panel Data on Automobiles and Total Merchandise
Is the EMS the Perfect Fix? An Empirical
Exploration of Exchange Rate Target Zones
Estimating Pass-through: Stability
Structure and
International Capital Mobility: from Long-Term Currency Swaps
Evidence
Is National Treatment Still Viable? Policy in Theory and Practice
U.S. Three-Factor General Equilibrium Models: A Dual, Geometric Approach
Modeling the Demand for Narrow Money in the United Kingdom and the United States
The Term Structure of Interest Rates in the Onshore Markets of the United States, Germany, and Japan
Financial Structure and Economic Development
Foreign Currency Operations: Bibliography
An Annotated
The Global Economic Implications of German Unification
Computers and the Trade Deficit: The Case of the Falling Prices
—___oOoOoOoOO
Please address requests for co Papers, Division of International F Federal Reserve System, Washington, D.C.
20551.
28
AUTHOR (s)
Beth Ingram Eric M. Leeper
Douglas A. Irwin
Douglas A. Irwin
Andrew K. Rose Joseph E. Gagnon Michael M. Knetter
Robert P. Flood Andrew K. Rose Donald J. Mathieson
William R. Melick Helen Popper Sydney J. Key Douglas A. Irwin David F. Hendry
Neil R. Ericsson
Helen Popper
Ross Levine
Hali J. Edison Dale W. Henderson
Lewis S. Alexander Joseph E. Gagnon
Ellen E. Meade
pies to International Finance Discussion inance, Stop 24, Board of Governors of the
IFDP NUMBER
377
376
375
374
373
372
371
370
369
368
367
365
364
363
362
361
International Finance Discussion Papers
TITLES 1990
Evaluating the Predictive Performance of Trade-Account Models
Towards the Next Generation of Newly Industrializing Economies: The Roles for Macroeconomic Policy and the Manufacturing Sector
The Dynamics of Interest Rate and Tax Rules in a Stochastic Model
Stock Markets, Growth, and Policy Prospects for Sustained Improvement in U. S. External Balance: Structural Changes versus
Policy Change
International Financial Markets and the U.S. External Balance
Why Hasn't Trade Grown Faster Than Income? Inter-Industry Trade Over the Past Century
Contractionary Devaluation with Black Markets for Foreign Exchange
1989
Exchange Rate Variability and the Level of International Trade
A Substitute for the Capital Stock Variable in Investment Functions
An Empirical Assessment of Non-Linearities In Models of Exchange Rate Determination
Equilibrium in a Production Economy with an Income Tax
Tariffs and the Macroeconomy: from the USA
Evidence
European Integration, Exchange Rate Management, and Monetary Reform: A Review of the Major Issues
Savings Rates and Output Variability in Industrial Countries
Determinants of Japanese Direct Investment in U.S. Manufacturing Industries
The U.S. and U.K. Activities of Japanese Banks: 1980-1988
29
AUTHOR(s)
Jaime Marquez Neil R. Ericsson
Catherine L. Mann
Eric M. Leeper
Ross Levine
Catherine L. Mann
Deborah Danker Peter Hooper
Joseph E. Gagnon Andrew K. Rose
Steven B. Kamin
Joseph E. Gagnon
Guy V.G. Stevens
Richard A. Meese Andrew K. Rose Wilbur J. Coleman II Andrew K. Rose
Jonathan D. Ostry
Garry J. Schinasi
Garry J. Schinasi Joseph E. Gagnon
Catherine L. Mann Henry S. Terrell
Robert S. Dohner Barbara R. Lowery
Cite this document
Beth Ingram and Eric M. Leeper (1990). Post Econometric Policy Evaluation: A Critique (IFDP 1990-393). Board of Governors of the Federal Reserve System, International Finance Discussion Papers. https://whenthefedspeaks.com/doc/ifdp_1990-393
@techreport{wtfs_ifdp_1990_393,
author = {Beth Ingram and Eric M. Leeper},
title = {Post Econometric Policy Evaluation: A Critique},
type = {International Finance Discussion Papers},
number = {1990-393},
institution = {Board of Governors of the Federal Reserve System},
year = {1990},
url = {https://whenthefedspeaks.com/doc/ifdp_1990-393},
abstract = {An increasingly popular approach to policy evaluation involves applying the parameters calibrated for a real business cycle model that does not include policy to a different model, where policy does affect private decisions. This technique, in effect, estimates a model that misspecifies how private behavior depends on policy. The calibrated parameters depend on policy behavior, but calibrators overlook this dependence when projecting policy effects. This procedure repeats the "Keynesian" errors that Lucas (1976) noted in his influential critique of (then) standard methods of econometric policy evaluation and produces predictions of policy consequences that may be no more useful than ones from traditional econometric models.},
}