feds · February 28, 2011

How Useful are Estimated DSGE Model Forecasts

Abstract

DSGE models are a prominent tool for forecasting at central banks and the competitive forecasting performance of these models relative to alternatives--including official forecasts--has been documented. When evaluating DSGE models on an absolute basis, however, we find that the benchmark estimated medium scale DSGE model forecasts inflation and GDP growth very poorly, although statistical and judgmental forecasts forecast as poorly. Our finding is the DSGE model analogue of the literature documenting the recent poor performance of macroeconomic forecasts relative to simple naive forecasts since the onset of the Great Moderation. While this finding is broadly consistent with the DSGE model we employ--ie, the model itself implies that under strong monetary policy especially inflation deviations should be unpredictable--a "wrong" model may also have the same implication. We therefore argue that forecasting ability during the Great Moderation is not a good metric to judge the usefulness of model forecasts.

Finance and Economics Discussion Series Divisions of Research & Statistics and Monetary Affairs Federal Reserve Board, Washington, D.C. How Useful are Estimated DSGE Model Forecasts Rochelle M. Edge and Refet S. Gurkaynak 2011-11 NOTE: Staff working papers in the Finance and Economics Discussion Series (FEDS) are preliminary materials circulated to stimulate discussion and critical comment. The analysis and conclusions set forth are those of the authors and do not indicate concurrence by other members of the research staff or the Board of Governors. References in publications to the Finance and Economics Discussion Series (other than acknowledgement) should be cleared with the author(s) to protect the tentative character of these papers.

How Useful are Estimated DSGE Model Forecasts?∗ Rochelle M. Edge Refet S. Gu¨rkaynak Federal Reserve Board Bilkent University January 18, 2011 Abstract DSGE models are a prominent tool for forecasting at central banks and the competitive forecasting performance of these models relative to alternatives–including official forecasts–has been documented. When evaluating DSGE models on an absolute basis, however, we find that the benchmark estimated medium scale DSGE model forecasts inflation and GDP growth very poorly,althoughstatisticalandjudgmentalforecastsforecastaspoorly. OurfindingistheDSGE model analogue of the literature documenting the recent poor performance of macroeconomic forecasts relative to simple naive forecasts since the onset of the Great Moderation. While this finding is broadly consistent with the DSGE model we employ–ie, the model itself implies that understrongmonetarypolicyespeciallyinflationdeviationsshouldbeunpredictable–a“wrong” model may also have the same implication. We therefore argue that forecasting ability during the Great Moderation is not a good metric to judge the usefulness of model forecasts. ∗WearegratefultoBurc¸inKısacıkog˘luforoutstandingresearchassistancethatwentbeyondthecallofduty. We thank Harun Alp, Selim Elekdag˘, Jeff Fuhrer, Marvin Goodfriend, Fulya O¨zcan, Jeremy Rudd, Frank Smets, Peter Tulip, Raf Wouters, and Jonathan Wright as well as seminar participants at Bilkent, the Brookings Panel, Central Bank of Turkey, Geneva Graduate Institute, GWU, Johns Hopkins, METU and PSE for very useful comments and suggestions. We thank Ricardo Reis, David Romer, Chris Sims and Justin Wolfers for several rounds of detailed feedback and also thank Volker Wieland and Maik Wolters for allowing us to cross check our data with theirs. This paper uses Blue Chip Economic Indicators and Blue Chip Financial Forecasts: Blue Chip Economic Indicators and Blue Chip Financial Forecasts are publications owned by Aspen Publishers. Copyright (C) 2010 by Aspen Publishers,Inc. Allrightsreserved. http://www.aspenpublishers.com. Theviewsexpressedhereareourownanddo not necessarily reflect the views of the Board of Governors or the staff of the Federal Reserve System.

1 Introduction Dynamic stochastic general equilibrium (DSGE) models were descriptive tools at their inception. They were useful because they allowed economists to think about business cycles and carry out hypothetical policy experiments in Lucas critique proof frameworks. In their early form, however, they were viewed as too minimalistic to be appropriate for use in any practical application–such as macroeconomic forecasting–for which a strong connection to the data was needed. The seminal work of Smets and Wouters (2003, 2007), however, changed this perception. In particular, their demonstration of the possibility of estimating a much larger and richly-specified DSGE model (similar to that developed by Christiano, Eichenbaum, and Evans, 2005) as well as their finding of a good forecast performance of their DSGE model relative to competing VAR and Bayesian VAR (BVAR) models led DSGE models to be taken more seriously by central bankers around the world. Indeed, estimated DSGE models are now quite prominent tools for macroeconomic analysis at many policy institutions with forecasting being one of the key areas where these models are used, in conjunction with other forecasting methods. ReflectingthisuseofDSGEmodels,severalcentral-bankmodelingteamshaveinrecentresearch evaluated the relative forecasting performance of their institutions’ estimated DSGE models. Notably, inadditiontoconsideringtheirDSGEmodels’forecastsrelativetotimeseriesmodelssuch as BVARs (as Smets and Wouters did), these papers also consider official central bank forecasts. For the U.S., Edge, Kiley, and Laforte (2010) compare the Federal Reserve Board’s DSGE model’s forecasts to alternatives such as those generated in pseudo real time by time series models as well as official Greenbook forecasts and find that the DSGE model forecasts are competitive with, and indeed often better than, others.1 This is an especially notable finding given that previous analyses havedocumentedthehighqualityoftheFederalReserve’sGreenbookforecasts(RomerandRomer, 2000, Sims, 2002). We began writing this paper with the aim of establishing the marginal contributions of statistical, judgmental and DSGE model forecasts to efficient forecasts of key macroeconomic variables, such as GDP growth and inflation. “How much importance should central bankers attribute to model forecasts on top of judgmental or statistical forecasts?” was the question we wanted to answer. To do this, we first evaluated the forecasting performance of the Smets- Wouters(2007)model–apopularbenchmark–forU.S.GDPgrowth,inflationandinterestrates,and comparedtheseforecaststothoseofaBVARandtheFRBstaff’sGreenbookforecasts. Importantly, 1Other examples with similar findings include, Adolfson et al. (2007) for the Riksbank’s DSGE model and Lees etal. (2007)fortheRBNZ’sDSGEmodel. Inaddition, Adolfsonetal. (2006)andChristoffeletal. (2010)examine out-of-sample forecast performance for DSGE models of the euro area although the focus of these papers is much more on technical aspects of model evaluation. 2

toensurethatthesameinformationisusedtogenerateourDSGEmodelandBVARmodelforecasts as was used to formulate the Greenbook forecasts, we used real time data and re-estimated the model at each Greenbook forecast date. In line with the results in the DSGE model forecasting literature, we found that the root mean squared errors (RMSEs) of the DSGE-model forecasts were similar to, and often better than, those of the BVAR and Greenbook forecasts. Our surprising finding was that unlike what one would expect when told that the model forecast is better than that of the Greenbook, the DSGE model in anabsolutesensedidaverypoorjobofforecasting. TheGreenbookandtimeseriesmodelforecasts similarly did not capture much of the realized changes in GDP growth and inflation in our sample, 1992to2004. Thereisamoderateamountofnowcastingabilityandthenalmostnothingbeginning with one quarter ahead forecasts. Thus, the forecast comparison is not one of one good forecast relative to another; all three methods of forecasting are poor and combining them does not lead to much improvement either. ThisfindingreflectsthechangednatureofmacroeconomicfluctuationsintheGreatModeration period. For example, Stock and Watson (2007) have shown that since the Great Moderation, the permanent (forecastable) component of inflation, which had earlier dominated, has diminished such that the inflation process more recently has been largely influenced by the transitory (unforecastable) component. An analogous point for GDP has been made by Tulip (2009). Data availability prevents us from answering the question of whether the forecasting ability of estimated DSGE models has worsened with the Great Moderation. We do, however, address the question of whether these models’ forecasting performance are in an absolute sense poor and we find that they are. A key point we make in this paper is that forecasting ability is not always a good criteria for a model’s success. As we discuss in more detail below, DSGE models of the class we consider often imply that under a strong monetary policy rule there should not be much forecastability. In other words, when there is not much to be forecasted in the observed out of sample data, as is the case in the Great Moderation period, a “wrong” model will fail to forecast, but so will a “correct” model. Consequently, it is entirely possible that a model that is unable to forecast, say inflation, will nonetheless provide reasonable counterfactual scenarios, which is ultimately the main purpose of the DSGE models. The remainder of the paper is organized as follows. Section two describes the different forecasting methods that we will consider in this paper, including those generated by the Smets and Wouters (2007) DSGE model, the Bayesian VAR model, the Greenbook, and the Blue Chip consensus forecast. The Blue Chip is an additional forecast that we consider primarily because there is a five-year delay in the public release of Greenbook forecasts and we want to consider the 3

most recent recession. Section three then describes the data that we use, which as noted is realtime to ensure that the same information is used to generate our DSGE model and BVAR model forecasts as was used to formulate the Greenbook and Blue Chip forecasts. Section four describes and presents the results for our forecast comparison exercises while section five discusses them. Section six considers robustness analysis and extensions. In particular we show in this section that judgmental forecasts have adjusted faster to capture the developments during the Great Recession. Section seven concludes. A contribution of this paper is the construction of real-time data sets using data vintages that match Greenbook forecast dates and Blue Chip forecast dates. The appendix describes the construction of this data in detail.2 2 Forecast Methods In this section we briefly review the four different forecasts that we will later consider. These forecasts are a DSGE model forecast, a Bayesian VAR model forecast, the Federal Reserve Board’s Greenbook forecast, and the Blue Chip Consensus forecast. 2.1 DSGE Model The DSGE model that we use in this paper is exactly that of Smets and Wouters (2007) and the description of the model given here quite closely follows the description presented in section one of Smets and Wouters (2007) and section two of Smets and Wouters (2003). The Smets and Wouters model is an application of a real business cycle model (in the spirit of King, Plosser, and Rebelo, 1988) to an economy with sticky prices and sticky wages. In addition to nominal rigidities, the model also contains a large number of real rigidities–specifically habit formation in consumption, costs of adjustment in capital accumulation, and variable capacity utilization–that ultimately appear to be necessary to capture the empirical persistence of U.S. macroeconomic data. The model consists of households, firms, and a monetary authority. Households maximize a non-separable utility function with goods and labor effort as its arguments over an infinite life horizon. Consumption enters the utility function relative to a time-varying external habit variable and labor is differentiated by a union. This assumed structure of the labor market enables the household sector to have some monopoly power over wages. This implies a specific wage-setting 2Allofthedatausedinthispaper, excepttheBlueChipmedianforecastswhichareproprietary, areavailableat http://www.bilkent.edu.tr//refet/research.html 4

equation that in turn allows for the inclusion of sticky nominal wages, modeled following Calvo (1983). Capital accumulation is undertaken by households, who then rent capital to economy’s firms. Inaccumulatingcapitalhouseholdsfaceadjustmentcosts,specificallyinvestmentadjustment costs. As the rental price of capital changes, the utilization of capital can be adjusted, albeit at an increasing cost. The firms in the model rent labor and capital from households (in the former case via a union) to produce differentiated goods for which they set prices, with Calvo (1983) price stickiness. These differentiated goods are aggregated into a final good by different (perfectly competitive) firms in the model and it is this good that is used for consumption and accumulating capital. The Calvo model in both wage and price setting is augmented by the assumption that prices that are not reoptimized are partially indexed to past inflation rates. Prices are therefore set in reference to current and expected marginal costs but are also determined, via indexation, by the past inflation rate. Marginal costs depend on the wage and the rental rate of capital. Wages are set analogously as a function of current and expected marginal rates of substitution between leisure and consumption and are also determined by the past wage inflation rate due to indexation. The model assumes a variant of Dixit-Stiglitz aggregation in the goods and labor markets following Kimball (1995). This aggregation allows for time-varying demand elasticities, which allows more realistic estimates of price and wage stickiness. Finally, the model contains seven structural shocks, which is equal to the number of observables used in estimation. The model’s observable variables are the log difference of real per capita GDP, real consumption, real investment, real wage, log hours worked, log difference of the GDP deflator, and the federal funds rate. These series, and in particular their real time sources, are discussed in detail below. In estimation, the seven observed variables are mapped into 14 model variables by the Kalman filter. Then 36 parameters (17 of which belong to the seven ARMA shock processes in the model) are estimated via Bayesian methods (while 5 parameters are calibrated). It is the combination of the Kalman filter and Bayesian estimation which allows this large (although technically called a medium scale) model to be estimated rather than calibrated. In estimation we use exactly the same priors as Smets and Wouters (2007) as well as using the same data series. Once the model is estimated for a given data vintage, forecasting is done by employing the posterior modes for each parameter. The model can produce forecasts for all model variables but we only use the GDP growth, inflation and interest rate forecasts. 5

2.2 Bayesian VAR TheBayesianVARis, initsessence, asimpleforecastingVAR(4). Thesamesevenobservableseries that are used in the DSGE model estimation are used in the VAR. Having seven variables in a four lag VAR leads to a large number of parameters to be estimated which leads to over-fitting and poor out-of-sample forecast performance problems. The solution is the same as for the DSGE model. Priors are assigned to each parameter (and the priors we use are again those of Smets and Wouters, 2007) and the data are used to update these in the VAR framework. Similar to the DSGE model, the BVAR is estimated at every forecast date using real time data and forecasts are obtained by utilizing the modes of the posterior densities for each parameter. BoththejudgmentalforecastandtheDSGEmodelhaveanadvantageoverthepurelystatistical model,theBVAR,inthatthepeoplewhoproducetheGreenbookandBlueChipforecastsobviously know a lot more than seven time series and the DSGE model was built to match the data that is being forecast. That is, judgment also enters the DSGE model in the form of modeling choices. To help the BVAR overcome this handicap it is customary to have a training sample–to estimate the model with some data and use the posteriors as priors in the actual estimation. Following Smets and Wouters (2007) we also “trained” the BVAR with data from 1955-1965 but, in an a sign of how different the early and the late parts of the sample are, found that the performance of the trained and untrained BVAR are comparable. We therefore report results from the untrained BVAR only. 2.3 Greenbook The Greenbook forecast is a detailed judgmental forecast that until March 2010 (after which it becameknownastheTealbook)wasproducedeighttimesayearbystaffattheBoardofGovernors.3 The specific dates of when each Greenbook forecast is produced – and hence the data availability of each round – is somewhat irregular since the Greenbook is made specifically for each Federal Open Market Committee (FOMC) meeting and the timings of FOMC meetings are themselves somewhat irregular. Broadly speaking FOMC meetings take place at an approximate six-week interval (although they tend to be further apart at the beginning of the year and closer together at the end of the year). The Greenbook is generally closed about one week before the FOMC meeting takes place so as to allow FOMC members, and their staffs, enough time to review, analyze and critique the document. Importantly–and unlike several other central banks–the Greenbook forecast reflects the view of the staff and not the members of the FOMC. Greenbook forecasts are formulated subject to a set of assumed paths for financial variables, 3The renaming of the Federal Reserve Board’s main forecasting document reflected a reorganization and combination and the original Greenbook and Bluebook. Throughout this paper we will continue to refer to the FRB’s main forecasting document as the Greenbook. 6

such as the policy rate, key interest rates, and stock market wealth. Over time there has been some variation in the way these assumptions have been set. For example, as can be seen from the Greenbook federal funds rate assumptions reported in the Philadelphia Fed’s Real-Time Data Set for Macroeconomists, from about the middle of 1990 to the middle of 1992 an essentially constant path of the federal funds rate was assumed in making the forecast.4 In other periods, however, the path of the federal funds rate does vary, reflecting a conditioning assumption about the path of monetary policy consistent with the forecast. Asisthecaseformostjudgmentalforecasts,themaximumprojectionhorizonfortheGreenbook forecastvintagesisnotconstantandvaries fromtentosixquartersdependingontheforecastround. The July/August round of each year has the shortest projection horizon of any forecast round. It extendssixquarters: Thecurrent(third)quarterandthenext(fourth)quarterandallfourquarters of the following year. In the September round of each year, the staff extend the forecast to include the year following the next in the projection period. Since the third quarter is not yet finished at the time of the September forecast, that quarter is still included in the Greenbook projection horizon and so in total the horizon is ten quarters–the longest horizon for any forecast round. The end-point of the projection horizon remains fixed for subsequent forecasts as the starting point movesforward. ThisleavestheJuly/Augustforecastroundwithonlyasix-quarterforecasthorizon. In our analysis, we consider a maximum forecast horizon of eight quarters because the number of observations for nine and ten quarters is very small. Of course, the number of observations for a forecast horizons of seven and eight quarters (which we do consider) will be smaller than the number of observations for horizons of six quarters and less. We use the forecasts produced for the FOMC meetings starting in January 1992 and ending in December 2004. Our forecast-vintage start date represents when the GDP, rather than GNP, became the key indicator of economic activity. This is not a critical limitation since GNP forecasts can clearly be used for earlier vintages. The end date was chosen by necessity: Greenbook forecasts are made public only with a 5-year lag. The first two columns in Appendix Tables 1 to 13 provide detailed information on the dates of Greenbook forecasts we use and the horizons covered in each forecast. Note that the first four Greenbook forecasts that we consider fall in the episode of when the policy rate was assumed to remain flat throughout the projection period. 2.4 Blue Chip The Blue Chip Economic Indicators are a monthly poll of the forecasts for U.S. economic growth, inflation, interest rates, and a range of other key variables of approximately 50 banks, corporations, and consulting firms. The Blue Chip poll is taken on about the 4th or 5th of the month and the 4See http://www.philadelphiafed.org/research-and-data/real-time-center/greenbook-data/. 7

forecasts are published on the 10th day of each month. A consensus forecast, which is equal to the median of the individual reported forecasts, is then reported along with the average of the top 10 and bottom 10 forecasts for each variable. In our analysis we use only the consensus forecast. As with the Greenbook, the Blue Chip forecast horizons are not constant across forecast rounds and in the case of the Blue Chip the forecast horizons are uniformly shorter. The longest forecast horizon in the Blue Chip is nine quarters. This is for the January round for which a forecast is made for the year to come and the next one, but for which the forth quarter of the previous year is not yet available and is also “forecast.” The shortest forecast horizon in the Blue Chip is five quarters. This is for the November and December rounds for which a forecast is made for the current (fourth) quarter and the following year. We use the Blue Chip consensus forecasts over the period January 1992 to September 2009. The start date for the Blue Chip corresponds to the start date for the Greenbook. The end date is one year prior to the time of writing. 3 Data and Sample In this section we provide a brief overview of the data involved in the forecasting process and our sample period. A detailed appendix presents sources and information on how the raw data is converted to the form used in estimation. The data we use for the estimation of the Smets-Wouters DSGE model and the BVAR model are the same seven series used by Smets and Wouters (2007) but pulled for the real time vintages of each series at each forecast date. Our forecast dates coincide with either the dates of Greenbook forecastsorthoseoftheBlueChipforecasts. Thatis,ateachGreenbookorBlueChipforecastdate, we use the data that was available on that date to estimate the DSGE model and the BVAR.5 We then generate forecasts out to eight quarters. From the data perspective, the last known quarter is the previous one, therefore the one quarter ahead forecast is the nowcast (and the n quarter ahead forecast corresponds to n−1 quarters ahead counting from the forecast date.). This convention is also the case for Greenbook and most Blue Chip forecasts.6 We will evaluate the forecasts for real per capita GDP growth, GDP deflator inflation and the 5See the appendix for exceptions to this. There are a few instances where one of the variables from the last quarter is not released yet on a Greenbook forecast date. In these instances we help the DGSE and BVAR forecasts byappendingtheFRBstaffbackcastofthatdatapointtothetimeseries. Thatsaid,inthesecircumstancesweverify thatdoingsodoesnotinfluenceourresultsbydroppingtheseforecastobservationsfromouranalysisandre-running our results. 6The exception for the Blue Chip forecasts are the January, April, July, and October forecasts. These typically takeplacesoearlyinthequarterthannoorlittledatafortheprecedingquarterisavailable. Fortheseforecaststhe previous quarter is considered the nowcast. 8

short (policy) rate. GDP growth and inflation are in terms of non-annualized quarter-on-quarter rates, while interest rates are in levels. Our main focus will be on inflation forecasts because this is theforecastthatisthemostcomparableacrossthedifferentforecastingmethods. TheDSGEmodel andtheBVARproducecontinuous(andinveryrecentperiodsnegative)interestrateforecastswhile judgmental forecasts obviously factor in the discrete nature of the interest rate setting and the zero nominal bound. Furthermore, the Blue Chip forecasts do not contain forecasts of the federal funds rate and hence we cannot do robustness checks for the interest rates or use the longer sample for this variable. The issue about GDP growth is more subtle. The DSGE model is based on per capita values andproducesapercapitaGDPgrowthforecast. TheBVARsimilarlyusesandproducespercapita values. On the other hand, GDP growth itself is announced in aggregate terms and Greenbook and Blue Chip forecasts are in terms of aggregate growth. Thus, one has to either convert the aggregate growth rates to per capita values by dividing them by realized population growth rates, or convert per capita values to aggregate forecasts by multiplying them with realized population growth numbers. The two methods should produce similar results and the fact that the model uses per capita data should make little difference as population growth is a smooth series with little variance. However, the population numbers reported by the Census Bureau and used by Smets and Wouters (and work following them) has a number of extremely sharp spikes caused by census picking up previously uncaptured population levels as well as CPS rebasings. The spikes are there because the data is not revised backwards; that is, population growth is placed in the quarter that uncaptured population is measured, not across any estimate of the quarters over which it more likely occurred. In this paper we used the population series used by Smets and Wouters in estimating the model because we realized the erratic behavior of the population series after our estimation and forecast exercisewascomplete. (Weestimatethemodelmorethan300times,whichtookabouttwomonths, and did not have the time to re-estimate and re-forecast using the better population series.) We note the violence this does to the model estimates and encourage future researchers to smooth the population series before using that data to obtain per capita GDP. Here, we adjust the DSGE model and BVAR forecasts using the realized future population growth numbers to make them comparable to announced GDP growth rates and judgmental forecasts but we again note that this is an imperfect adjustment which likely hurts the DSGE model and BVAR forecasts.7 7We also experimented with converting the realized aggregate GDP growth numbers and Blue Chip forecasts to per capita values using the realized population growth rates, and converting the Greenbook GDP growth forecast intopercapitavaluesbyusingtheFedstaff’sinternalpopulationforecast. ThisessentiallygivesBlueChipforecasts perfect foresight about the population component of per capita GDP, helping it quite a lot in forecasting because the variance of the population series is high, and hurts the Greenbook GDP forecast a lot because the Fed staff population growth estimate is a smooth series. Those results are available upon request. 9

We estimate the models (DSGE and BVAR) with data going back to 1965 and do the first forecast on January 1992. The Greenbook forecasts are embargoed for five years, therefore our last forecast is in 2004:Q4, forecasting the period out to 2006:Q3. There are two scheduled FOMC meetings per quarter and thus all of our forecasts that are compared to the Greenbook are made twice a quarter. This has consequences for correlated forecast errors, as explained in the next section. For Blue Chip forecasts, the forecasting period ends in 2010:Q1, the last quarter for which we know the realized values of variables of interest. Blue Chip forecasts are published monthly and we produce a separate set of real time DSGE and BVAR model forecasts coinciding with the Blue Chip publication dates. We should note that, while not identical, our sample, 1992 to 2004 for Greenbook comparisons, is similar to the ones used in previous studies of forecast ability of DSGE models, such as Smets- Wouters (2007), who use 1990 to 2004, and Edge et al. (2010) who use 1996 to 2002. It is also important to note again that the sample is in the Great Moderation period, after the long disinflation was complete, and that most of the period corresponds to a particularly transparent monetary policy making episode, with the FOMC signalling likely policy actions in the near future with statements accompanying releases of interest rate decisions. 4 Forecast Comparison We distinguish between two types of forecast evaluations. Given a variable to be forecasted, x, and its h-period ahead forecast (made h-periods in the past) by method y, xh, one can compute the (cid:98)y root mean square error of the real time forecasts (cid:118) (cid:117) T RMSExh = (cid:117) (cid:116) 1 (cid:88)(cid:0) x −xh (cid:1)2 . (1) y T t (cid:98)y,t t=1 Comparing the root mean square errors across different forecast methods, a policy maker can then choose the method with the smallest RMSE to use. The RMSE comparison therefore answers the decision theory question: Which forecast is the best and should be used? To our knowledge, all of the forecast evaluations of DSGE models so far (Smets and Wouters 2007, Edge et al. 2010, and those mentioned earlier for other countries) have used essentially this metric–and concluded that the model forecasts do well. In Figure 1 we carry out this exercise with real time data and show the RMSE of the DSGE model forecasts for inflation and GDP growth relative to those of the Greenbook and BVAR forecasts at different horizons. This figure visually conveys a result that Smets and Wouters and Edge et al. have shown earlier: except for very short horizon inflation forecasts (where the 10

Greenbookforecastsarebetter)theDSGEmodelforecastshavethelowestRMSEforbothinflation and growth. The literature has taken this finding as both a vindication of the estimated medium scaleDSGEmodel,andasasignthatthesemodelscanbeusedforforecastingaswellasforpositive analysis of counterfactuals and for optimal policy questions. While Figure 1 indeed shows that the DSGE model has the best forecasting record among the three forecasting methods we consider, it does not offer any clues about how good the “best” is. To furtherevaluatetheforecasts, wefirstlookinFigure2atthescatterplotsofthe fourquarterahead forecasts (a horizon that the DSGE model outperforms the Greenbook and BVAR ) of inflation and GDP growth from the DSGE model and the realized values of these variables. With a good forecast performance, the observations should lie on the 45-degree line. The scatter plots shown in Figure 2 are surprising. For both variables, the points form clouds rather than 45-degree lines, suggesting that the four quarter ahead forecast of the DSGE model is quite unrelated to the realized value. To get the full picture, we run a standard forecast efficiency test (see Gu¨rkaynak and Wolfers, 2007, for a discussion of tests of forecast efficiency and further references) and estimate x = αh+βhxh +εh . (2) t y y(cid:98)y,t y,t A “good” forecast should have an intercept of zero, a slope coefficient of one, and a high R2. If the intercept is different from zero the forecast has on average been biased, if the slope is different from one, the forecast has consistently under or over predicted deviations from the mean, and if the R2 islowthenlittleofthevariationofthevariabletobeforecastediscapturedbytheforecast. Note that especially when the point estimates of αh and βh are different from zero and one, respectively, y y the R2 is a more charitable measure of the success of the forecast than the RMSE calculated in (1) as the errors in (2) are residuals obtained from the best fitting line. That is, a policy maker would make errors of size εh only if she knew the values of αh and βh and adjusted xh with these. The y,t y y (cid:98)y,t R2 that is comparable to the RMSE measures calculated in (1) would be that implied by equation (2) with αh and βh constrained to 0 and 1, respectively. y y Tables 1 to 3 show the estimation results of (2) for the DSGE model, BVAR and Greenbook forecasts of inflation, GDP growth and interest rates, respectively.8 The table suggests that forecastsofinflationandGDPgrowthhavebeenverypoorbyallmethods,exceptfortheGreenbook inflation nowcast. The DSGE model inflation forecasts have about zero R2 for forecasts of the next quarter and beyond, and slope coefficients very far away from unity. GDP growth forecasts are likewise capturing less than 10 percent of the actual variation in growth and point estimates of the 8The standard errors reported are Newey-West standard errors for 2∗h lags, given there are two forecasts made in each quarter. Explicitly taking the clustering at the level of quarters–as the forecasts made in the same quarter maybecorrelated–intoaccountmadenoperceptibledifference. Neitherdidusingonlythefirstorsecondforecastin each quarter. 11

slopes are again away from unity. Except for the Greenbook nowcast, the results are very similar for the judgmental forecast and the BVAR forecasts. Allthreeforecastmethods,however,doimpressivelyinforecastinginterestrates(Table3). This is surprising as short rates should be a function of inflation and GDP, and thus should not be any more forecastable than these two variables, except for the forecastability coming from interest rate smoothing by policy makers. The issue here is that the interest rate is highly serially correlated, which makes it easy to forecast. (Indeed, in our sample the level of the interest rate behaves like a unit root process as verified by an unreported ADF test.)9 Thus, Table 3 is possibly showing long-run cointegrating relationships rather than short-run forecasting ability. We therefore follow Gu¨rkaynak, Sack, and Swanson (2005) in studying at the change in the interest rate rather than its level. Table 4 shows the interest rate change forecast evaluations for the three methods. The forecast success is now more comparable to inflation and GDP growth forecasts, although in the short run there is quite high forecastability in interest rate changes. The very strong nowcasting ability of the Greenbook partly comes from the fact that while the Fed staff know interest rates changes in integer multiples of 25 basis points, while BVAR and the DSGE model produce continuous interest rate forecasts. The panels of Figure 2 and Tables 1 to 4 collectively show that while the DSGE model forecasts are comparable and often better than Greenbook and BVAR forecasts, this is a comparison of very poor forecasts to each other. To provide a benchmarks for forecast quality, we introduce a constant and a random walk forecast and ask the following two questions. First, if a policy maker could have used one of these three forecasts over the 1992-2006 period or could have access to the actual mean of the series over the same period and used that as a forecast (and zero change as the interest rate forecast at all horizons) how would the root mean square errors compare? Second, how large would the root mean square errors be if the policy maker used the last observation on each date as the forecast for all horizons, essentially treating the series to be forecast as random walks?10 WeshowtheactuallevelsoftherootmeansquareerrorsinFigure3. Theconstantforecastdoes about as well as the other forecasts, and often better, suggesting that the DSGE model, BVAR and Greenbook forecasts are not accomplishing much. It is some relief, however, that the DSGE model forecast usually does better than the random walk forecast, an often used benchmark.11 But notice 9While nominal interest rates cannot theoretically be simple unit root processes due to the zero nominal bound, they can be statistically indistinguishable from unit root processes in small samples and pose their econometric difficulties. 10In the random walk forecasts we set the interest rate change forecasts to zero. That is, in this exercise the assumed policy maker treats the level of the intertest rate as a random walk. 11We also looked at how the DSGE model forecast RMSEs compare to other forecast RMSEs statistically (results availablefromtheauthors). TheDiebold-MarianotestresultsshowthatforinflationtheRMSEoftheDGSEmodel 12

that the random walk RMSEs are very large. To understand the quantities involved, observe that the 6-quarter ahead inflation forecast RMSE of the DSGE model is about 0.25 in quarterly terms. This would be about one percent annualized and would lead to a 95 percent confidence interval that is 4 percentage points wide. That is not very useful for policy making. 5 Discussion Our findings are surprising, especially for inflation, given the Romer and Romer (2000) finding that the Greenbook is an excellent forecaster of inflation at horizons out to eight quarters. Figure 4 shows the reason of the difference. The Romer and Romer sample covers a period when inflation had a large swing. Our sample–and the sample used in other studies for DSGE model forecast evaluations–covers a period where inflation behaves more as i.i.d. deviations around a constant level. That is, there is little to be forecasted over our sample. This finding is in line with Stock and Watson’s (2007) result that after the Great Moderation, the permanent (forecastable) component of inflation, which had earlier dominated, diminished in importance and the bulk of the variance of inflation began to be driven by the transitory (unforecastable) component. It is therefore not surprising that no forecasting method does well. Trehan(2010)showsthatasimilarlackofforecastabilityisalsoevidentintheSurveyofProfessional Forecasters and the Michigan Survey. Atkeson and Ohanian (2001) document that over the period 1984 to 1999 a random-walk forecast of four-quarter ahead inflation outperforms the Greenbook forecast as well as Phillips curve models. (But note that here we find that the DSGE model, with a sophisticated microfounded Phillips curve, outperforms the random walk forecast.) Fuhrer et al.(2009) show that this is due to the parameter changes in the inflation process that have occurred with the onset of the Great Moderation. For forecasts of output growth, Tulip (2009) documents a notably larger reduction in actual output growth volatility following the Great Moderation relative tothereductioninGreenbookRMSEs,thusindicatingthatmuchofthereductioninoutput-growth volatility has stemmed from the predictable component–that is, the part that can potentially be forecast. Reifschneider and Tulip (2009) perform a wide reaching analysis of institutional forecasts– specifically, the Greenbook, the SPF and the Blue Chip, as well as forecasts produced by the Congressional Budget Office and the Administration–for real GDP (or GNP) growth, the unemployment rate, and CPI inflation. Although they do not consider changes in forecast issignificantlylowerthanthoseoftheBVARandtherandomwalkforecastsformostmaturities,isindistinguishable fromtheRMSEoftheGreenbookandishigherthanthatoftheconstantforecastforsomematurities;whileforGDP growth the DSGE model RMSE is statistically lower than those of the BVAR and the random walk forecasts and is indistinguishable from the RMSEs of the Greenbook and the constant forecasts. 13

performance associated with the Great Moderation their analysis, which is undertaken for the post-1986 period, finds overwhelmingly that errors for all institutional forecasts are large. More broadly D’Agostino and Giannone (2006) also consider a range of time series forecasting models, including univariate AR models, factor augmented AR models, and pooled bivariate forecasting models, as well as institutional forecasts–that is, the Greenbook forecast and the forecasts from the SPF–and document that while RMSEs for forecasts of real activity, inflation, and interest rates have dropped notably with the Great Moderation, time series and institutional forecasts have also largely lost their ability to improve on a random walk. Faust and Wright (2009) similarly note that performances of some of the forecasting methods they consider improves when data from periods preceding the Great Moderation is included in the sample. We would argue that DSGE models should not be judged solely by their (lack of) absolute forecast abilities. Previous authors, such as, Edge et. al (2010), were conscious of the declining performanceofGreenbookandtimeseriesforecastswhentheyperformedtheircomparisonexercises but took as given the fact that staff at the Federal Reserve Board are required to produce forecasts ofthemacroeconomyeighttimesayear. Moreprecisely,theyaskedwhetheraDSGEmodelforecast should be introduced into the mix of inputs used to arrive at the final Greenbook forecast. In this caserelativeforecastperformanceisarelevantpointofcomparison. Anotheraspectofcentralbank forecasting that is important to note is that of “story telling.” That is, not only are the values of the forecast variables important but so too is the narrative explaining how present imbalances will be unwound as the macroeconomy moves toward the balanced growth path. A well thought out and much scrutinized story accompanies the Greenbook forecast but is not something present in reduced-form time series forecasts. An internally consistent and coherent narrative is, however, implicit in a DSGE model forecast, indicating that these models can also contribute along this important dimension of forecasting. In sum, what do these findings say about the quality of DSGE models as a tool for telling internally consistent, reasonable stories for counterfactual scenarios? Not much. Inflation being unforecastable is a prediction of basic sticky price DSGE models when monetary policy responds aggressively to inflation. Goodfriend and King (2009) make this point explicitly using a tractable model. Ifinflationisforecastedtobehigh,policymakersincreaseinterestratesandreinininflation. Thus,inflationisneverpredictablydifferentfromthe(implicit)targetandallofthevariationcomes from unforecastable shocks. In models lacking real rigidities the divine coincidence will be present, which means that the output gap will have the same property of unforecastability. Thus, it is well possible that the model is “correct” and therefore cannot forecast cyclical fluctuations but the counterfactual scenarios produced by the model can still inform policy discussions.12 12Although see Gali (2010) about difficulties inherent in generating counterfactual scenarios using DSGE models. 14

Of course, the particular DSGE model we employ in this paper does not have the divine coincidenceduetotherealrigiditiesitincludes,suchasarealwagerigidityduetohavingbothsticky pricesandstickywages. Moreoverbecauseinthismodelthereisatrade-offbetweenstabilizingprice inflation, wage inflation, and the output gap, optimal policy is not characterized by price-inflation stabilization and therefore unforecastable price inflation. Nonetheless, price-inflation stabilization isapossiblepolicy,whichcouldbepursuedevenifnotoptimal,andthiswouldimplyunforecastable inflation. That said, this policy would likely not stabilize the output gap, so implying some forecastability of the output gap. Ultimately, whether, and to what extent, the model implies (un)forecastable fluctuations in inflation and GDP growth can be learned by simulating data from the model calibrated under different monetary policy rules and performing forecast exercises on the simulated data. We note the qualitative model implication that there should not be much predictability, especially for inflation, and leave the quantitative study to future research. Note also that our discussion here has focused on the forecastability of the output gap, not output growth, which is ultimately the variable of interest in our forecast exercises. Unforecastability of the output gap may not imply unforecastability of output growth. Finally,wewouldnotethatareducedformmodelwithanassumedinflationprocessthatisequal to a constant with i.i.d. deviations–i.e. a “wrong” model–will also have the same unforecastability implication. Thus evaluating forecasting ability during a period such as the Great Moderation, when no method is able to forecast, is not a test of the empirical relevance of a model. 6 Robustness and Extensions To verify that our results are not specific to the relatively short sample we have used and to the Greenbook date vintages we employed, we repeated the exercise using Blue Chip forecasts as the judgmental forecast for the 1992-2010 period. (This also has the advantage of adding the Great Recession period to our sample.) We also estimated the DSGE model and the BVAR using data vintages of Blue Chip publication dates and produced forecasts. WedonotdisplaytheanaloguesofFigures1to3andTables1to4forbrevitybutnotethatthe findings are very similar when Blue Chip forecasts replace Greenbook forecasts and the sample is extended to 2010, encompassing the financial crisis episode. (One difference is that the Blue Chip forecast has nowcasting ability for GDP as well as inflation.) The DSGE model forecast is similar to the judgmental forecast and is better than the BVAR in the RMSE sense for almost all horizons, but all three forecasts are very poor forecasts. (This exercise omits the forecasts of interest rates as Blue Chip does not include forecasts of the overnight rate.) The longer sample allows us to answer some interesting questions and provide further robustness checks. 15

Although we use quarter over quarter changes and not annual growth rates for all of our variables, overlapping periods in long horizon forecasting is a potential issue. In Figure 5 we show the non-overlapping four quarter ahead absolute errors of DSGE model forecasts made in the January of each year for the first quarter of the subsequent year. Horizontal lines at -0.25 and 0.25 show forecast errors that would be one percentage point in annualized terms. Most errors are near or above (in absolute value) these bounds. It is clear that our statistical results are not driven by outliers (a fact also visible in Figure 1). To provide a better understanding of the evolution of forecast errors over time, Figure 6 shows three year rolling averages of root mean square errors for four quarter ahead forecasts, using all 12 forecasts for each year. Not surprisingly, the forecast errors are considerably higher in the latter part of the sample, which includes the crisis episode. The DSGE model does worse than the Blue Chip forecast once the rolling windows includes 2008, for both inflation and the GDP growth forecasts. Lastly, we look atthe forecasting performance of theDSGE and BVARmodels comparedto the Blue Chip forecasts during the recent crisis and the recession. Figures 7 and 8 show the forecast errors for inflation and GDP growth beginning with 4 quarter ahead forecasts and ending with the nowcastforthreequarters: 2007Q4,thefirstquarteroftherecessionaccordingtotheNBERdating, 2008Q3, when Lehman failed and per capita GDP growth turned negative, and 2009Q1, when the extent of the contraction became clear (see Wieland and Wolters, 2010, for a similar analysis of more episodes).13 A salient feature of all panels in Figures 7 and 8 is the closeness of the model forecastandthejudgmentalforecasttoeachotherwhentheforecasthorizonisfourquarters. While all forecasts clearly first miss the recession, then its severity, the Blue Chip forecasts in general far better when the quarter to be forecasted gets closer and especially when nowcasting. An interesting point is the within quarter improvement in the judgmental forecast, especially for the nowcast quarter, and the lack of a similar improvement for the DSGE and BVAR model forecasts. The DSGE and statistical models have access to more revised versions of data belonging to the previous quarter and before as the quarter progresses. On the other hand, forecasters surveyed by the Blue Chip survey observe within quarter developments and learn of industrial production, retail sales, etc. as well as receiving updates about policy responses, which were not following previous prescriptions that are in the estimated parameters. For example, the Blue Chip forecasters surely knew of the zero nominal bound, whereas both estimated models (DSGE and statistical) imply deeply negative nominal rate forecasts during the crisis. It is not very surprising that judgmental forecasts fare better in capturing such regime switches. The DSGE model, lacking a financial sector and a zero nominal bound, should naturally do 13In the horizontal axis labels, (A), (B), and (C) denote the first, second, and third month of a given quarter. 16

somewhat better in the pre-crisis period. In fact, that is the period this model was built to explain. But this also cautions us that out-of-sample tests for DSGE models are not truly out of sample as long as the sample is in the period the model was built to explain. The next generation of DSGE models will likely have the zero nominal bound and a financial sector as standard features and will do better when explaining the great recession. Their real test will be to explain–but not necessarily to forecast–the first business cycle that follows those models’ creation.14 7 Conclusion DSGE models are very poor in forecasting, but so are all other approaches. Forecasting ability is a nonissue in DSGE model evaluation because in recent samples (over which these models can be evaluated using real time data) there isn’t much to be forecasted. This is consistent with the literature on the Great Moderation, which emphasizes that not only the standard deviation of macroeconomic fluctuations, but also their nature has changed. In particular, cycles are driven more by temporary, unforecastable shocks. The lack of forecastability is not, however, evidence against the DSGE model and indeed can be evidence in favor of it. Monetary policy was characterized with a strongly stabilizing rule in this period and the model implies that such policy will undo predictable fluctuations, especially in inflation. We leave scrutinizing this point and studying the forecasting ability of the model in preand post-Great Moderation periods in more detail to future work and conclude by repeating that forecasting ability is not a proper metric to judge a model. References [1] Adolfson, M., M. Andersson, J. Linde, M. Villani, and A. Vredin. 2007. “Modern Forecasting Models in Action: Improving Macroeconomic Analyses at Central Banks,” International Journal of Central Banking 3(4), 111-144. [2] Adolfson, M., J. Linde, and M. Villani. 2006. “Forecasting Performance of an Open Economy Dynamic Stochastic General Equilibrium Model.” Sveriges Riksbank Working Paper Series, No. 190. [3] Atkeson, A. and L. Ohanian. 2001.“Are Phillips Curves Useful for Forecasting Inflation?,” Quarterly Review, Federal Reserve Bank of Minneapolis (Winter), 2-11. 14A promising avenue of research is adding unemployment explicitly to the model, as in Gali, Smets and Wouters (2010). This will likely help improve the model forecasts as Stock and Watson (2010), show that utilizing an unemployment gap measure helps improve forecasts of inflation in recession episodes. 17

[4] Calvo, G. 1983. “Staggered Prices in a Utility-Maximizing Framework,” Journal of Monetary Economics 12(3), 383-398. [5] Christiano, L., M. Eichenbaum, and C. Evans. 2005. “Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy,” Journal of Political Economy 113(1), 1-45. [6] Christoffel, K., G. Coenen, and A. Warne. 2010. “Forecasting with DSGE Models,” in M. Clements and D. Hendry (eds), Handbook of Forecasting, Oxford University Press, Oxford, forthcoming. [7] D’Agostino, A. and D. Giannone. 2006. “Comparing Alternative Predictors Based on Large- Panel Factor Models,” ECB Working Paper No. 680. [8] Edge, R., M. Kiley, and JP. Laforte. 2010. “A Comparison of Forecast Performance between Federal Reserve Staff Forecasts, Simple Reduced-Form Models, and a DSGE Model,” Journal of Applied Econometrics, 25(4), 720-54. [9] Faust, J. and J. Wright. 2009. “Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset,” Journal of Business and Economic Statistics 27(4), 468-479. [10] Fuhrer, J., G. Olivei, and G. Tootell. 2009. “Empirical Estimates of Changing Inflation Dynamics,” FRB Boston Working Paper No. 09-4. [11] Gali, J. 2010. “Are Central Banks’ Projections Meaningful?” CEPR Discussion Paper 8027. [12] Gali, J., F. Smets, and R. Wouters. 2010. “Unemployment in an Estimated New Keynesian Model,” Working Paper, CREI. [13] Goodfriend, M. and R. King. 2009. “The Great Inflation Drift,” NBER Working Paper No. 14862 [14] Gu¨rkaynak, R., E. Swanson and B. Sack. 2005. “Market-Based Measures of Monetary Policy Expectations,” Journal of Business and Economic Statistics 25(2), 201-12. [15] Gu¨rkaynak, R. and J. Wolfers. 2007. “Macroeconomic Derivatives: An Initial Analysis of Market-Based Macro Forecasts, Uncertainty, and Risk,” NBER International Seminar on Macroeconomics 2005 (2), 11-50. [16] Kimball, M. 1995. “The Quantitative Analytics of the Basic Neomonetarist Model,” Journal of Money, Credit, and Banking 27(4), 1241–1277 [17] King, R., C. Plosser, and S. Rebelo. 1988. “Production, Growth and Business Cycles I,” Journal of Monetary Economics 21(2-3),195-232. 18

[18] Lees K., T. Matheson, and C. Smith. 2007. “Open Economy DSGE-VAR Forecasting and Policy Analysis - Head to Head with the RBNZ Published Forecasts,” Reserve Bank of New Zealand Discussion Paper No. 2007/01. [19] Reifschneider, D. and P. Tulip. 2007. “Gauging the Uncertainty of the Economic Outlook from Historical Forecasting Errors,” FEDS Working Paper 2007-60. [20] Romer, C. and D. Romer. 2000. “Federal Reserve Information and the Behavior of Interest Rates,” American Economic Review 90(3), 429-457. [21] Sims, C. 2002. “The Role of Models and Probabilities in the Monetary Policy Process,” Brookings Papers on Economic Activity 2002(2), 1-40. [22] Smets, F. and R. Wouters. 2003. “An Estimated Stochastic Dynamic General Equilibrium Model of the Euro Area,” Journal of European Economic Association, 1(5), 1123-1175. [23] Smets, F. and R. Wouters. 2007. “Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach,” American Economic Review 97(3), 586-607. [24] Stock, J.andM.Watson.2007.“WhyHasU.S.InflationBecomeHardertoForecast?”Journal of Money Credit and Banking 39(1), 3-33. [25] Stock, J. and M. Watson. 2010. “Modeling Inflation after the Crisis,” Paper presented at the Federal Reserve Bank of Kansas City Economic Policy Symposium. [26] Trehan, B. 2010. “Survey Measures of Expected Inflation and the Inflation Process,” FRBSF Working Paper Series No. 2009-10 [27] Tulip, P. 2009.“Has the Economy Become More Predictable? Changes in Greenbook Forecast Accuracy,” Journal of Money, Credit and Banking 41(6), 1217-1231. [28] Wieland, W. and M. Wolters. 2010. ‘The Diversity of Forecasts from Macroeconomic Models of the U.S. Economy,” Working Paper, Goethe University. 19

1Q ahead 2Q ahead 3Q ahead 4Q ahead 5Q ahead 6Q ahead DSGE Model Slope 0.451∗∗ 0.089 0.031 0.209 0.167 0.134 (0.108) (0.149) (0.250) (0.261) (0.216) (0.174) Intercept 0.261∗∗ 0.421∗∗ 0.446∗∗ 0.363∗∗ 0.386∗∗ 0.398∗∗ (0.051) (0.082) (0.122) (0.128) (0.112) (0.112) R2 0.13 0.00 0.00 0.02 0.01 0.01 No. of Obs 104 104 104 104 104 104 BVAR Model Slope 0.472∗∗ 0.205 0.224∗ 0.209 0.062 −0.033 (0.096) (0.133) (0.104) (0.121) (0.094) (0.119) Intercept 0.216∗∗ 0.344∗∗ 0.322∗∗ 0.329∗∗ 0.430∗∗ 0.497∗∗ (0.052) (0.091) (0.066) (0.085) (0.069) (0.097) R2 0.17 0.03 0.04 0.04 0.00 0.00 No. of Obs 104 104 104 104 104 104 Greenbook Slope 0.642∗∗ 0.288 0.268 0.209 −0.007 −0.386 (0.084) (0.161) (0.188) (0.245) (0.306) (0.253) Intercept 0.138∗∗ 0.322∗∗ 0.332∗∗ 0.369∗∗ 0.477∗∗ 0.657∗∗ (0.048) (0.091) (0.106) (0.130) (0.157) (0.136) R2 0.48 0.08 0.05 0.02 0.00 0.06 No. of Obs 104 104 104 104 104 104 Notes: Standard errors in parentheses; ∗∗/∗ denotes significance at the 1/5 percent level, respectively. Table 1: DSGE Model, BVAR Model, and Greenbook Inflation Forecast Accuracy 20

1Q ahead 2Q ahead 3Q ahead 4Q ahead 5Q ahead 6Q ahead DSGE Model Slope 0.374∗ 0.485 0.477 0.507 0.485 0.553 (0.174) (0.249) (0.321) (0.303) (0.312) (0.279) Intercept 0.419∗ 0.313 0.331 0.299 0.320 0.284 (0.206) (0.292) (0.362) (0.346) (0.344) (0.311) R2 0.08 0.09 0.07 0.08 0.07 0.06 No. of Obs 104 104 104 104 104 104 BVAR Model Slope 0.041 −0.057 0.094 0.082 0.110 0.037 (0.130) (0.136) (0.143) (0.135) (0.146) (0.206) Intercept 0.784∗∗ 0.894∗∗ 0.735∗∗ 0.754∗∗ 0.713∗∗ 0.815∗∗ (0.160) (0.196) (0.198) (0.189) (0.205) (0.263) R2 0.00 0.00 0.01 0.01 0.01 0.00 No. of Obs 104 104 104 104 104 104 Greenbook Slope 0.641∗∗ 0.260 −0.081 −0.115 −0.416 −0.001 (0.172) (0.339) (0.287) (0.318) (0.359) (0.422) Intercept 0.561∗∗ 0.721∗∗ 0.875∗∗ 0.893∗∗ 1.015∗∗ 0.852∗∗ (0.102) (0.179) (0.162) (0.181) (0.195) (0.233) R2 0.13 0.01 0.00 0.00 0.02 0.00 No. of Obs 104 104 104 104 104 104 Notes: Standard errors in parentheses; ∗∗/∗ denotes significance at the 1/5 percent level, respectively. Table 2: DSGE Model, BVAR Model, and Greenbook GDP Growth Forecast Accuracy 21

1Q ahead 2Q ahead 3Q ahead 4Q ahead 5Q ahead 6Q ahead DSGE Model Slope 1.138∗∗ 1.286∗∗ 1.373∗∗ 1.385∗∗ 1.381∗∗ 1.324∗ (0.031) (0.085) (0.181) (0.305) (0.416) (0.538) Intercept −0.149∗∗ −0.308∗∗ −0.427∗∗ −0.483 −0.528 −0.512 (0.027) (0.068) (0.153) (0.289) (0.422) (0.582) R2 0.95 0.83 0.66 0.48 0.35 0.24 No. of Obs 104 104 104 104 104 104 BVAR Model Slope 0.924∗∗ 0.888∗∗ 0.867∗∗ 0.852∗∗ 0.828∗∗ 0.807∗∗ (0.020) (0.041) (0.076) (0.126) (0.191) (0.262) Intercept 0.056∗∗ 0.067 0.056 0.037 0.031 0.025 (0.020) (0.036) (0.064) (0.117) (0.195) (0.281) R2 0.96 0.87 0.74 0.60 0.47 0.35 No. of Obs 104 104 104 104 104 104 Greenbook Slope 0.993∗∗ 0.962∗∗ 0.904∗∗ 0.829∗∗ 0.735∗∗ 0.614∗∗ (0.006) (0.025) (0.057) (0.098) (0.148) (0.194) Intercept 0.001 0.012 0.049 0.112 0.200 0.316 (0.006) (0.025) (0.056) (0.096) (0.150) (0.205) R2 1.00 0.96 0.87 0.72 0.54 0.36 No. of Obs 104 104 104 104 104 104 Notes: Standard errors in parentheses; ∗∗/∗ denotes significance at the 1/5 percent level, respectively. Table 3: DSGE Model, BVAR Model, and Greenbook Interest Rate Forecast Accuracy 22

1Q ahead 2Q ahead 3Q ahead 4Q ahead 5Q ahead 6Q ahead DSGE Model Slope 0.498∗∗ 0.453∗ 0.560∗ 0.862∗ 1.127∗ 1.003 (0.121) (0.173) (0.240) (0.411) (0.473) (0.507) Intercept −0.012 −0.009 −0.017 −0.029 −0.041 −0.034 (0.016) (0.019) (0.023) (0.028) (0.031) (0.031) R2 0.15 0.11 0.11 0.17 0.20 0.12 No. of Obs 104 104 104 104 104 104 BVAR Model Slope 0.724∗∗ 0.978∗∗ 1.202∗ 1.064∗ 1.025∗ 1.040∗ (0.133) (0.274) (0.459) (0.489) (0.476) (0.482) Intercept −0.018 −0.027 −0.044 −0.043 −0.040 −0.038 (0.014) (0.019) (0.028) (0.033) (0.033) (0.033) R2 0.30 0.17 0.16 0.16 0.17 0.18 No. of Obs 104 104 104 104 104 104 Greenbook Slope 1.052∗∗ 1.191∗∗ 0.986∗∗ 0.588 0.423 −0.279 (0.030) (0.144) (0.212) (0.358) (0.215) (0.333) Intercept −0.006 −0.022 −0.023 −0.011 −0.006 0.005 (0.003) (0.013) (0.022) (0.023) (0.024) (0.022) R2 0.96 0.50 0.14 0.03 0.02 0.01 No. of Obs 104 104 104 104 104 104 Notes: Standard errors in parentheses; ∗∗/∗ denotes significance at the 1/5 percent level, respectively. Table 4: DSGE Model, BVAR Model, and Greenbook Interest Rate Change Forecast Accuracy 23

1.5 1 0.5 1 2 3 4 5 6 7 8 EMSR tsaceroF noitalfnI .leR DSGE Model Relative to GB 1.5 1 0.5 1 2 3 4 5 6 7 8 Quarters Ahead EMSR tsaceroF noitalfnI .leR DSGE Model Relative to BVAR Quarters Ahead 1.5 E DSGE Model Relative to GB 1.5 E 1.5 1 0.5 1 2 3 4 5 6 7 8 DSGE Model Relative to BVAR EMSR tsaceroF noitalfnI .leR DSGE Model Relative to GB 1.5 1 0.5 1 2 3 4 5 6 7 8 Quarters Ahead EMSR tsaceroF noitalfnI .leR DSGE Model Relative to BVAR Quarters Ahead 1.5 1 0.5 1 2 3 4 5 6 7 8 EMSR tsaceroF .rG PDG .leR DSGE Model Relative to GB 1.5 1 0.5 1 2 3 4 5 6 7 8 Quarters Ahead EMSR tsaceroF .rG PDG .leR DSGE Model Relative to BVAR Quarters Ahead Figure 1: Relative Forecast RMSEs 24

0.9 0.6 noi 0.9 0.6 0.3 noitalfnI dezilaeR 0.9 0.6 0.3 0 0 0.3 0.6 0.9 noitalfnI dezilaeR 0.9 0.6 0.3 0 0 0.3 0.6 0.9 DSGE Model Forecast of Inflation noitalfnI dezilaeR 0.9 0.6 0.3 0 0 0.3 0.6 0.9 DSGE Model Forecast of Inflation 2.4 noitalfnI dezilaeR DSGE Model Forecast of Inflation 2.4 1.8 1.2 htworG PD 0.9 0.6 0.3 0 0 0.3 0.6 0.9 noitalfnI dezilaeR DSGE Model Forecast of Inflation 2.4 1.8 1.2 0.6 0 htworG PDG dezilaeR 0.9 0.6 0.3 0 0 0.3 0.6 0.9 noitalfnI dezilaeR DSGE Model Forecast of Inflation 2.4 1.8 1.2 0.6 0 ‐0.6 ‐0.6 0 0.6 1.2 1.8 2.4 htworG PDG dezilaeR DSGE Model Forecast of GDP Growth Figure 2: Realized and Four-quarter Ahead DSGE Inflation and Real GDP Growth Forecast 25

0.5 0.4 0.3 0.2 0.1 1 2 3 4 5 6 7 8 noitalfnI Quarters Ahead 1 0.8 0.6 04 htworG PDG 0.5 0.4 0.3 0.2 0.1 1 2 3 4 5 6 7 8 noitalfnI Quarters Ahead 1 0.8 0.6 0.4 1 2 3 4 5 6 7 8 htworG PDG Quarters Ahead 0.15 0.10 0.05 0.00 1 2 3 4 5 6 7 8 egnahC etaR tseretnI DSGE BVAR GB Random Walk Constant Quarters Ahead Figure 3: RSMEs of Alternative Forecasts 26

3333....5555 RRRRoooommmmeeeerrrr&&&& RRRRoooommmmeeeerrrr SSSSaaaammmmpppplllleeee EEEEddddggggeeee &&&& 3333....0000 GGGGuuuurrrrkkkkaaaayyyynnnnaaaakkkk SSSSaaaammmmpppplllleeee 2222....5555 222...000 111...555 111...000 00..55 00..00 ‐‐00..55 11996644q22 11996699q22 11997744q22 11997799q22 11998844q22 11998899q22 11999944q22 11999999q22 22000044q22 Figure 4: A Short History of Inflation 27

0.4 0.2 0 ‐0.2 ‐0.4 1993 1995 1997 1999 2001 2003 2005 2007 2009 rorrE tsaceroF noitalfnI EGSD Years 2 1 0 1 rorrE tsaceroF htworG PD 0.4 0.2 0 ‐0.2 ‐0.4 1993 1995 1997 1999 2001 2003 2005 2007 2009 rorrE tsaceroF noitalfnI EGSD Years 2 1 0 ‐1 ‐2 1993 1995 1997 1999 2001 2003 2005 2007 2009 rorrE tsaceroF htworG PDG EGSD Years Figure 5: Non-overlapping Four-quarter Ahead Forecast Errors 28

0.5 0.4 0.3 EMSR noitalfn 0.5 0.4 0.3 0.2 0.1 0 EMSR noitalfnI gnilloR 0.5 0.4 0.3 0.2 0.1 0 1993 1995 1997 1999 2001 2003 2005 2007 2009 EMSR noitalfnI gnilloR Years 1.5 E 0.5 0.4 0.3 0.2 0.1 0 1993 1995 1997 1999 2001 2003 2005 2007 2009 DSGE BVAR BC EMSR noitalfnI gnilloR Years 1.5 1.0 05 EMSR htworG PDG 0.5 0.4 0.3 0.2 0.1 0 1993 1995 1997 1999 2001 2003 2005 2007 2009 DSGE BVAR BC EMSR noitalfnI gnilloR Years 1.5 1.0 0.5 0.0 1993 1995 1997 1999 2001 2003 2005 2007 2009 EMSR htworG PDG gnilloR 0.5 0.4 0.3 0.2 0.1 0 1993 1995 1997 1999 2001 2003 2005 2007 2009 DSGE BVAR BC Years EMSR noitalfnI gnilloR Years 1.5 1.0 0.5 0.0 1993 1995 1997 1999 2001 2003 2005 2007 2009 EMSR htworG PDG gnilloR DSGE BVAR BC Years Figure 6: Three-year Rolling Average of Four-quarter Ahead RMSEs 29

22000077::QQ44 IInnffllaattiioonn 22000088::QQ33 IInnffllaattiioonn 11..22 11..22 00..99 00..99 00..66 00..66 00..33 00..33 00 00 ‐‐00..33 ‐‐00..33 22000099::QQ11 IInnffllaattiioonn 11.22 0.9 DSGE BVAR 2008:Q4 0.6 2 1 0 0.3 ‐1 ‐2 0 BC Actual ‐0.3 Figure 7: Forecasts of Inflation during the Crisis 30

22000077::QQ44 GGDDPP GGrroowwtthh 22000088::QQ33 GGDDPP GGrroowwtthh 11..66 11..66 11..22 11..22 00..88 00..88 00..44 00..44 00 00 ‐‐00..44 ‐‐00..44 22000099::QQ11 GGDDPP GGrroowwtthh 22 DSGE BVAR 1 2008:Q4 2 0 1 0 ‐1 ‐2 ‐1 BC Actual ‐2 Figure 8: Forecasts of GDP Growth during the Crisis 31

Appendix A. Constructing the Real Time Data Sets In this appendix we discuss how the real time data sets that we use to generate all of the forecasts other than those of the Greenbook are constructed. To ensure that when we carry out our forecast performance exercises we are indeed comparing the ability to forecast of different methodologies (and not some other difference) it is critical that the information/data sets that we use to generate our model forecasts are the same as those used to generate the Greenbook and Blue Chip forecasts. For this we are very conscious of the timing of the releases of the data that we use to generate our model forecasts and how they relate to timings of the Greenbook’s closing dates and Blue Chip publication dates. We begin by documenting the data series that are used in the DSGE model and in the other reduced-form forecasting models. Here relatively little discussion is necessary, since we employ essentially all of the same data series that were used by Smets and Wouters in estimating their model. We then move on to provide a full account of how we constructed the real-time data sets that we then use to generate the model forecasts. We then briefly explain our construction of the “first final” data, which are ultimately what we consider to be realized value of real GDP growth and the rate of GDP price inflation against which we compare the forecasts. The data series used To allow comparability with the results of Smets and Wouters (2007) we use exactly the same data series that they used in their analysis. Because we will subsequently have to obtain different release vintages for all of our data series (other than the federal funds rate) we do need to be very specific about the data release from which each series is obtained (not only the government statistical agency from the data series is obtained). Four series used in our estimation are taken from the National Income and Product Accounts (NIPA).TheseaccountsareproducedbytheBureauofEconomicAnalysisandtheyareconstructed at the quarterly frequency. The four series from the NIPA are real GDP (GDPC), the GDP price deflator (GDPDEF), nominal personal consumption expenditures (PCEC), and nominal fixed private investment (FPI). The mnemonics that we use – given in parenthesis – are in all cases other than real GDP the same as those used by Smets and Wouters. And, the only reason for using a different mnemonic for real GDP is that whereas in Smets and Wouters real GDP is defined in terms of chained 1996 dollars (and therefore denoted by GDPC96), for our analysis the chained dollars for which real GDP is defined changes with the data’s base year. Actually, the GDP price deflator also changes with the base year (since it is usually set to 100 in the base year) though it appears that its mnemonic does not change. 32

OneseriesusedinourestimationistakenfromtheLaborProductivityandCosts(P&C)release. These data are produced by the Bureau of Labor Statistics and are constructed at the quarterly frequency. TheseriesthatweusedfromtheP&Creleaseiscompensationperhoursforthenonfarm business sector (PRS85006103). The mnemonic here is not intuitive but rather reflects the name that data service that Smets and Wouters used to extract their data – macrospect – gave to the series. Three series used in our estimation are taken from the Employment Situation Summary (ESS), which contains the findings of two surveys the Household Survey and the Establishment Survey. This data release is produced by the Bureau of Labor Statistics and is constructed at the monthly frequency. The three series from this source are average weekly hours of production and nonsupervisory employees for total private industries (PRS85006023), civilian employment (CE16OV), and civilian noninstitutional population (LNSINDEX). The first of these series is from the establishment survey while the latter two are both from the household survey.15 Clearly, since our model is at the quarterly frequency we make simple transformations – specifically, take averages – of the monthly data. The final series in our model – the federal funds rate – does not revise. This series, which is obtained from the Federal Reserve Board’s H.15 release, comes at the business day frequency and the quarterly series is simply the average of this daily data. We transform all of our data sources for use in the model in exactly the same way as Smets and Wouters as described below. CONSUMPTION = LN((PCEC/GDPDEF)/LNSINDEX)∗100 INVESTMENT = LN((FPI/GDPDEF)/LNSINDEX)∗100 OUTPUT = LN((GDPC)/LNSINDEX)∗100 HOURS = LN((PRS85006023∗CE16OV/100)/LNSINDEX)∗100 INFLATION = LN(GDPDEF/GDPDEF(−1))∗100 REAL WAGE = LN(PRS85006103/GDPDEF)∗100 INTEREST RATE = FEDERAL FUNDS RATE/4 15Note that there is an employment series in the establishment survey as well, which when the data is released usually receives more attention. We use the household survey series for the reason that it is the series that Smets and Wouters use. 33

Obtaining the real time data sets corresponding to Greenbook forecasts Tables 1 to 13 provide for the years 1992 to 2004 what – in the vertical dimension – is essentially a time line of the dates of all Greenbook forecasts and all release dates for the data sources that we use and that also revise. The horizontal dimension of the table sorts the release dates according the data source in question. From these tables it is reasonably straightforward to understand how we go about constructing the real time data sets that we will use to estimate our models from which we will obtain our model forecasts that will in turn have their forecast performance compared to the Greenbook forecasts. Specifically, for each Greenbook forecast we can look-up in the table what the most recent release – or vintage – of each data source was. For example, for the June 1997 Greenbook forecast (shown about halfway down Table 6) that closed on June 25, we can see that the most recent release of NIPA data was the preliminary release of 1997:Q1 on May 30 and the most recent release of the P&Cdatawasthefinalreleaseof1997:Q1onJune18.16 TheESSrequiresalittlemoreexplanation. This is a monthly series for which the first estimate of the data is available quite promptly (i.e., within a week) of the data’s reference period. Thus the most recent release of the ESS prior to the June Greenbook is the estimate for May 1997, released on June 6. An employment report release includes, however, not only the first estimate of the preceding month’s data (in this case May) but also revisions to the two preceding months (in this case April and March). This means that from the perspective of thinking about quarterly data, the June 6 ESS release represents the second and last revision of 1997:Q1 data.17 From looking up what vintage of the data was available at the times of each Greenbook we can construct a data set corresponding to each Greenbook that contains observations for each of our model variables taken from the correct release vintage. All vintages for 1992 to 1996 (shown in Tables 1 to 5) were obtained from “ALFRED,” which is an archive of Federal Reserve Economic Data maintained by the St Louis Fed. All vintages for 1997 to 2004 (shown in Tables 6 to 13) were obtained from datasets that since September 1996 have been archived by Board staff at the end of each Greenbook round. In the June 1997 example given above the last observation that we have for each data series is the same – 1997:Q1. This will not always be the case. For example, in every January Greenbook round P&C data are not available for the preceding year’s fourth quarter but EES data is always available and NIPA data sometimes is available. This means that in the January Greenbook for all 16Until last year the names of the three releases in the NIPA were, in the following sequence the advance release, the preliminary release, and the final release. Thus, the preliminary release described above is the second of three releases. Last year, however, the names of the NIPA releases were changed to the first release, the second release, and the final release. We refer to the original names of the releases in this paper. Note also that there are only two releases of the P&C for each quarter. These are called the preliminary release and the final release. 17Ofcourse,thereleasealsocontainstwothirdsofthedatafor1997:Q2,butwedonotusethisinformationatall. This is reasonably standard practice. 34

years other than 1992 to 1994 there is – relative to the NIPA – one extra quarter of employment data. This is also the case in the 2002 and 2003 October Greenbooks; all Greenbooks for which this is an issue are marked with a † in Tables 1 to 13. Differential data availability can also work the other way. For example, in the Greenbooks marked with a ∗ in Tables 1 to 13 of the working paper we always have one less observation of the P&C relative to the NIPA. We use the availability of the NIPA as what determines whether data is available for a quarter or not. Thus, if we have an extra quarter of the ESS (as we do in the † rounds) we ignore it in making our first quarter ahead forecasts – even those for HOURS. If we have one less quarter of P&C data (as we do in the ∗ rounds) we use the staff’s estimate of compensation per hour for the quarter, which is calculated based on the ESS’s reading average hourly earnings. This is always available in time since the ESS is very prompt. Of course, this raises the question of why (given its timeliness) not just use the ESS’s estimate for wages – that is, average hourly earnings for total private industry – instead of the P&C’s compensation per hours for the nonfarm business sector series. One reason arises from our desire to stay as close as possible to Smets and Wouters, but another is that real time data on average hourly earnings in ALFRED only extend back to 1999. We would also note that there are much more elegant ways to deal with the jaggedness in data availability that we face. In particular, the Kalman filter, which is present in our DSGE model, does represent one way to make use of data that is available for only some series. We leave this to future work. Obtaining the real time data sets corresponding to Blue Chip forecasts Tables 14 though 31 provide the time line of the dates for all Blue Chip forecasts and the release dates of all our data sources. They are exactly analogous to Table 1 to 13 for the Greenbook although they extend further in time – specifically, to September 2009, one year ago from the time of writing. Note also that there are 12 Blue Chip forecasts per year. As with the Greenbook there are instances where the last observation of data that we have is different across series. Indeed this is more frequent for the Blue Chip due to the fact that the survey of forecasters occurs at the beginning of the month and the EES is also released near the beginning of every month while the preliminary release of the P&C is usually at the beginning of the second, fifth, eighth, and eleventh months of each year. The timing of the release of the EES means that for every January, April, July, and October Blue Chip there is an extra quarter of employment data that we do not use in the estimation. Again, these rounds are marked with a † in Tables 14 to 31. Note that Blue Chip databases marked with a ∗ denote when we have one less quarter of P&C data than we have NIPA data. In this case when we have a quarter less of P&C data it is really only by a day of so that we are missing the LPS release so we make the assumption that forecasters do have this data over the quarters for which we have to make this data. As with 35

the Greenbook forecast we use the availability of NIPA data to determine if data is available for a quarter. Constructing the first final A review of the data release tables should also give some indication of how we construct the “first final”dataseries,whichistheseriesagainstwhichtheGreenbookandmodelforecastsareevaluated. As can be seen in the table, every third release of the NIPA data and every second release of the P&Cismarkedwithan“(F).”Thisrepresentsthefinalreleaseofthedatapriortoitgettingrevised in either an annual or comprehensive revision. For EES releases the final release for any quarter is represented by “r2.” This denotes the second revision to the data, which is the last revision before any annual revision – or benchmarking – is made. Note that even when considering our economic growth forecasts were are in fact considering real GDP growth per capita and for this reason we must also pay attention to the “first final” releases of the ESS. Wemakethefirstfinaldatabysimplyextractingthefirstfinalobservation–alwaysthelastone – from each final (F) or second revision (r2) vintage. We must, however, not extract the levels of these observations but rather the growth rates. This is because whenever there is a comprehensive revision the base year of real GDP and the GDP price deflator change, so were we to make our first-finalseriesinlevels, theserieswouldbecharacterizedbylargejumpsfortheobservationatthe quarter for which the comprehensive revision takes place. Deriving our first final series in growth rates addresses this problem. 36

SSE miretnI SSE miretnI C&P miretnI APIN miretnI tsac’F BG BG tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desolc emaN 29/01/1 :4Q:19 SPC&ceD:19 29/3/1:)F(3Q:19 19/02/21:)F(3Q:19 29/01/1 :snoisiveR 29/92/1:)A(4Q:19 4Q:39-1Q:29 29/03/1 ∗29 .naJ 29/7/2 :)1r(4Q:19 29/7/2 :naJ:29 29/5/2:)P(4Q:19 29/82/2:)P(4Q:19 29/6/3 :)2r(4Q:19 29/6/3 :beF:29 .nnA&)F(4Q:19 29/01/3 :snoisiveR 4Q:39-1Q:29 29/52/3 29 .raM 29/3/4 :1Q:29 29/3/4 :raM:29 – 29/62/3:)F(4Q:19 29/8/5 :)1r(1Q:29 29/8/5 :rpA:29 29/82/4:)A(1Q:29 4Q:39-2Q:29 29/41/5 ∗29 yaM 29/5/6 :)2r(1Q:29 SEC&yaM:29 29/71/6:)F,P(1Q:29 29/92/5:)P(1Q:29 29/5/6 :snoisiveR 29/52/6:)F(1Q:29 4Q:39-2Q:29 29/62/6 29 .nuJ 29/2/7 :2Q:29 29/2/7 :nuJ:29 APIN&)P(2Q:29 .nnA&)A(2Q:29 29/7/8 :)1r(2Q:29 29/7/8 :luJ:29 29/11/8 :snoisiveR 29/03/7 :snoisiveR 4Q:39-3Q:29 29/31/8 29 .guA 29/4/9 :)2r(2Q:29 29/4/9 :guA:29 29/3/9:)F(2Q:29 29/72/8:)P(2Q:29 29/42/9:)F(2Q:29 4Q:49-3Q:29 29/03/9 29 .peS 29/2/01 :3Q:29 29/2/01 :peS:29 29/5/11:)P(3Q:29 29/72/01:)A(3Q:29 29/6/11 :)1r(3Q:29 29/6/11 :tcO:29 4Q:49-4Q:29 29/21/11 29 .voN 29/4/21 :)2r(3Q:29 29/4/21 :voN:29 29/3/21:)F(3Q:29 29/52/11:)P(3Q:29 4Q:49-4Q:29 29/61/21 29 .ceD .2991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF koobneerG :5 elbaT 37

SSE miretnI SSE miretnI C&P miretnI APIN miretnI tsac’F BG BG tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desolc emaN 39/8/1 :4Q:29 SPC&ceD:29 – 29/02/21:)F(3Q:29 39/8/1 :snoisiveR 39/82/1:)A(4Q:29 4Q:49-1Q:39 39/92/1 ∗39 .naJ 39/5/2 :)1r(4Q:29 SEC&naJ:39 39/4/2:)P(4Q:29 39/62/2:)P(4Q:29 39/5/3 :)2r(4Q:29 39/5/3 :beF:39 .nnA&)F(4Q:29 39/9/3 :snoisiveR 4Q:49-1Q:39 39/71/3 39 .raM 39/2/4 :1Q:39 39/2/4 :raM:39 39/6/5:)P(1Q:39 39/62/3:)F(4Q:29 39/7/5 :)1r(1Q:39 39/7/5 :rpA:39 39/92/4:)A(1Q:39 4Q:49-2Q:39 39/41/5 39 yaM 39/4/6 :)2r(1Q:39 SEC&yaM:39 39/71/6:)F(1Q:39 39/82/5:)P(1Q:39 39/4/6 :snoisiveR 39/32/6:)F(1Q:39 4Q:49-2Q:39 39/03/6 39 .nuJ 39/2/7 :2Q:39 39/2/7 :nuJ:39 APIN&)P(2Q:39 .nnA&)A(2Q:39 39/6/8 :)1r(2Q:39 39/6/8 :luJ:39 39/01/8 :snoisiveR 39/92/7 :snoisiveR 4Q:49-3Q:39 39/11/8 39 .guA 39/3/9 :)2r(2Q:39 39/3/9 :guA:39 39/9/9:)F(2Q:39 39/13/8:)P(2Q:39 4Q:59-3Q:39 39/51/9 39 .peS 39/8/01 :3Q:39 39/8/01 :peS:39 39/4/11:)P(3Q:39 39/92/9:)F(2Q:39 39/5/11 :)1r(3Q:39 39/5/11 :tcO:39 39/82/01:)A(3Q:39 4Q:59-4Q:39 39/01/11 39 .voN 39/3/21 :)2r(3Q:39 39/3/21 :voN:39 39/8/21:)F(3Q:39 39/1/21:)P(3Q:39 4Q:59-4Q:39 39/51/21 39 .ceD .3991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF koobneerG :6 elbaT 38

SSE miretnI SSE miretnI C&P miretnI APIN miretnI tsac’F BG BG tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desolc emaN 49/7/1 :4Q:39 SPC&ceD:39 – 39/22/21:)F(3Q:39 49/7/1 :snoisiveR 49/82/1:)A(4Q:39 4Q:59-1Q:49 49/13/1 ∗49 .naJ 49/4/2 :)1r(4Q:39 49/4/2 :naJ:49 49/8/2:)P(4Q:39 49/1/3:)P(4Q:39 49/4/3 :)2r(4Q:39 49/4/3 :beF:49 .nnA&)F(4Q:39 49/8/3 :snoisiveR 4Q:59-1Q:49 49/61/3 49 .raM 49/1/4 :1Q:49 49/1/4 :raM:49 49/5/5:)P(1Q:49 49/13/3:)F(4Q:39 49/6/5 :)1r(1Q:49 49/6/5 :rpA:49 49/82/4:)A(1Q:49 4Q:59-2Q:49 49/31/5 49 yaM 49/3/6 :)2r(1Q:49 SEC&yaM:49 49/51/6:)F(1Q:49 49/72/5:)P(1Q:49 49/3/6 :snoisiveR 49/92/6:)F(1Q:49 4Q:59-2Q:49 49/03/6 49 .nuJ 49/8/7 :2Q:49 49/8/7 :nuJ:49 APIN&)P(2Q:49 .nnA&)A(2Q:49 49/5/8 :)1r(2Q:49 49/5/8 :luJ:49 49/9/8 :snoisiveR 49/92/7 :snoisiveR 4Q:59-3Q:49 49/21/8 49 .guA 49/2/9 :)2r(2Q:49 49/2/9 :guA:49 49/7/9:)F(2Q:49 49/62/8:)P(2Q:49 4Q:69-3Q:49 49/12/9 49 .peS 49/7/01 :3Q:49 49/7/01 :peS:49 49/9/11:)P(3Q:49 49/92/9:)F(2Q:49 49/4/11 :)1r(3Q:49 49/4/11 :tcO:49 49/82/01:)A(3Q:49 4Q:69-4Q:49 49/9/11 49 .voN 49/2/21 :)2r(3Q:49 49/2/21 :voN:49 49/7/21:)F(3Q:49 49/03/11:)P(3Q:49 4Q:69-4Q:49 49/41/21 49 .ceD .4991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF koobneerG :7 elbaT 39

SSE miretnI SSE miretnI C&P miretnI APIN miretnI tsac’F BG BG tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desolc emaN 59/6/1 :4Q:49 SPC&ceD:49 – 49/22/21:)F(3Q:49 59/6/1 :snoisiveR 4Q:69-1Q:59 59/52/1 †59 .naJ 59/3/2 :)1r(4Q:49 59/3/2 :naJ:59 59/7/2:)P(4Q:49 59/72/1:)A(4Q:49 59/01/3 :)2r(4Q:49 59/01/3 :beF:59 .nnA&)F(4Q:49 59/1/3:)P(4Q:49 59/8/3 :snoisiveR 4Q:69-1Q:59 59/22/3 59 .raM 59/7/4 :1Q:59 59/7/4 :raM:59 59/9/5:)P(1Q:59 59/13/3:)F(4Q:49 59/5/5 :)1r(1Q:59 59/5/5 :rpA:59 59/82/4:)A(1Q:59 4Q:69-2Q:59 59/71/5 59 yaM 59/2/6 :)2r(1Q:59 SEC&yaM:59 – 59/13/5:)P(1Q:59 59/2/6 :snoisiveR 4Q:69-2Q:59 59/02/6 59 .nuJ 59/7/7 :2Q:59 59/7/7 :nuJ:59 59/12/6:)F(1Q:59 59/03/6:)F(1Q:59 59/4/8 :)1r(2Q:59 59/4/8 :luJ:59 APIN&)P(2Q:59 .nnA&)A(2Q:59 59/8/8 :snoisiveR 59/82/7 :snoisiveR 4Q:69-3Q:59 59/61/8 59 .guA 59/1/9 :)2r(2Q:59 59/1/9 :guA:59 59/7/9:)F(2Q:59 59/03/8:)P(2Q:59 4Q:79-3Q:59 59/02/9 59 .peS 59/6/01 :3Q:59 59/6/01 :peS:59 59/7/11:)P(3Q:59 59/92/9:)F(2Q:59 59/3/11 :)1r(3Q:59 59/3/11 :tcO:59 59/72/01:)A(3Q:59 4Q:79-4Q:59 59/8/11 59 .voN 59/8/21 :)2r(3Q:59 59/8/21 :voN:59 nwodtuhS nwodtuhS 4Q:79-4Q:59 59/41/21 59 .ceD .5991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF koobneerG :8 elbaT 40

SSE miretnI SSE miretnI C&P miretnI APIN miretnI tsac’F BG BG tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desolc emaN 69/91/1 :4Q:59 SPC&ceD:59 – .pmoCdna)F,P(3Q:59 69/91/1 :snoisiveR 69/91/1 :snoisiveR 4Q:79-1Q:69 69/62/1 ∗69 .naJ 69/2/2 :)1r(4Q:59 69/2/2 :naJ:69 69/8/2:)F(3Q:59 69/32/2:)P,A(4Q:59 69/8/3 :)2r(4Q:59 69/8/3 :beF:69 .nnA&)P(4Q:59 69/6/3 :snoisiveR 4Q:79-1Q:69 69/12/3 69 .raM 69/5/4 :1Q:69 69/5/4 :raM:69 69/01/4:)F(4Q:59 69/2/4:)F(4Q:59 69/3/5 :)1r(1Q:69 69/3/5 :rpA:69 69/61/5:)P(1Q:69 69/2/5:)A(1Q:69 4Q:79-2Q:69 69/61/5 69 yaM 69/7/6 :)2r(1Q:69 SEC&yaM:69 69/81/6:)F(1Q:69 69/03/5:)P(1Q:69 69/7/6 :snoisiveR 4Q:79-2Q:69 69/62/6 69 .nuJ 69/5/7 :2Q:69 69/5/7 :nuJ:69 APIN&)P(2Q:69 69/82/6:)F(1Q:69 69/2/8 :)1r(2Q:69 69/2/8 :luJ:69 69/41/8 :snoisiveR .nnA&)A(2Q:69 69/1/8 :snoisiveR 4Q:79-3Q:69 69/51/8 69 .guA 69/6/9 :)2r(2Q:69 69/6/9 :guA:69 69/01/9:)F(2Q:69 69/92/8:)P(2Q:69 4Q:89-3Q:69 69/81/9 69 .peS 69/4/01 :3Q:69 69/4/01 :peS:69 – 69/72/9:)F(2Q:69 69/03/01:)A(3Q:69 4Q:89-4Q:69 69/6/11 ∗69 .voN 69/1/11 :)1r(3Q:69 69/1/11 :tcO:69 69/7/11:)P(3Q:69 69/72/11:)P(3Q:69 69/6/21 :)2r(3Q:69 69/6/21 :voN:69 69/5/21:)F(3Q:69 4Q:89-4Q:69 69/21/21 69 .ceD .6991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF koobneerG :9 elbaT 41

SSE miretnI SSE miretnI C&P miretnI APIN miretnI tsac’F BG BG tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desolc emaN 79/01/1 :4Q:69 SPC&ceD:69 – 69/02/21:)F(3Q:69 79/01/1 :snoisiveR 4Q:89-1Q:79 79/92/1 †79 .naJ 79/7/2 :)1r(4Q:69 79/7/2 :naJ:79 79/11/2:)P(4Q:69 79/13/1:)A(4Q:69 79/7/3 :)2r(4Q:69 79/7/3 :beF:79 .nnA&)F(4Q:69 79/82/2:)P(4Q:69 79/11/3 :snoisiveR 4Q:89-1Q:79 79/91/3 79 .raM 79/4/4 :1Q:79 79/4/4 :raM:79 79/7/5:)P(1Q:79 79/82/3:)F(4Q:69 79/2/5 :)1r(1Q:79 79/2/5 :rpA:79 79/03/4:)A(1Q:79 79/7/5 :)rrE,A(1Q:79 4Q:89-2Q:79 79/51/5 79 yaM 79/6/6 :)2r(1Q:79 SEC&yaM:79 79/81/6:)F(1Q:79 79/03/5:)P(1Q:79 79/6/6 :snoisiveR 4Q:89-2Q:79 79/52/6 79 .nuJ 79/3/7 :2Q:79 79/3/7 :nuJ:79 APIN&)P(2Q:79 79/72/6:)F(1Q:79 79/1/8 :)1r(2Q:79 79/1/8 :luJ:79 79/21/8 :snoisiveR .nnA&)A(2Q:79 79/13/7 :snoisiveR 4Q:89-3Q:79 79/41/8 79 .guA 79/5/9 :)2r(2Q:79 79/5/9 :guA:79 79/9/9:)F(2Q:79 79/82/8:)P(2Q:79 4Q:99-3Q:79 79/42/9 79 .peS 79/3/01 :3Q:79 79/3/01 :peS:79 – 79/62/9:)F(2Q:79 79/13/01:)A(3Q:79 4Q:99-4Q:79 79/6/11 ∗79 .voN 79/7/11 :)1r(3Q:79 79/7/11 :tcO:79 79/31/11:)P(3Q:79 79/62/11:)P(3Q:79 79/5/21 :)2r(3Q:79 79/5/21 :voN:79 79/4/21:)F(3Q:79 4Q:99-4Q:79 79/11/21 79 .ceD .7991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF koobneerG :01 elbaT 42

SSE miretnI SSE miretnI C&P miretnI APIN miretnI tsac’F BG BG tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desolc emaN 89/9/1 :4Q:79 SPC&ceD:79 – 79/32/21:)F(3Q:79 89/9/1 :snoisiveR 4Q:99-1Q:89 89/82/1 †89 .naJ 89/6/2 :)1r(4Q:79 89/6/2 :naJ:89 89/01/2:)P(4Q:79 89/03/1:)A(4Q:79 89/6/3 :)2r(4Q:79 89/6/3 :beF:89 .nnA&)F(4Q:79 89/72/2:)P(4Q:79 89/01/3 :snoisiveR 4Q:99-1Q:89 89/91/3 89 .raM 89/3/4 :1Q:89 89/3/4 :raM:89 89/70/5:)P(1Q:89 89/62/3:)F(4Q:79 89/8/5 :)1r(1Q:89 89/8/5 :rpA:89 89/03/4:)A(1Q:89 4Q:99-2Q:89 89/41/5 89 yaM 89/5/6 :)2r(1Q:89 SEC&yaM:89 89/4/6:)F(1Q:89 89/82/5:)P(1Q:89 89/5/6 :snoisiveR 4Q:99-2Q:89 89/42/6 89 .nuJ 89/2/7 :2Q:89 89/2/7 :nuJ:89 APIN&)P(2Q:89 89/52/6:)F(1Q:89 89/7/8 :)1r(2Q:89 89/7/8 :luJ:89 89/8/8 :snoisiveR .nnA&)A(2Q:89 89/13/7 :snoisiveR 4Q:99-3Q:89 89/31/8 89 .guA 89/4/9 :)2r(2Q:89 89/4/9 :guA:89 89/3/9:)F(2Q:89 89/72/8:)P(2Q:89 4Q:00-3Q:89 89/32/9 89 .peS 89/2/01 :3Q:89 89/2/01 :peS:89 89/01/11:)P(3Q:89 89/42/9:)F(2Q:89 89/5/11 :)1r(3Q:89 89/5/11 :tcO:89 89/03/01:)A(3Q:89 4Q:00-4Q:89 89/31/11 89 .voN 89/4/21 :)2r(3Q:89 89/4/21 :voN:89 89/3/21:)F(3Q:89 89/42/11:)P(3Q:89 4Q:00-4Q:89 89/61/21 89 .ceD .8991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF koobneerG :11 elbaT 43

SSE miretnI SSE miretnI C&P miretnI APIN miretnI tsac’F BG BG tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desolc emaN 99/8/1 :4Q:89 SPC&ceD:89 – 89/32/21:)F(3Q:89 99/8/1 :snoisiveR 4Q:00-1Q:99 99/01/1 †99 .naJ 99/5/2 :)1r(4Q:89 99/5/2 :naJ:99 99/9/2:)P(4Q:89 99/92/1:)A(4Q:89 99/5/3 :)2r(4Q:89 99/5/3 :beF:99 .nnA&)F(4Q:89 99/62/2:)P(4Q:89 99/9/3 :snoisiveR 4Q:00-1Q:99 99/01/3 99 .raM 99/2/4 :1Q:99 99/2/4 :raM:99 99/11/5:)P(1Q:99 99/13/3:)F(4Q:89 99/7/5 :)1r(1Q:99 99/7/5 :rpA:99 99/03/4:)A(1Q:99 4Q:00-2Q:99 99/01/5 99 yaM 99/4/6 :)2r(1Q:99 SEC&yaM:99 99/8/6:)F(1Q:99 99/72/5:)P(1Q:99 99/4/6 :snoisiveR 4Q:00-2Q:99 99/01/6 99 .nuJ 99/2/7 :2Q:99 99/2/7 :nuJ:99 99/5/8:)P(2Q:99 99/52/6:)F(1Q:99 99/6/8 :)1r(2Q:99 99/6/8 :luJ:99 99/92/7:)A(2Q:99 4Q:00-3Q:99 99/01/8 99 .guA 99/3/9 :)2r(2Q:99 99/3/9 :guA:99 99/2/9:)F(2Q:99 99/62/8:)P(2Q:99 4Q:10-3Q:99 99/01/9 99 .peS 99/8/01 :3Q:99 99/8/01 :peS:99 – 99/03/9:)F(2Q:99 99/5/11 :)1r(3Q:99 99/5/11 :tcO:99 .pmoC&)A(3Q:99 99/92/01 :snoisiveR 4Q:10-4Q:99 99/01/11 ∗99 .voN 99/3/21 :)2r(3Q:99 99/3/21 :voN:99 99/21/11:)P(3Q:99 99/42/11:)P(3Q:99 99/7/21:)F(3Q:99 4Q:10-4Q:99 99/01/21 99 .ceD .9991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF koobneerG :21 elbaT 44

SSE miretnI SSE miretnI C&P miretnI APIN miretnI tsac’F BG BG tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desolc emaN 00/7/1 :4Q:99 SPC&ceD:99 – 99/22/21:)F(3Q:99 00/7/1 :snoisiveR 4Q:10-1Q:00 00/72/1 †00 .naJ 00/4/2 :)1r(4Q:99 00/4/2 :naJ:00 00/8/2:)P(4Q:99 00/82/1:)A(4Q:99 00/3/3 :)2r(4Q:99 00/3/3 :beF:00 .nnA&)F(4Q:99 00/52/2:)P(4Q:99 00/7/3 :snoisiveR 4Q:10-1Q:00 00/51/3 00 .raM 00/7/4 :1Q:00 00/7/4 :raM:00 00/4/5:)P(1Q:00 00/03/3:)F(4Q:99 00/5/5 :)1r(1Q:00 00/5/5 :rpA:00 00/3/4 :)r,F(4Q:99 00/72/4:)A(1Q:00 4Q:10-2Q:00 00/11/5 00 yaM 00/2/6 :)2r(1Q:00 SEC&yaM:00 00/6/6:)F(1Q:00 00/52/5:)P(1Q:00 00/2/6 :snoisiveR 4Q:10-2Q:00 00/12/6 00 .nuJ 00/7/7 :2Q:00 00/7/7 :nuJ:00 APIN&)P(2Q:00 00/92/6:)F(1Q:00 00/4/8 :)1r(2Q:00 00/4/8 :luJ:00 00/8/8 :snoisiveR .nnA&)A(2Q:00 00/82/7 :snoisiveR 4Q:10-3Q:00 00/61/8 00 .guA 00/1/9 :)2r(2Q:00 00/1/9 :guA:00 00/6/9:)F(2Q:00 00/52/8:)P(2Q:00 4Q:20-3Q:00 00/72/9 00 .peS 00/6/01 :3Q:00 00/6/01 :peS:00 00/2/11:)P(3Q:00 00/82/9:)F(2Q:00 00/3/11 :)1r(3Q:00 00/3/11 :tcO:00 00/72/01:)A(3Q:00 4Q:20-4Q:00 00/8/11 00 .voN 00/8/21 :)2r(3Q:00 00/8/21 :voN:00 00/6/21:)F(3Q:00 00/92/11:)P(3Q:00 4Q:20-4Q:00 00/31/21 00 .ceD .0002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF koobneerG :31 elbaT 45

SSE miretnI SSE miretnI C&P miretnI APIN miretnI tsac’F BG BG tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desolc emaN 10/5/1 :4Q:00 SPC&ceD:00 – 00/12/21:)F(3Q:00 10/5/1 :snoisiveR 4Q:20-1Q:10 10/52/1 †10 .naJ 10/2/2 :)1r(4Q:00 10/2/2 :naJ:10 10/7/2:)P(4Q:00 10/13/1:)A(4Q:00 10/9/3 :)2r(4Q:00 10/9/3 :beF:10 .nnA&)F(4Q:00 10/82/2:)P(4Q:00 10/6/3 :snoisiveR 4Q:20-1Q:10 10/41/3 10 .raM 10/6/4 :1Q:10 10/6/4 :raM:10 10/8/5:)P(1Q:10 10/92/3:)F(4Q:00 10/4/5 :)1r(1Q:10 10/4/5 :rpA:10 10/72/4:)A(1Q:10 4Q:20-2Q:10 10/9/5 10 yaM 10/1/6 :)2r(1Q:10 SEC&yaM:10 10/5/6:)F(1Q:10 10/52/5:)P(1Q:10 10/1/6 :snoisiveR 4Q:20-2Q:10 10/02/6 10 .nuJ 10/6/7 :2Q:10 10/6/7 :nuJ:10 APIN&)P(2Q:10 10/92/6:)F(1Q:10 10/3/8 :)1r(2Q:10 10/3/8 :luJ:10 10/7/8 :snoisiveR .nnA&)A(2Q:10 10/72/7 :snoisiveR 4Q:20-3Q:10 10/51/8 10 .guA 10/7/9 :)2r(2Q:10 10/7/9 :guA:10 10/5/9:)F(2Q:10 10/92/8:)P(2Q:10 4Q:30-3Q:10 10/62/9 10 .peS 10/5/01 :3Q:10 10/5/01 :peS:10 – 10/82/9:)F(2Q:10 10/13/01:)A(3Q:10 4Q:30-4Q:10 10/13/01 ∗10 .tcO 10/2/11 :)1r(3Q:10 10/2/11 :tcO:10 10/7/11:)P(3Q:10 10/03/11:)P(3Q:10 4Q:30-4Q:10 10/5/21 10 .ceD .1002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF koobneerG :41 elbaT 46

SSE miretnI SSE miretnI C&P miretnI APIN miretnI tsac’F BG BG tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desolc emaN 10/7/21 :)2r(3Q:10 10/7/21 :voN:10 10/6/21:)F(3Q:10 10/12/21:)F(3Q:10 20/4/1 :4Q:10 SPC&ceD:10 50/4/1 :snoisiveR 4Q:30-1Q:20 20/32/1 †20 .naJ 20/1/2 :)1r(4Q:10 10/1/2 :naJ:20 20/6/2:)P(4Q:10 20/03/1:)A(4Q:10 20/8/3 :)2r(4Q:10 20/8/3 :beF:20 .nnA&)F(4Q:10 20/82/2:)P(4Q:10 20/7/3 :snoisiveR 4Q:30-1Q:20 20/31/3 20 .raM 20/5/4 :1Q:20 20/5/4 :raM:20 – 20/82/3:)F(4Q:10 20/62/4:)A(1Q:20 4Q:30-2Q:20 20/1/5 ∗20 yaM 20/3/5 :)1r(1Q:20 20/3/5 :rpA:20 20/7/5:)P(1Q:20 20/42/5:)P(1Q:20 20/7/6 :)2r(1Q:20 SEC&yaM:20 20/13/5:)F(1Q:20 20/7/6 :snoisiveR 4Q:30-2Q:20 20/91/6 20 .nuJ 20/5/7 :2Q:20 20/5/7 :nuJ:20 – 20/72/6:)F(1Q:20 20/2/8 :)1r(2Q:20 20/2/8 :luJ:20 .nnA&)A(2Q:20 20/13/7 :snoisiveR 4Q:30-3Q:20 20/7/8 ∗20 .guA 20/6/9 :)2r(2Q:20 20/6/9 :guA:20 APIN&)P(2Q:20 20/92/8:)P(2Q:20 20/9/8 :snoisiveR 20/5/9:)F(2Q:20 4Q:40-3Q:20 20/81/9 20 .peS 20/4/01 :3Q:20 20/4/01 :peS:20 – 20/72/9:)F(2Q:20 4Q:40-4Q:20 20/03/01 †20 .tcO 20/1/11 :)1r(3Q:20 20/1/11 :tcO:20 20/7/11:)P(3Q:20 20/13/01:)A(3Q:20 20/4/21:)F(3Q:20 20/62/11:)P(3Q:20 4Q:40-4Q:20 20/4/21 20 .ceD .2002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF koobneerG :51 elbaT 47

SSE miretnI SSE miretnI C&P miretnI APIN miretnI tsac’F BG BG tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desolc emaN 20/6/21 :)2r(3Q:20 20/6/21 :voN:20 – 20/02/21:)F(3Q:20 30/01/1 :4Q:20 SPC&ceD:20 30/01/1 :snoisiveR 4Q:40-1Q:30 30/22/1 †30 .naJ 30/7/2 :)1r(4Q:20 30/7/2 :naJ:30 30/6/2:)P(4Q:20 30/03/1:)A(4Q:20 30/7/3 :)2r(4Q:20 30/7/3 :beF:30 .nnA&)F(4Q:20 30/82/2:)P(4Q:20 30/6/3 :snoisiveR 4Q:40-1Q:30 30/21/3 30 .raM 30/4/4 :1Q:30 30/4/4 :raM:30 – 30/72/3:)F(4Q:20 30/52/4:)A(1Q:30 4Q:40-2Q:30 30/03/4 ∗30 .rpA 30/2/5 :)1r(1Q:30 30/2/5 :rpA:30 30/1/5:)P(1Q:30 30/92/5:)P(1Q:30 30/6/6 :)2r(1Q:30 SEC&yaM:30 30/4/6:)F(1Q:30 30/6/6 :snoisiveR 4Q:40-2Q:30 30/81/6 30 .nuJ 30/3/7 :2Q:30 30/3/7 :nuJ:30 – 30/62/6:)F(1Q:30 30/1/8 :)1r(2Q:30 30/1/8 :luJ:30 30/13/7:)A(2Q:30 4Q:40-3Q:30 30/6/8 ∗30 .guA 30/5/9 :)2r(2Q:30 30/5/9 :guA:30 30/7/8:)P(2Q:30 30/82/8:)P(2Q:30 30/4/9:)F(2Q:30 4Q:50-3Q:30 30/01/9 30 .peS 30/3/01 :3Q:30 30/3/01 :peS:30 – 30/62/9:)F(2Q:30 4Q:50-4Q:30 30/22/01 †30 .tcO 30/7/11 :)1r(3Q:30 30/7/11 :tcO:30 30/6/11:)P(3Q:30 30/03/01:)A(3Q:30 30/3/21:)F(3Q:30 30/52/11:)P(3Q:30 4Q:50-4Q:30 30/3/21 30 .ceD .3002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF koobneerG :61 elbaT 48

SSE miretnI SSE miretnI C&P miretnI APIN miretnI tsac’F BG BG tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desolc emaN 30/5/21 :)2r(3Q:30 30/5/21 :voN:30 – 30/01/21 :.veR .pmoC 40/9/1 :4Q:30 SPC&ceD:30 30/32/21:)F(3Q:30 40/9/1 :snoisiveR 4Q:50-1Q:40 40/12/1 †40 .naJ 40/6/2 :)1r(4Q:30 SEC&naJ:40 40/5/2:)P(4Q:30 40/03/1:)A(4Q:30 40/5/3 :)2r(4Q:30 60/6/2 :snoisiveR .nnA&)F(4Q:30 40/72/2:)P(4Q:30 40/5/3 :beF:40 40/4/3 :snoisiveR 4Q:50-1Q:40 40/01/3 40 .raM 40/2/4 :1Q:40 40/2/4 :raM:40 – 40/52/3:)F(4Q:70 4Q:50-2Q:40 40/82/4 40 .rpA 40/7/5 :)1r(1Q:40 40/7/5 :rpA:40 40/6/5:)P(1Q:40 40/92/4:)A(1Q:40 40/4/6 :)2r(1Q:40 40/4/6 :yaM:40 40/3/6:)F(1Q:40 40/72/5:)P(1Q:40 4Q:50-2Q:40 40/32/6 40 .nuJ 40/2/7 :2Q:40 40/2/7 :nuJ:40 – 40/52/6:)F(1Q:40 .nnA&)A(2Q:40 40/03/7 :noisiveR 4Q:50-3Q:40 40/4/8 ∗40 .guA 40/6/8 :)1r(2Q:40 40/6/8 :luJ:40 APIN&)P(2Q:40 40/72/8:)P(2Q:40 40/3/9 :)2r(2Q:40 40/3/9 :guA:40 40/01/8 :noisiveR 40/2/9:)F(2Q:40 4Q:60-3Q:40 40/51/9 40 .peS 40/8/01 :3Q:40 40/8/01 :peS:40 40/31/01 :).rrE(2Q:40 40/92/9:)F(2Q:40 40/92/01:)A(3Q:40 4Q:60-4Q:40 40/3/11 40 .voN 40/5/11 :)1r(3Q:40 40/5/11 :tcO:40 40/4/11:)P(3Q:40 40/03/11:)P(3Q:40 40/3/21 :)2r(3Q:40 40/3/21 :voN:40 40/7/21:)F(3Q:40 4Q:60-4Q:40 40/8/21 40 .ceD .4002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF koobneerG :71 elbaT 49

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 19/6/21 :)2r(3Q:19 19/6/21 :voN:19 29/3/1:)F(3Q:19 19/02/21:)F(3Q:19 29/01/1 :4Q:19 SPC&ceD:19 4Q:39-4Q:19 29/01/1 †29 .naJ 29/01/1 :snoisiveR 29/7/2 :)1r(4Q:19 29/7/2 :naJ:29 29/50/2:)P(4Q:69 29/92/1:)A(4Q:19 4Q:39-1Q:29 29/01/2 29 .beF 29/6/3 :)2r(4Q:19 29/6/3 :beF:29 29/82/2:)P(4Q:19 29/01/3:)P(4Q:69 4Q:39-1Q:29 29/01/3 29 .raM 29/3/4 :1Q:29 29/3/4 :raM:29 29/62/3:)F(4Q:19 4Q:39-1Q:29 29/01/4 †29 .rpA 29/8/5 :)1r(1Q:29 29/8/5 :rpA:29 – 29/82/4:)A(1Q:29 4Q:39-2Q:29 29/01/5 ∗29 yaM 29/5/6 :)2r(1Q:29 SEC&yaM:29 – 29/92/5:)P(1Q:29 29/5/6 :snoisiveR 29/52/6:)F(1Q:29 4Q:39-2Q:29 29/01/6 ∗29 .nuJ 29/2/7 :2Q:29 29/2/7 :nuJ:29 29/71/6:)F,P(1Q:29 29/52/6:)F(1Q:29 4Q:39-2Q:29 29/01/7 †29 .luJ 29/7/8 :)1r(2Q:29 29/7/8 :luJ:29 – .nnA&)A(2Q:29 29/03/7 :snoisiveR 4Q:39-3Q:29 29/01/8 ∗29 .guA 29/4/9 :)2r(2Q:29 29/4/9 :guA:29 29/11/8:)P(2Q:29 29/72/8:)P(2Q:29 29/3/9:)F(2Q:29 4Q:39-3Q:29 29/01/9 29 .peS 29/2/01 :3Q:29 29/2/01 :peS:29 – 29/42/9:)F(2Q:29 4Q:39-3Q:29 29/01/01 †29 .tcO 29/6/11 :)1r(3Q:29 29/6/11 :tcO:29 29/50/11:)P(3Q:29 29/72/01:)A(3Q:29 4Q:39-4Q:29 29/01/11 29 .voN 29/4/21 :)2r(3Q:29 29/4/21 :voN:29 29/3/21:)F(3Q:29 29/52/11:)P(3Q:29 4Q:39-4Q:29 29/01/21 29 .ceD .2991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :81 elbaT 50

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 39/8/1 :4Q:29 SPC&ceD:29 – 29/22/21:)F(3Q:29 39/8/1 :snoisiveR 4Q:49-4Q:29 39/01/1 †39 .naJ 39/5/2 :)1r(4Q:29 39/5/2 :naJ:39 39/4/2:)P(4Q:29 39/82/1:)A(4Q:29 4Q:49-1Q:39 39/01/2 39 .beF 39/5/3 :)2r(4Q:29 39/5/3 :beF:39 .nnA&)F(4Q:29 39/62/2:)P(4Q:29 39/9/3 :snoisiveR 4Q:49-1Q:39 39/01/3 39 .raM 39/2/4 :1Q:39 39/2/4 :raM:39 – 39/62/3:)F(4Q:29 4Q:49-1Q:39 39/01/4 †39 .rpA 39/7/5 :)1r(1Q:39 39/7/5 :rpA:39 39/6/5:)P(1Q:39 39/92/4:)A(1Q:39 4Q:49-2Q:39 39/01/5 39 yaM 39/4/6 :)2r(1Q:39 SEC&yaM:39 – 39/82/5:)P(1Q:39 39/4/6 :snoisiveR 39/32/6:)F(1Q:39 4Q:49-2Q:39 39/01/6 39 .nuJ 39/2/7 :2Q:39 39/2/7 :nuJ:39 39/71/6:)F(1Q:39 39/32/6:)F(1Q:39 4Q:49-2Q:39 39/01/7 †39 .luJ 39/6/8 :)1r(2Q:39 39/6/8 :luJ:39 – 39/92/7)A(2Q:39 39/01/8:)P(2Q:39 4Q:49-3Q:39 39/01/8 39 .guA 39/3/9 :)2r(2Q:39 39/3/9 :guA:39 39/9/9:)F(2Q:39 .nnA&)P(2Q:39 39/13/8 :snoisiveR 4Q:49-3Q:39 39/01/9 39 .peS 39/8/01 :3Q:39 39/8/01 :peS:39 – 39/92/9:)F(2Q:39 4Q:49-3Q:39 39/01/01 †39 .tcO 39/5/11 :)1r(3Q:39 39/5/11 :tcO:39 39/4/11:)P(3Q:39 39/82/01:)A(3Q:39 4Q:49-4Q:39 39/01/11 39 .voN 39/3/21 :)2r(3Q:39 39/3/21 :voN:39 39/8/21:)F(3Q:39 39/1/21:)P(3Q:39 4Q:49-4Q:39 39/01/21 39 .ceD .3991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :91 elbaT 51

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 49/7/1 :4Q:89 SPC&ceD:39 – 39/22/21:)F(3Q:39 49/7/1 :snoisiveR 4Q:59-4Q:39 49/01/1 †49 .naJ 49/4/2 :)1r(4Q:89 49/4/2 :naJ:49 49/8/2:)P(4Q:39 49/82/1:)A(4Q:39 4Q:59-1Q:49 49/01/2 49 .beF 49/4/3 :)2r(4Q:89 49/4/3 :beF:49 .nnA&)F(4Q:39 49/1/3:)P(4Q:39 49/8/3 :snoisiveR 4Q:59-1Q:49 49/01/3 49 .raM 49/1/4 :1Q:49 49/1/4 :raM:49 – 49/13/3:)F(4Q:39 4Q:59-1Q:49 49/01/4 †49 .rpA 49/6/5 :)1r(1Q:49 49/6/5 :rpA:49 49/5/5:)P(1Q:49 49/82/4:)A(1Q:49 4Q:59-2Q:49 49/01/5 49 yaM 49/3/6 :)2r(1Q:49 SEC&yaM:49 – 49/72/5:)P(1Q:49 49/3/6 :snoisiveR 49/92/6:)F(1Q:49 4Q:59-2Q:49 49/01/6 49 .nuJ 49/8/7 :2Q:49 49/8/7 :nuJ:49 49/51/6:)F(1Q:49 49/92/6:)F(1Q:49 4Q:59-2Q:49 49/01/7 †49 .luJ 49/5/8 :)1r(2Q:49 49/5/8 :luJ:49 49/9/8:)P(2Q:49 .nnA&)A(2Q:49 49/92/7 :snoisiveR 4Q:59-3Q:49 49/01/8 49 .guA 49/2/9 :)2r(2Q:49 49/2/9 :guA:49 49/7/9:)F(2Q:49 49/62/8:)P(2Q:49 4Q:59-3Q:49 49/01/9 49 .peS 49/7/01 :3Q:49 49/7/01 :peS:49 – 49/92/9:)F(2Q:49 4Q:59-3Q:49 49/01/01 †49 .tcO 49/4/11 :)1r(3Q:49 49/4/11 :tcO:49 49/90/11:)P(3Q:49 49/82/01:)A(3Q:49 4Q:59-4Q:49 49/01/11 49 .voN 49/2/21 :)2r(3Q:49 49/2/21 :voN:49 49/7/21:)F(3Q:49 49/03/11:)P(3Q:49 4Q:59-4Q:49 49/01/21 49 .ceD .4991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :02 elbaT 52

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 59/6/1 :4Q:99 SPC&ceD:99 – 49/22/21:)F(3Q:49 59/6/1 :snoisiveR 4Q:69-4Q:49 59/01/1 †59 .naJ 59/3/2 :)1r(4Q:99 59/3/2 :naJ:59 59/7/2:)P(4Q:49 59/72/1:)A(4Q:49 4Q:69-1Q:59 59/01/2 59 .beF .nnA&)F(4Q:49 59/10/3:)P(4Q:49 59/8/3 :snoisiveR 59/01/3 :)2r(4Q:99 59/01/3 :beF:59 4Q:69-1Q:59 59/01/3 59 .raM 59/7/4 :1Q:59 59/7/4 :raM:59 – 59/13/3:)F(4Q:49 4Q:69-1Q:59 59/01/4 †59 .rpA 59/5/5 :)1r(1Q:59 59/5/5 :rpA:59 59/9/5:)P(1Q:59 59/82/4:)A(1Q:59 4Q:69-2Q:59 59/01/5 59 yaM 59/2/6 :)2r(1Q:59 SEC&yaM:59 – 59/13/5:)P(1Q:59 59/2/6 :snoisiveR 4Q:69-2Q:59 59/01/6 59 .nuJ 59/7/7 :2Q:59 59/7/7 :nuJ:59 59/12/6:)F(1Q:59 59/03/6:)F(1Q:59 4Q:69-2Q:59 59/01/7 †59 .luJ 59/4/8 :)1r(2Q:59 59/4/8 :luJ:59 59/8/8:)P(2Q:59 59/82/7:)A(2Q:59 4Q:69-3Q:59 59/01/8 59 .guA 59/1/9 :)2r(2Q:59 59/1/9 :guA:59 59/7/9:)F(2Q:59 59/03/8:)P(2Q:59 4Q:69-3Q:59 59/01/9 59 .peS 59/6/01 :3Q:59 59/6/01 :peS:59 – 59/92/9:)F(2Q:59 4Q:69-3Q:59 59/01/01 †59 .tcO 59/3/11 :)1r(3Q:59 59/3/11 :tcO:59 59/7/11:)P(3Q:59 59/72/01:)A(3Q:59 4Q:69-4Q:59 59/01/11 59 .voN 59/8/21 :)2r(3Q:59 59/8/21 :voN:59 nwodtuhS nwodtuhS 4Q:69-4Q:59 59/01/21 59 .ceD .5991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :12 elbaT 53

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN nwodtuhS nwodtuhS – nwodtuhS 4Q:79-4Q:59 69/01/1 69 .naJ 69/91/1 :4Q:00 SPC&ceD:59 69/8/2:)F(3Q:59 .pmoC&)F,P(3Q:59 69/2/2 :)1r(4Q:00 69/91/1 :snoisiveR 69/91/1 :snoisiveR 69/2/2 :naJ:69 4Q:79-1Q:69 69/01/2 ∗69 .beF 69/8/3 :)2r(4Q:00 69/8/3 :beF:69 69/6/3:)P(4Q:59 69/32/2:)P,A(4Q:59 4Q:79-1Q:69 69/01/3 69 .raM 69/5/4 :1Q:69 69/5/4 :raM:69 69/2/4:)F(4Q:59 .nnA&)F(4Q:59 4Q:79-1Q:69 69/01/4 †69 .rpA 69/01/4 :snoisiveR 69/3/5 :)1r(1Q:69 69/3/5 :rpA:69 69/2/5:)A(1Q:69 4Q:79-2Q:69 69/01/5 ∗69 yaM 69/7/6 :)2r(1Q:69 SEC&yaM:69 69/61/5:)P(1Q:69 69/03/5:)P(1Q:69 69/7/6 :snoisiveR 4Q:79-2Q:69 69/01/6 69 .nuJ 69/5/7 :2Q:69 69/5/7 :nuJ:69 69/81/6:)F(1Q:69 69/82/6:)F(1Q:69 4Q:79-2Q:69 69/01/7 †69 .luJ 69/2/8 :)1r(2Q:69 69/2/8 :luJ:69 APIN&)P(2Q:69 .nnA&)A(2Q:69 69/41/8 :snoisiveR 69/10/8 :snoisiveR 4Q:79-3Q:69 69/01/8 ∗69 .guA 69/6/9 :)2r(2Q:69 69/6/9 :guA:69 – 69/92/8:)P(2Q:69 69/01/9:)F(2Q:69 4Q:79-3Q:69 69/01/9 69 .peS 69/4/01 :3Q:69 69/4/01 :peS:69 – 69/72/9:)F(2Q:69 4Q:79-3Q:69 69/01/01 †69 .tcO 69/1/11 :)1r(3Q:69 69/1/11 :tcO:69 69/7/11:)P(3Q:69 69/03/01:)A(3Q:69 4Q:79-4Q:69 69/01/11 69 .voN 69/6/21 :)2r(3Q:69 69/6/21 :voN:69 69/5/21:)F(3Q:69 69/72/11:)P(3Q:69 4Q:79-4Q:69 69/01/21 69 .ceD .6991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :22 elbaT 54

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 69/6/21 :)2r(3Q:69 69/6/21 :voN:69 69/5/21:)F(3Q:69 69/02/21:)F(3Q:69 79/01/1 :4Q:69 SPC&ceD:69 4Q:89-4Q:69 79/01/1 †79 .naJ 79/7/2 :)1r(4Q:69 79/01/1 :snoisiveR 79/7/2 :naJ:79 – 79/13/1:)A(4Q:69 4Q:89-1Q:79 79/01/2 ∗79 .beF 79/7/3 :)2r(4Q:69 79/7/3 :beF:79 79/11/2:)P(4Q:69 79/82/2:)P(4Q:69 4Q:89-1Q:79 79/01/3 79 .raM 79/4/4 :1Q:79 79/4/4 :raM:79 .nnA&)F(4Q:69 79/82/3:)F(4Q:69 79/11/3 :snoisiveR 4Q:89-1Q:79 79/01/4 †79 .rpA 79/2/5 :)1r(1Q:79 79/2/5 :rpA:79 79/70/5:)P(1Q:79 79/03/4:)A(1Q:79 79/7/5 :)r,A(1Q:79 4Q:89-2Q:79 79/01/5 79 yaM 79/6/6 :)2r(1Q:79 SEC&yaM:79 – 79/03/5:)P(1Q:79 79/6/6 :snoisiveR 4Q:89-2Q:79 79/01/6 79 .nuJ 79/3/7 :2Q:79 79/3/7 :nuJ:79 79/81/6:)F(1Q:79 79/72/6:)F(1Q:79 4Q:89-2Q:79 79/01/7 †79 .luJ 79/1/8 :)1r(2Q:79 79/1/8 :luJ:79 – .nnA&)A(2Q:79 79/13/7 :snoisiveR 4Q:89-3Q:79 79/01/8 ∗79 .guA 79/5/9 :)2r(2Q:79 79/5/9 :guA:79 79/21/8:)P(2Q:79 79/82/8:)P(2Q:79 79/9/9:)F(2Q:79 4Q:89-3Q:79 79/01/9 79 .peS 79/3/01 :3Q:79 79/3/01 :peS:79 – 79/62/9:)F(2Q:79 4Q:89-3Q:79 79/01/01 †79 .tcO 79/7/11 :)1r(3Q:79 79/7/11 :tcO:79 – 79/13/01:)A(3Q:79 4Q:89-4Q:79 79/01/11 ∗79 .voN 79/5/21 :)2r(3Q:79 79/5/21 :voN:79 79/31/11:)P(3Q:79 79/62/11:)P(3Q:79 79/4/21:)F(3Q:79 4Q:89-4Q:79 79/01/21 79 .ceD .7991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :32 elbaT 55

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 89/9/1 :4Q:79 SPC&ceD:79 – 79/32/21:)F(3Q:79 89/9/1 :snoisiveR 4Q:99-4Q:79 89/01/1 †89 .naJ 89/6/2 :)1r(4Q:79 89/6/2 :naJ:89 – 89/03/1:)A(4Q:79 89/01/2:)P(4Q:79 4Q:99-1Q:89 89/01/2 89 .beF 89/6/3 :)2r(4Q:79 89/6/3 :beF:89 – 89/72/2:)P(4Q:79 .nnA&)F(4Q:79 4Q:99-1Q:89 89/01/3 89 .raM 89/01/3 :snoisiveR 89/3/4 :1Q:89 89/3/4 :raM:89 – 89/62/3:)F(4Q:79 4Q:99-1Q:89 89/01/4 †89 .rpA 89/8/5 :)1r(1Q:89 89/8/5 :rpA:89 89/70/5:)P(1Q:89 89/03/4:)A(1Q:89 4Q:99-2Q:89 89/01/5 89 yaM 89/5/6 :)2r(1Q:89 SEC&yaM:89 89/4/6:)F(1Q:89 89/82/5:)P(1Q:89 89/5/6 :snoisiveR 4Q:99-2Q:89 89/01/6 89 .nuJ 89/2/7 :2Q:89 89/2/7 :nuJ:89 – 89/52/6:)F(1Q:89 4Q:99-2Q:89 89/01/7 †89 .luJ 89/7/8 :)1r(2Q:89 89/7/8 :luJ:89 – .nnA&)A(2Q:89 89/13/7 :snoisiveR 4Q:99-3Q:89 89/01/8 ∗89 .guA 89/4/9 :)2r(2Q:89 89/4/9 :guA:89 89/11/8:)P(2Q:89 89/72/8:)P(2Q:89 89/3/9:)F(2Q:89 4Q:99-3Q:89 89/01/9 89 .peS 89/2/01 :3Q:89 89/2/01 :peS:89 – 89/42/9:)F(2Q:89 4Q:99-3Q:89 89/01/01 †89 .tcO 89/5/11 :)1r(3Q:89 89/5/11 :tcO:89 – 89/03/01:)A(3Q:89 89/01/11:)P(3Q:89 4Q:99-4Q:89 89/01/11 89 .voN 89/4/21 :)2r(3Q:89 89/4/21 :voN:89 89/3/21:)F(3Q:89 89/42/11:)P(3Q:89 4Q:99-4Q:89 89/01/21 89 .ceD .8991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :42 elbaT 56

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 99/8/1 :4Q:89 SPC&ceD:89 – 89/32/21:)F(3Q:89 99/8/1 :snoisiveR 4Q:00-4Q:89 99/01/1 †99 .naJ 99/5/2 :)1r(4Q:89 99/5/2 :naJ:99 99/9/2:)P(4Q:89 99/92/1:)A(4Q:89 4Q:00-1Q:99 99/01/2 99 .beF 99/5/3 :)2r(4Q:89 99/5/3 :beF:99 .nnA&)F(4Q:89 99/62/2:)P(4Q:89 99/9/3 :snoisiveR 4Q:00-1Q:99 99/01/3 99 .raM 99/2/4 :1Q:99 99/2/4 :raM:99 – 99/13/3:)F(4Q:89 4Q:00-1Q:99 99/01/4 †99 .rpA 99/7/5 :)1r(1Q:99 99/7/5 :rpA:99 – 99/03/4:)A(1Q:99 4Q:00-2Q:99 99/01/5 ∗99 yaM 99/4/6 :)2r(1Q:99 SEC&yaM:99 99/11/5:)P(1Q:99 99/72/5:)P(1Q:99 99/4/6 :snoisiveR 99/8/6:)F(1Q:99 4Q:00-2Q:99 99/01/6 99 .nuJ 99/2/7 :2Q:99 99/2/7 :nuJ:99 – 99/52/6:)F(1Q:99 4Q:00-2Q:99 99/01/7 †99 .luJ 99/6/8 :)1r(2Q:99 99/6/8 :luJ:99 99/5/8:)P(2Q:99 99/92/7:)A(2Q:99 4Q:00-3Q:99 99/01/8 99 .guA 99/3/9 :)2r(2Q:99 99/3/9 :guA:99 99/2/9:)F(2Q:99 99/62/8:)P(2Q:99 4Q:00-3Q:99 99/01/9 99 .peS 99/8/01 :3Q:99 99/8/01 :peS:99 – 99/03/9:)F(2Q:99 4Q:00-3Q:99 99/01/01 †99 .tcO 99/5/11 :)1r(3Q:99 99/5/11 :tcO:99 – .pmoC&)A(3Q:99 99/92/01 :snoisiveR 4Q:00-4Q:99 99/01/11 ∗99 .voN 99/3/21 :)2r(3Q:99 99/3/21 :voN:99 99/21/11:)P(3Q:99 99/42/11:)P(3Q:99 99/7/21:)F(3Q:99 4Q:00-4Q:99 99/01/21 99 .ceD .9991 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :52 elbaT 57

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 00/7/1 :4Q:99 SPC&ceD:99 – 99/22/21:)F(3Q:99 00/7/1 :snoisiveR 4Q:10-4Q:99 00/01/1 †00 .naJ 00/4/2 :)1r(4Q:99 00/4/2 :naJ:00 00/8/2:)P(4Q:99 00/82/1:)A(4Q:99 4Q:10-1Q:00 00/01/2 00 .beF 00/3/3 :)2r(4Q:99 00/3/3 :beF:00 .nnA&)F(4Q:99 00/52/2:)P(4Q:99 00/7/3 :snoisiveR 4Q:10-1Q:00 00/01/3 00 .raM 00/7/4 :1Q:00 00/7/4 :raM:00 – 00/03/3:)F(4Q:99 00/3/4 :)r,F(4Q:99 4Q:10-1Q:00 00/01/4 †00 .rpA 00/5/5 :)1r(1Q:00 00/5/5 :rpA:00 00/4/5:)P(1Q:00 00/72/4:)A(1Q:00 4Q:10-2Q:00 00/01/5 00 yaM 00/2/6 :)2r(1Q:00 SEC&yaM:00 00/6/6:)F(1Q:00 00/52/5:)P(1Q:00 00/2/6 :snoisiveR 4Q:10-2Q:00 00/01/6 00 .nuJ 00/7/7 :2Q:00 00/7/7 :nuJ:00 – 00/92/6:)F(1Q:00 4Q:10-2Q:00 00/01/7 †00 .luJ 00/4/8 :)1r(2Q:00 00/4/8 :luJ:00 APIN&)P(2Q:00 .nnA&)A(2Q:00 00/8/8 :snoisiveR 00/82/7 :snoisiveR 4Q:10-3Q:00 00/01/8 00 .guA 00/1/9 :)2r(2Q:00 00/1/9 :guA:00 00/6/9:)F(2Q:00 00/52/8:)P(2Q:00 4Q:10-3Q:00 00/01/9 00 .peS 00/6/01 :3Q:00 00/6/01 :peS:00 – 00/82/9:)F(2Q:00 4Q:10-3Q:00 00/01/01 †00 .tcO 00/3/11 :)1r(3Q:00 00/3/11 :tcO:00 00/2/11:)P(3Q:00 00/72/01:)A(3Q:00 4Q:10-4Q:00 00/01/11 00 .voN 00/8/21 :)2r(3Q:00 00/8/21 :voN:00 00/6/21:)F(3Q:00 00/92/11:)P(3Q:00 4Q:10-4Q:00 00/01/21 00 .ceD .0002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :62 elbaT 58

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 10/5/1 :4Q:00 SPC&ceD:00 – 00/12/21:)F(3Q:00 10/5/1 :snoisiveR 4Q:20-4Q:00 10/01/1 †10 .naJ 10/2/2 :)1r(4Q:00 10/2/2 :naJ:10 10/7/2:)P(4Q:00 10/13/1:)A(4Q:00 4Q:20-1Q:10 10/01/2 10 .beF 10/9/3 :)2r(4Q:00 10/9/3 :beF:10 .nnA&)F(4Q:00 10/82/2:)P(4Q:00 10/6/3 :snoisiveR 4Q:20-1Q:10 10/01/3 10 .raM 10/6/4 :1Q:10 10/6/4 :raM:10 – 10/92/3:)F(4Q:00 4Q:20-1Q:10 10/01/4 †10 .rpA 10/4/5 :)1r(1Q:10 10/4/5 :rpA:10 10/8/5:)P(1Q:10 10/72/4:)A(1Q:10 4Q:20-2Q:10 10/01/5 10 yaM 10/1/6 :)2r(1Q:10 SEC&yaM:10 10/5/6:)F(1Q:10 10/52/5:)P(1Q:10 10/1/6 :snoisiveR 4Q:20-2Q:10 10/01/6 10 .nuJ 10/6/7 :2Q:10 10/6/7 :nuJ:10 – 10/92/6:)F(1Q:10 4Q:20-2Q:10 10/01/7 †10 .luJ 10/3/8 :)1r(2Q:10 10/3/8 :luJ:10 APIN&)P(2Q:10 .nnA&)A(2Q:10 10/7/8 :snoisiveR 10/72/7 :snoisiveR 4Q:20-3Q:10 10/01/8 10 .guA 10/7/9 :)2r(2Q:10 10/7/9 :guA:10 10/5/9:)F(2Q:10 10/92/8:)P(2Q:10 4Q:20-3Q:10 10/01/9 10 .peS 10/5/01 :3Q:10 10/5/01 :peS:10 – 10/82/9:)F(2Q:10 4Q:20-3Q:10 10/01/01 †10 .tcO 10/2/11 :)1r(3Q:10 10/2/11 :tcO:10 10/7/11:)P(3Q:10 10/13/01:)A(3Q:10 4Q:20-4Q:10 10/01/11 10 .voN 10/7/21 :)2r(3Q:10 10/7/21 :voN:10 10/6/21:)F(3Q:10 10/03/11:)P(3Q:10 4Q:20-4Q:10 10/01/21 10 .ceD .1002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :72 elbaT 59

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 20/4/1 :4Q:10 SPC&ceD:10 – 10/12/21:)F(3Q:10 20/4/1 :snoisiveR 4Q:30-4Q:20 20/01/1 †20 .naJ 20/1/2 :)1r(4Q:10 10/1/2 :naJ:20 20/6/2:)P(4Q:10 20/03/1:)A(4Q:10 4Q:30-1Q:20 20/01/2 20 .beF 20/8/3 :)2r(4Q:10 20/8/3 :beF:20 .nnA&)F(4Q:10 20/82/2:)P(4Q:10 20/7/3 :snoisiveR 4Q:30-1Q:20 20/01/3 20 .raM 20/5/4 :1Q:20 20/5/4 :raM:20 – 20/82/3:)F(4Q:10 4Q:30-1Q:20 20/01/4 †20 .rpA 20/3/5 :)1r(1Q:20 20/3/5 :rpA:20 20/7/5:)P(1Q:20 20/62/4:)A(1Q:20 4Q:30-2Q:20 20/01/5 20 yaM 20/7/6 :)2r(1Q:20 SEC&yaM:20 20/13/5:)F(1Q:20 20/42/5:)P(1Q:20 20/7/6 :snoisiveR 4Q:30-2Q:20 20/01/6 20 .nuJ 20/5/7 :2Q:20 20/5/7 :nuJ:20 – 20/72/6:)F(1Q:20 4Q:30-2Q:20 20/01/7 †20 .luJ 20/2/8 :)1r(2Q:20 20/2/8 :luJ:20 APIN&)P(2Q:20 .nnA&)A(2Q:20 20/9/8 :snoisiveR 20/13/7 :snoisiveR 4Q:30-3Q:20 20/01/8 20 .guA 20/6/9 :)2r(2Q:20 20/6/9 :guA:20 20/5/9:)F(2Q:20 20/92/8:)P(2Q:20 4Q:30-3Q:20 20/01/9 20 .peS 20/4/01 :3Q:20 20/4/01 :peS:20 – 20/72/9:)F(2Q:20 4Q:30-3Q:20 20/01/01 †20 .tcO 20/1/11 :)1r(3Q:20 20/1/11 :tcO:20 20/7/11:)P(3Q:20 20/13/01:)A(3Q:20 4Q:30-4Q:20 20/01/11 20 .voN 20/6/21 :)2r(3Q:20 20/6/21 :voN:20 20/4/21:)F(3Q:20 20/62/11:)P(3Q:20 4Q:30-4Q:20 20/01/21 20 .ceD .2002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :82 elbaT 60

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 30/01/1 :4Q:20 – 20/02/21:)F(3Q:20 SPC&ceD:20 4Q:40-4Q:20 30/01/1 †30 .naJ 30/01/1 :snoisiveR 30/7/2 :)1r(4Q:20 30/7/2 :naJ:30 30/6/2:)P(4Q:20 30/03/1:)A(4Q:20 4Q:40-1Q:30 30/01/2 30 .beF 30/7/3 :)2r(4Q:20 30/7/3 :beF:30 .nnA&)F(4Q:20 30/82/2:)P(4Q:20 30/6/3 :snoisiveR 4Q:40-1Q:30 30/01/3 30 .raM 30/4/4 :1Q:30 30/4/4 :raM:30 – 30/72/3:)F(4Q:20 4Q:40-1Q:30 30/01/4 †30 .rpA 30/2/5 :)1r(1Q:30 30/2/5 :rpA:30 30/1/5:)P(1Q:30 30/52/4:)A(1Q:30 4Q:40-2Q:30 30/01/5 30 yaM 30/6/6 :)2r(1Q:30 SEC&yaM:30 30/4/6:)F(1Q:30 30/92/5:)P(1Q:30 30/6/6 :snoisiveR 4Q:40-2Q:30 30/01/6 30 .nuJ 30/3/7 :2Q:30 30/3/7 :nuJ:30 – 30/62/6:)F(1Q:30 4Q:40-2Q:30 30/01/7 †30 .luJ 30/1/8 :)1r(2Q:30 30/1/8 :luJ:30 30/7/8:)P(2Q:30 30/13/7:)A(2Q:30 4Q:40-3Q:30 30/01/8 30 .guA 30/5/9 :)2r(2Q:30 30/5/9 :guA:30 30/4/9:)F(2Q:30 30/82/8:)P(2Q:30 4Q:40-3Q:30 30/01/9 30 .peS 30/3/01 :3Q:30 30/3/01 :peS:30 – 30/62/9:)F(2Q:30 4Q:40-3Q:30 30/01/01 †30 .tcO 30/7/11 :)1r(3Q:30 30/7/11 :tcO:30 30/6/11:)P(3Q:30 30/03/01:)A(3Q:30 4Q:40-4Q:30 30/01/11 30 .voN 30/5/21 :)2r(3Q:30 30/5/21 :voN:30 30/3/21:)F(3Q:30 30/52/11:)P(3Q:30 4Q:40-4Q:30 30/01/21 30 .ceD .3002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :92 elbaT 61

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 40/9/1 :4Q:30 SPC&ceD:30 – 30/01/21 :.veR .pmoC 40/9/1 :snoisiveR – 30/32/21:)F(3Q:30 4Q:50-4Q:30 40/01/1 †40 .naJ 40/6/2 :)1r(4Q:30 SEC&naJ:40 40/5/2:)P(4Q:30 40/03/1:)A(4Q:30 60/6/2 :snoisiveR 4Q:50-1Q:40 40/01/2 40 .beF 40/5/3 :)2r(4Q:30 40/5/3 :beF:40 .nnA&)F(4Q:30 40/72/2:)P(4Q:30 40/4/3 :snoisiveR 4Q:50-1Q:40 40/01/3 40 .raM 40/2/4 :1Q:40 40/2/4 :raM:40 – 40/52/3:)F(4Q:70 4Q:50-1Q:40 40/01/4 †40 .rpA 40/7/5 :)1r(1Q:40 40/7/5 :rpA:40 40/6/5:)P(1Q:40 40/92/4:)A(1Q:40 4Q:50-2Q:40 40/01/5 40 yaM 40/4/6 :)2r(1Q:40 40/4/6 :yaM:40 40/3/6:)F(1Q:40 40/72/5:)P(1Q:40 4Q:50-2Q:40 40/01/6 40 .nuJ 40/2/7 :2Q:40 40/2/7 :nuJ:40 – 40/52/6:)F(1Q:40 4Q:50-2Q:40 40/01/7 †40 .luJ 40/6/8 :)1r(2Q:40 40/6/8 :luJ:40 – .nnA&)A(2Q:40 40/03/7 :noisiveR APIN&)P(2Q:40 4Q:50-3Q:40 40/01/8 40 .guA 40/01/8 :noisiveR 40/3/9 :)2r(2Q:40 40/3/9 :guA:40 40/2/9:)F(2Q:40 40/72/8:)P(2Q:40 4Q:50-3Q:40 40/01/9 40 .peS 40/8/01 :3Q:40 40/8/01 :peS:40 – 40/92/9:)F(2Q:40 4Q:50-3Q:40 40/01/01 †40 .tcO 40/5/11 :)1r(3Q:40 40/5/11 :tcO:40 40/31/01 :).rrE(2Q:40 40/92/01:)A(3Q:40 40/4/11:)P(3Q:40 4Q:50-4Q:40 40/01/11 40 .voN 40/3/21 :)2r(3Q:40 40/3/21 :voN:40 40/7/21:)F(3Q:40 40/03/11:)P(3Q:40 4Q:50-4Q:40 40/01/21 40 .ceD .4002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :03 elbaT 62

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 50/7/1 :4Q:40 SPC&ceD:40 40/7/21:)F(3Q:40 40/22/21:)F(3Q:40 50/7/1 :snoisiveR 4Q:60-4Q:40 50/01/1 †50 .naJ 50/4/2 :)1r(4Q:40 SEC&naJ:50 50/3/2:)P(4Q:40 50/82/1:)A(4Q:40 50/4/2 :snoisiveR 4Q:60-1Q:50 50/01/2 50 .beF 50/4/3 :)2r(4Q:40 50/4/3 :beF:50 .nnA&)F(4Q:40 50/52/2:)P(4Q:40 50/3/3 :snoisiveR 4Q:60-1Q:50 50/01/3 50 .raM 50/1/4 :1Q:50 50/1/4 :raM:50 – 50/03/3:)F(4Q:40 4Q:60-1Q:50 50/01/4 †50 .rpA 50/6/5 :)1r(1Q:50 50/6/5 :rpA:50 50/5/5:)P(1Q:50 50/82/4:)A(1Q:50 4Q:60-2Q:50 50/01/5 50 yaM 50/3/6 :)2r(1Q:50 50/3/6 :yaM:50 50/2/6:)F(1Q:50 50/62/5:)P(1Q:50 4Q:60-2Q:50 50/01/6 50 .nuJ 50/8/7 :2Q:50 50/8/7 :nuJ:50 – 50/92/6:)F(1Q:50 4Q:60-2Q:50 50/01/7 †50 .luJ 50/5/8 :)1r(2Q:50 50/5/8 :luJ:50 APIN&)P(2Q:50 .nnA&)A(2Q:50 50/9/8 :snoisiveR 50/92/7 :snoisiveR 4Q:60-3Q:50 50/01/8 50 .guA 50/2/9 :)2r(2Q:50 50/2/9 :guA:50 50/7/9:)F(2Q:50 50/13/8:)P(2Q:50 4Q:60-3Q:50 50/01/9 50 .peS 50/7/01 :3Q:50 50/7/01 :peS:50 – 50/92/9:)F(2Q:50 4Q:60-3Q:50 50/01/01 †50 .tcO 50/4/11 :)1r(3Q:50 50/4/11 :tcO:50 50/3/11:)P(3Q:50 50/82/01:)A(3Q:50 4Q:60-4Q:50 50/01/11 50 .voN 50/2/21 :)2r(3Q:50 50/2/21 :voN:50 50/6/21:)F(3Q:50 50/03/11:)P(3Q:50 4Q:60-4Q:50 50/01/21 50 .ceD .5002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :13 elbaT 63

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 60/6/1 :4Q:50 SPC&ceD:50 – 50/12/21:)F(3Q:50 60/6/1 :snoisiveR 4Q:70-4Q:50 60/01/1 †60 .naJ 60/3/2 :)1r(4Q:50 SEC&naJ:60 60/2/2:)P(4Q:50 60/72/1:)A(4Q:50 60/3/2 :snoisiveR 4Q:70-1Q:60 60/01/2 60 .beF .nnA&)F(4Q:50 60/82/2:)P(4Q:50 60/7/3 :snoisiveR 60/01/3 :)2r(4Q:50 60/01/3 :beF:60 4Q:70-1Q:60 60/01/3 60 .raM 60/7/4 :1Q:60 60/7/4 :raM:60 – 60/03/3:)F(4Q:50 4Q:70-1Q:60 60/01/4 †60 .rpA 60/5/5 :)1r(1Q:60 60/5/5 :rpA:60 60/4/5:)P(1Q:60 60/82/4:)A(1Q:60 4Q:70-2Q:60 60/01/5 60 yaM 60/2/6 :)2r(1Q:60 60/2/6 :yaM:60 60/1/6:)F(1Q:60 60/52/5:)P(1Q:60 4Q:70-2Q:60 60/01/6 60 .nuJ 60/7/7 :2Q:60 60/7/7 :nuJ:60 – 60/92/6:)F(1Q:60 4Q:70-2Q:60 60/01/7 †60 .luJ 60/4/8 :)1r(2Q:60 60/4/8 :luJ:60 APIN&)P(2Q:60 .nnA&)A(2Q:60 60/8/8 :snoisiveR 60/82/7 :snoisiveR 4Q:70-3Q:60 60/01/8 60 .guA 60/1/9 :)2r(2Q:60 60/1/9 :guA:60 60/6/9:)F(2Q:60 60/03/8:)P(2Q:60 4Q:70-3Q:60 60/01/9 60 .peS 60/6/01 :3Q:60 60/6/01 :peS:60 – 60/82/9:)F(2Q:60 4Q:70-3Q:60 60/01/01 †60 .tcO 60/3/11 :)1r(3Q:60 60/3/11 :tcO:60 60/2/11:)P(3Q:60 60/72/01:)A(3Q:60 4Q:70-4Q:60 60/01/11 60 .voN 60/8/21 :)2r(3Q:60 60/8/21 :voN:60 60/5/21:)F(3Q:60 60/92/11:)P(3Q:60 4Q:70-4Q:60 60/01/21 60 .ceD .6002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :23 elbaT 64

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 70/5/1 :4Q:60 SPC&ceD:60 – 60/12/21:)F(3Q:60 70/5/1 :snoisiveR 4Q:80-4Q:60 70/01/1 †70 .naJ 70/2/2 :)1r(4Q:60 SEC&naJ:70 70/7/2:)P(4Q:60 70/13/1:)A(4Q:60 70/2/2 :snoisiveR 4Q:80-1Q:70 70/01/2 70 .beF 70/9/3 :)2r(4Q:60 70/9/3 :beF:70 .nnA&)F(4Q:60 70/82/2:)P(4Q:60 70/6/3 :snoisiveR 4Q:80-1Q:70 70/01/3 70 .raM 70/6/4 :1Q:70 70/6/4 :raM:70 – 70/92/3:)F(4Q:60 4Q:80-1Q:70 70/01/4 †70 .rpA 70/4/5 :)1r(1Q:70 70/4/5 :rpA:70 70/3/5:)P(1Q:70 70/72/4:)A(1Q:70 4Q:80-2Q:70 70/01/5 70 yaM 70/1/6 :)2r(1Q:70 70/1/6 :yaM:70 70/6/6:)F(1Q:70 70/13/5:)P(1Q:70 4Q:80-2Q:70 70/01/6 70 .nuJ 70/6/7 :2Q:70 70/6/7 :nuJ:70 – 70/82/6:)F(1Q:70 4Q:80-2Q:70 70/01/7 †70 .luJ 70/3/8 :)1r(2Q:70 70/3/8 :luJ:70 APIN&)P(2Q:70 .nnA&)A(2Q:70 70/7/8 :snoisiveR 70/72/7 :snoisiveR 4Q:80-3Q:70 70/01/8 70 .guA 70/7/9 :)2r(2Q:70 70/7/9 :guA:70 70/6/9:)F(2Q:70 70/03/8:)P(2Q:70 4Q:80-3Q:70 70/01/9 70 .peS 70/5/01 :3Q:70 70/5/01 :peS:70 – 70/72/9:)F(2Q:70 4Q:80-3Q:70 70/01/01 †70 .tcO 70/2/11 :)1r(3Q:70 70/2/11 :tcO:70 70/7/11:)P(3Q:70 70/13/01:)A(3Q:70 4Q:80-4Q:70 70/01/11 70 .voN 70/7/21 :)2r(3Q:70 70/7/21 :voN:70 70/5/21:)F(3Q:70 70/92/11:)P(3Q:70 4Q:80-4Q:70 70/01/21 70 .ceD .7002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :33 elbaT 65

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 80/4/1 :4Q:70 SPC&ceD:70 – 70/02/21:)F(3Q:70 80/4/1 :snoisiveR 4Q:90-4Q:70 80/01/1 †80 .naJ 80/1/2 :)1r(4Q:70 SEC&naJ:80 80/6/2:)P(4Q:70 80/03/1:)A(4Q:70 80/1/2 :snoisiveR 4Q:90-1Q:80 80/01/2 80 .beF 80/7/3 :)2r(4Q:70 80/7/3 :beF:80 .nnA&)F(4Q:70 80/82/2:)P(4Q:70 80/5/3 :snoisiveR 4Q:90-1Q:80 80/01/3 80 .raM 80/4/4 :1Q:80 80/4/4 :raM:80 – 80/72/3:)F(4Q:70 4Q:90-1Q:80 80/01/4 †80 .rpA 80/2/5 :)1r(1Q:80 80/2/5 :rpA:80 80/7/5:)P(1Q:80 80/03/4:)A(1Q:80 4Q:90-2Q:80 80/01/5 80 yaM 80/6/6 :)2r(1Q:80 80/6/6 :yaM:80 80/4/6:)F(1Q:80 80/92/5:)P(1Q:80 4Q:90-2Q:80 80/01/6 80 .nuJ 80/3/7 :2Q:80 80/3/7 :nuJ:80 – 80/62/6:)F(1Q:80 4Q:90-2Q:80 80/01/7 †80 .luJ 80/1/8 :)1r(2Q:80 80/1/8 :luJ:80 APIN&)P(2Q:80 .nnA&)A(2Q:80 80/8/8 :snoisiveR 80/13/7 :snoisiveR 4Q:90-3Q:80 80/01/8 80 .guA 80/5/9 :)2r(2Q:80 80/5/9 :guA:80 80/4/9:)F(2Q:80 80/82/8:)P(2Q:80 4Q:90-3Q:80 80/01/9 80 .peS 80/3/01 :3Q:80 80/3/01 :peS:80 – 80/62/9:)F(2Q:80 4Q:90-3Q:80 80/01/01 †80 .tcO 80/7/11 :)1r(3Q:80 80/7/11 :tcO:80 80/6/11:)P(3Q:80 80/03/01:)A(3Q:80 4Q:90-4Q:80 80/01/11 80 .voN 80/5/21 :)2r(3Q:80 80/5/21 :voN:80 80/3/21:)F(3Q:80 80/52/11:)P(3Q:80 4Q:90-4Q:80 80/01/21 80 .ceD .8002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :43 elbaT 66

SEE miretnI SEE miretnI C&P miretnI APIN miretnI tsac’F CB pihCeulB tsac’F )yltrq( sesaeler )ylhtm( sesaeler sesaeler sesaeler noziroh desaeler emaN 90/9/1 :4Q:80 SPC&ceD:80 – 80/32/21:)F(3Q:80 90/9/1 :snoisiveR 4Q:01-4Q:80 90/01/1 †90 .naJ 90/6/2 :)1r(4Q:80 SEC&naJ:90 90/5/2:)P(4Q:80 90/03/1:)A(4Q:80 90/6/2 :snoisiveR 4Q:01-1Q:90 90/01/2 90 .beF 90/6/3 :)2r(4Q:80 90/6/3 :beF:90 .nnA&)F(4Q:80 90/72/2:)P(4Q:80 90/5/3 :snoisiveR 4Q:01-1Q:90 90/01/3 90 .raM 90/3/4 :1Q:90 90/3/4 :raM:90 – 90/62/3:)F(4Q:70 4Q:01-1Q:90 90/01/4 †90 .rpA 90/8/5 :)1r(1Q:90 90/8/5 :rpA:90 90/7/5:)P(1Q:90 90/92/4:)A(1Q:90 4Q:01-2Q:90 90/01/5 90 yaM 90/5/6 :)2r(1Q:90 90/5/6 :yaM:90 90/4/6:)F(1Q:90 90/92/5:)P(1Q:90 4Q:01-2Q:90 90/01/6 90 .nuJ 90/2/7 :2Q:90 90/2/7 :nuJ:90 – 90/52/6:)F(1Q:90 4Q:01-2Q:90 90/01/7 †90 .luJ 90/7/8 :)1r(2Q:90 90/7/8 :luJ:90 – .pmoC&)A(2Q:90 90/13/7 :snoisiveR 4Q:01-3Q:90 90/01/8 ∗90 .guA 90/4/9 :)2r(2Q:90 90/4/9 :guA:90 APIN&)P(2Q:90 90/72/8:)P(2Q:90 90/11/8 :noisiveR 90/2/9:)F(2Q:90 4Q:01-3Q:90 90/01/9 90 .peS 90/2/01 :3Q:90 90/2/01 :peS:90 – 90/03/9:)F(2Q:90 .9002 ,setaD esaeleR noitautiS tnemyolpmE dma .C&P ,APIN dna stsaceroF pihC eulB :53 elbaT 67

Cite this document
APA
Rochelle M. Edge and Refet S. Gurkaynak (2011). How Useful are Estimated DSGE Model Forecasts (FEDS 2011-11). Board of Governors of the Federal Reserve System, Finance and Economics Discussion Series. https://whenthefedspeaks.com/doc/feds_2011-11
BibTeX
@techreport{wtfs_feds_2011_11,
  author = {Rochelle M. Edge and Refet S. Gurkaynak},
  title = {How Useful are Estimated DSGE Model Forecasts},
  type = {Finance and Economics Discussion Series},
  number = {2011-11},
  institution = {Board of Governors of the Federal Reserve System},
  year = {2011},
  url = {https://whenthefedspeaks.com/doc/feds_2011-11},
  abstract = {DSGE models are a prominent tool for forecasting at central banks and the competitive forecasting performance of these models relative to alternatives--including official forecasts--has been documented. When evaluating DSGE models on an absolute basis, however, we find that the benchmark estimated medium scale DSGE model forecasts inflation and GDP growth very poorly, although statistical and judgmental forecasts forecast as poorly. Our finding is the DSGE model analogue of the literature documenting the recent poor performance of macroeconomic forecasts relative to simple naive forecasts since the onset of the Great Moderation. While this finding is broadly consistent with the DSGE model we employ--ie, the model itself implies that under strong monetary policy especially inflation deviations should be unpredictable--a "wrong" model may also have the same implication. We therefore argue that forecasting ability during the Great Moderation is not a good metric to judge the usefulness of model forecasts.},
}