feds · October 31, 2007

News, Noise, and Estimates of the "True" Unobserved State of the Economy

Abstract

Which provides a better estimate of the "true" state of the U.S. economy, gross domestic product (GDP) or gross domestic income (GDI)? Past work has assumed the idiosyncratic variation in each estimate is pure noise, taking greater variability to imply lower reliability. We develop models that relax this assumption, allowing the idiosyncratic variation in the estimates to be partly or pure news; then greater variability may imply higher information content and greater reliability. Based on evidence from revisions, we reject the pure noise assumption for GDI growth, and our results favor placing a higher weight on GDI due to its relatively large idiosyncratic variability. This calls into question the suitability of the pure noise assumption in other contexts, including dynamic factor models.

Finance and Economics Discussion Series Divisions of Research & Statistics and Monetary Affairs Federal Reserve Board, Washington, D.C. News, Noise, and Estimates of the ”True” Unobserved State of the Economy Dennis J. Fixler and Jeremy J. Nalewaik 2007-34 Revised September 18, 2007 NOTE: Staff working papers in the Finance and Economics Discussion Series (FEDS) are preliminary materials circulated to stimulate discussion and critical comment. The analysis and conclusions set forth are those of the authors and do not indicate concurrence by other members of the research staff or the Board of Governors. References in publications to the Finance and Economics Discussion Series (other than acknowledgement) should be cleared with the author(s) to protect the tentative character of these papers.

News, Noise, and Estimates of the “True” Unobserved State of the Economy Dennis J. Fixler and Jeremy J. Nalewaik∗ September 18, 2007 Abstract Whichprovidesabetterestimateofthe“true”stateoftheU.S.economy, gross domesticproduct(GDP)orgrossdomesticincome(GDI)?Pastworkhasassumed theidiosyncraticvariationineachestimateispurenoise, takinggreatervariability to imply lower reliability. We develop models that relax this assumption, allowing the idiosyncratic variation in the estimates to be partly or pure news; then greater variability may imply higher information content and greater reliability. Based on evidence from revisions, we reject the pure noise assumption for GDI growth, and our results favor placing a higher weight on GDI due to its relatively large idiosyncratic variability. This calls into question the suitability of the pure noise assumption in other contexts, including dynamic factor models. ∗Fixler: Chief Statistician, U.S. Bureau of Economic Analysis, 1441 L Street NW, Washington, DC 20230 (e-mail: dennis.fixler@bea.gov); Nalewaik: Economist, Federal Reserve Board, 20th Street andConstitutionAvenue, Washington, DC20551(e-mail: jeremy.j.nalewaik@frb.gov). WethankErick Sagerforresearchassistance,andBoraganAruoba,BenBridgman,UfukDemiroglu,BobDennis,Bruce Grimm, Steve Landefeld, Keith Phillips, Matt Pritsker, Marshall Reinsdorf, Chris Sims, Mark Watson, and seminar participants at the Bureau of Economic Analysis, the Washington Statistical Society, the Federal Reserve Board, and the 2005 NBER SI Macroeconomics and Productivity workshop for comments. The views expressed in this paper are soley those of the authors and are not necessarily those of the Federal Reserve Board, the U.S. Bureau of Economic Analysis, or the U.S. Department of Commerce. 1

JEL classification: C1, C82. Keywords: GDP, statistical discrepancy, news and noise, signal-to-noise ratios, optimal combination of estimates, business cycles 1 Introduction For analysts of economic fluctuations, estimating the true state of the economy from imperfectly measured official statistics is an ever-present problem. As most economists agree that no one statistic is a perfect gauge of the state of the economy, many have proposedusingsometypeofweightedaverageofmultipleimperfectlymeasuredstatistics instead. Examples include the composite index of coincident indicators,1 and averages of different measures of aggregate economic activity such as gross domestic product (GDP) and its income-side counterpart GDI. While the precise meaning of the state of the economy can vary from case to case, in this paper we take it to mean the growth rate of the size of the economy as traditionally defined in the U.S. National Income and Product Accounts (NIPAs).2,3 The main point of our paper is as follows. To our knowledge, all prior attempts to produce such a weighted average of imperfectly measured statistics have made a strong 1See Stock and Watson (1989) and the subsequent literature on dynamic factor models referenced below. 2NationalIncomeaccountantsfacetwofundamentalproblems. First,theymustdefineaninteresting andusefulmeasureofaggregateeconomicactivity,andsecond,theymustdesignmethodsforestimating the value of that measure, taking the definition as fixed. Our concern in this paper is with the second issue, using the definition of economic activity traditionally employed by National Income accountants. Itisavalue-addedmeasurewiththeprivatesectorcomponentrestrictedtomarketedeconomicactivity forthemostpart-i.e. non-marketactivitiessuchhomeproductionandchangesinnaturalresourcesare excluded. For more discussion and references, see Sir Richard Stone’s Nobel Memorial lecture, Stone (1984). 3Alargeliterature,buildingontheworkofHamilton(1989,1994),definesthe“stateoftheeconomy” to be an unobserved discrete variable, usually binary - i.e. the economy is either in recession or expansion. We use the term in a different sense here. 2

implicit assumption that drives their weighting: that the idiosyncratic variation in each measured statistic is pure noise, or completely uncorrelated with information about the true state of the economy.4 Under this assumption, a statistic with greater idiosyncratic variance is given a smaller weight because it is assumed to contain more noise. We consider the implications of relaxing this assumption, allowing the idiosyncratic variation in each measured statistic to contain news, or information about the true state of the economy. If the idiosyncratic variation is mostly news, the implied weighting is diametrically opposite that of the noise assumption: a statistic with greater idiosyncratic variance should be given a larger weight because it contains more information about the true state of the economy. The implicit noise assumption relied upon in numerous prior papers is arbitrary, and more information must be brought to bear on this issue. Focusing on GDP and GDI allows us to make this basic point in a simple bivariate context. These two measures of the size of the U.S. economy would equal one another if all the transactions in the economy were observed, but measurement difficulties lead to the statistical discrepancy between the two; their quarterly growth rates often diverge significantly. Weale (1992) and others5 have estimated the growth rate of “true” unobserved GDP as a combination of measured GDP growth and GDI growth, generally concluding that GDI growth should be given more weight than measured GDP growth. Is GDI really the more accurate measure? We argue for caution, as the results are driven entirely by the noise assumption: the models implicitly assume that since GDP growth has higher variance than GDI growth over their sample period, it must be noisier, and so should receive a smaller weight. However GDP may have higher variance because it contains more information about “true” unobserved GDP (this is the essence of the 4OurterminologyfollowsMankiwandShapiro(1986); seealsoMankiw,RunkleandShapiro(1984). 5See Howrey (2003) and the related work of Weale (1985) and Smith, Weale, and Satchell (1998). 3

news assumption); then measured GDP should receive the higher weight. In the general version of our model that allows the idiosyncratic component of each measured statistic to be a mixture of news and noise, virtually any set of weights can be rationalized by making untestable assumptions about the mixtures. More information must be brought to bear on the problem; otherwise the choice of weights will be arbitrary. This point is broadly applicable, extending well beyond the simple bivariate case of GDP and GDI. For example, a large and growing literature on dynamic factor models uses principal components or other methods to extract common factors out of large data sets; see Stock and Watson (2002), Forni, Hallin, Lippi, and Reichlin (2000), Bernanke and Boivin (2003), Giannone, Reichlin, and Small (2005), Bernanke, Boivin, and Eliasz (2005), and Boivin and Ng (2006).6 While often these common factors are used for pure forecasting, sometimes they are equated with unobserveables of interest, assuming the idiosyncratic components of the variables in the dataset are uninteresting noise. However if these idiosyncratic components do contain useful information about the unobserveables of interest, estimating the unobserveables optimally may require taking weighted averages of the variables in the dataset very different from those implied by the factor models. While this fundamental indeterminancy - the arbitrary nature of most weighting schemes - is somewhat disturbing, in the case of combining GDP and GDI we bring more information to bear on the problem to help pin down the weights. GDI growth has more idiosyncratic variation than GDP growth in the sample we employ, which starts in the mid 1980s after the marked reduction in the variance of the measured estimates - see McConnell and Perez-Quiros (2000). However the initial GDI growth estimates have negligible idiosyncratic variance; it is only through revisions that the idiosyncratic 6This research builds on the work of Geweke (1977) and Sargent and Sims (1977). 4

variance of GDI growth becomes relatively large. If the revisions add news, and not noise - an assumption that is consistent with our knowledge of the revisions process and that follows previous research such as Mankiw, Runkle and Shapiro (1984) and Mankiw and Shapiro (1986) - then there must be a strong presumption that the idiosyncratic variation in GDI growth is largely news, news derived from the revisions. We decompose the revisions to GDP and GDI growth into news and noise, show how to place bounds on the shares of their idiosyncratic variances that are news, and based on these bounds we test the assumptions of the pure noise model, rejecting them at conventional significance levels. Based on its relatively large idiosyncratic variation, GDI growth should be weighted more heavily, not less, in estimating “true” unobserved GDP growth. This leads to some interesting modifications of economic history: for example both before and after the 1990-1991 recession, economic growth is weaker than indicated by measured GDP growth. Furthermore, our results indicate that measured GDP growth understates the true variability of the economy’s growth rate, a fact with clear implications for real business cycle, asset pricing, and other models. 2 Theory: The Competing News and Noise Models 2.1 Review of News and Noise Let∆y? bethetruegrowthrateoftheeconomy, let∆yi beoneofitsmeasuredestimates, t t and let εi be the difference between the two, so: t ∆yi = ∆y? +εi. t t t The noise model makes the classical measurement error assumption that cov(∆y?,εi) = t t 0; this is the precise meaning of the statement that εi is noise. One implication of a t 5

noisy estimate ∆yi is that it’s variance is greater than the variance of the true growth t rate of the economy, or var(∆yi) > var(∆y?). t t In contrast, if an estimate ∆yi were constructed efficiently with respect to a set of t information about ∆y? (call it Fi), then ∆yi would be the conditional expectation of t t t ∆y? given that information set: t (cid:0) (cid:1) ∆yi = E ∆y?|Fi . t t t Writing: ∆y? = ∆yi +ζi, t t t the term ζi represents the information about ∆y? that is unavailable in the construct t tion of ∆yi. Then ∆yi and ζi represent mutually orthogonal pieces of news about t t t ∆y?, employing the terminology in Mankiw and Shapiro (1986), and cov(∆yi,ζi) = 0. t t t This leads us to an implication of the news model that we employ later, namely that cov(∆yi,∆y?) = var(∆yi). We also have var(∆y?) > var(∆yi), an implication opposite t t t t t to that of the noise model. These two models are clearly extremes; the next section considers a general model that allows differing degrees of news and noise in the estimates. 6

2.2 The Mixed News and Noise Model We consider a model with two estimates of true unobserved GDP growth, each an efficient estimate plus noise: (cid:0) (cid:1) ∆y1 = E ∆y?|F1 +ε1, and t t t t (cid:0) (cid:1) ∆y2 = E ∆y?|F2 +ε2. t t t t The noise components ε1 and ε2 are mutually uncorrelated and, naturally, uncorrelated t t with true unobserved GDP. Taking ∆y1 to be GDP and ∆y2 to be GDI, the informat t tion in F1 likely would consist of personal consumption expenditures, investment, net t exports, and the other components that sum to GDP, while the information in F2 likely t would consist of wage and salary income, corporate profits, proprietors’ income, and the other components that sum to GDI.7 We assume each information set includes a constant, so both ∆y1 and ∆y2 consistently estimate the mean µ of ∆y?, and there may t t t be a substantial amount of additional overlap between the two information sets. Consumption growth may be highly correlated with the growth rate of wages and salaries, for example. However a key feature of our model is that it recognizes that the two information sets are not necessarily identical.8 7We should note that our efficiency assumption is weaker than some others that have been tested in the literature, such as those in Dynan and Elmendorf (2001) and Fixler and Grimm (2003). We only assume that the estimates are efficient with respect to the internal information used to compute them, not with respect to the entire universe of available information - we do not consider efficiency with respect to the slope of the yield curve, stock prices, and so on. 8It is natural to ask whether it is possible to compute an efficient estimate of ∆y? given that it is t unobserved. A couple of things should be kept in mind. First, though ∆y? itself is unobserved, it is t defined quite precisely - see footnote 2. Second, the BEA and statisticians in general draw on a large stock of knowledge about the data they employ, and it’s reliability. More reliable data sources are generally given greater weight, and less reliable data sources less weight; through such procedures it may be possible to produce estimates that are close to efficient even though ∆y? is never observed. To t illustrate, suppose that the source data used to compute a component of GDP is contaminated with sampling error, and the variance of the sampling error is known (as is often the case); then procedures 7

To clearly illustrate the main points of the paper, we focus on the simple case where all variables are jointly normally distributed, and where measured GDP and GDI are serially uncorrelated.9 With normality, the conditional expectation of the true growth rate of the economy is a weighted average of GDP and GDI; netting out means yields: (cid:0) (cid:1) E ∆y? −µ|∆y1,∆y2,µ = t t t (cid:0) (cid:1) (cid:0) (cid:1) (1) ∆dy? −µ = ω ∆y1 −µ +ω ∆y2 −µ , t 1 t 2 t calling the conditional expectation ∆dy?. The weights ω can be derived using standard t i formulas for the population version of ordinary least squares:    −1  ω var(∆y1) cov(∆y1,∆y2) cov(∆y1,∆y?) (2)  1  =  t t t   t t        ω cov(∆y1,∆y2) var(∆y2) cov(∆y2,∆y?) 2 t t t t t  −1  var(∆y1) cov(∆y1,∆y2) var(E(∆y?|F1)) =  t t t   t t ,     cov(∆y1,∆y2) var(∆y2) var(E(∆y?|F2)) t t t t t using cov(∆y?,εi) = 0 and the property of efficient estimates that their covariance with t t the variable they estimate is simply their variance. It is useful to introduce some additional notation. Call the covariance between the two estimates σ2; this arises from the overlap between the information sets used to compute the efficient estimates, and correlation between the measurement errors ε1 and t ε2. The model imposes the condition that the variance of each estimate is at least as t may be employed to downweight the estimate in proportion to the variance of the sampling error, producing an efficient estimate for that component even though it’s true value is never observed. 9In a set of additional results available from the authors, the model is extended to allow for serial correlation of arbitrary linear form in GDP and GDI. The main points of the paper carry through in this setting, and the empirical estimates with dynamics are similar to the empirical estimates of the static models presented here. 8

large as their covariance; let σ2 +τ2 and σ2 +τ2 be the variances of the ∆y1 and ∆y2, 1 2 t t respectively. The idiosyncratic variance in each estimate, the τ2 for i = 1,2, arises from i two potential sources. The first source is the idiosyncratic news in each estimate - the information in each efficient estimate missing from the other, and the second source is noise. Let the share of the covariance between the two estimates that is news, or common information, be χ. Similarly, let the news share of the idiosyncratic variance in the ith estimate be χ , so (1−χ ) is the fraction of the idiosyncratic variance that is noise. i i Then equation (2) becomes:    −1  ω σ2 +τ2 σ2 χσ2 +χ τ2  1  =  1   1 1 .       ω σ2 σ2 +τ2 χσ2 +χ τ2 2 2 2 2 Solving and substituting into (2) gives: (cid:16) (cid:17) χ τ2 +(χ−χ )τ2 +χ τ 1 2τ 2 2 (∆y1 −µ) 1 1 2 2 1 σ2 t ∆dy? −µ = t τ2 +τ2 + τ 1 2τ 2 2 1 2 σ2 (cid:16) (cid:17) χ τ2 +(χ−χ )τ2 +χ τ 1 2τ 2 2 (∆y2 −µ) 2 2 1 1 2 σ2 t (3) + . τ2 +τ2 + τ 1 2τ 2 2 1 2 σ2 Before examing (3) in greater depth, note that the weights on the two component variablesheredonotnecessarilysumtoone; theweightsonthetwocomponentsvariables and mean µ sum to one. But in some situations the econometrician may have little confidence in the estimated mean µ, so it may be inadvisable to use it as the third component in the weighted average. One way around this problem is to force the weights on ∆y1 and ∆y2 to sum to one, with ω = 1−ω ; substituting into (1) and rearranging t t 2 1 9

yields: (cid:0) (cid:1) (cid:0) (cid:1) (1’) E ∆y? −∆y2|∆y1,∆y2 = ω ∆y1 −∆y2 . t t t t 1 t t Adding back in ∆y2 to equation (1’) yields ∆dy?. The solution to the general model then t t becomes: (χ τ2 +(1−χ )τ2)∆y1 +(χ τ2 +(1−χ )τ2)∆y2 (3’) ∆dy? = 1 1 2 2 t 2 2 1 1 t . t τ2 +τ2 1 2 Withtheassumptionsofthepurenoisemodeldiscussedbelow, thisparticularestimator isequivalenttotheestimatorproposedbyWeale(1992)andStoneetal(1942). Appendix A clarifies the relation between these earlier estimators and those derived here. It is clear that not all of the parameters of the unconstrained model are identified: we observe three moments from the variance-covariance matrix of [∆y1 ∆y2], which is not t t enough to pin down the six parameters σ2, τ2, τ2, χ, χ , and χ . Imposing values for χ, 1 2 1 2 χ , and χ allows identification of the remaining parameters. Some illuminating special 1 2 cases are examined next, which show how assumptions about the idiosyncratic news shares χ and χ are critical for determining the relative weights on the two component 1 2 variables. 2.2.1 The Pure Noise Model Previous attempts to estimate models of this kind have focused on one particular assumptionfortheidiosyncraticnewsshares: χ = χ = 0. Theimplicationisthatthetwo 1 2 information sets must coincide, at least in the universe of information that is relevant for predicting ∆y?, so E(∆y?|F1) = E(∆y?|F2). We call this the pure noise model; t t t t t 10

equation (3) is then:10 χτ2(∆y1 −µ)+χτ2(∆y2 −µ) (4) ∆dy? −µ = 2 t 1 t . t τ2 +τ2 + τ 1 2τ 2 2 1 2 σ2 In the pure noise model, the weight for one measure is proportional to the idiosyncratic variance of the other measure - since the idiosyncratic variance in each estimate is assumed to be noise, the “noisier” measure is downweighted. The weights on the (net of mean) estimates sum to less than one; as is typical in the classical measurement error model, coefficients on noisy explanatory variables are downweighted. In fact, as the common variance σ2 approaches zero, the signal-to-noise ratio in the model approaches zero as well, and the formula instructs us to give up on the estimates of GDP and GDI for any given time period, using the overall sample mean as the best estimate for each and every period. 2.2.2 The Pure News Model The opposite case is what we call the pure news model, where χ = χ = 1. Equation 1 2 (3) then becomes: (cid:16) (cid:17) τ2 +(χ−1)τ2 + τ 1 2τ 2 2 (∆y1 −µ) 1 2 σ2 t ∆dy? −µ = t τ2 +τ2 + τ 1 2τ 2 2 1 2 σ2 (cid:16) (cid:17) τ2 +(χ−1)τ2 + τ 1 2τ 2 2 (∆y2 −µ) 2 1 σ2 t (5) + . τ2 +τ2 + τ 1 2τ 2 2 1 2 σ2 10PreviousworktypicallyhasimposedtheadditionalassumptionthatE (cid:0) ∆y?|Fi(cid:1) =∆y?,fori=1,2, t t t leadingtothefirstcaseinsubsection2.1. Equation(4)holdswithorwithoutthisadditionalassumption; the only difference lies in the interpretation of the parameters. With this assumption, σ2 identifies the varianceof“true”GDPgrowth; withoutit,σ2 merelyidentifiesvar (cid:0) E (cid:0) ∆y?|F1(cid:1)(cid:1) =var (cid:0) E (cid:0) ∆y?|F2(cid:1)(cid:1) , t t t t which must be less than the variance of “true” GDP growth. 11

The weight for each measure is now proportional to its own idiosyncratic variance - the estimate with greater variance contains more news and hence receives a larger weight. This result is diametrically opposed to that of the noise model. Under some circumstances it may be reasonable to assume that the covariance between the estimates is pure news, in which case the (χ−1) terms vanish; then the weights (on the net of mean estimates) sum to a number greater than unity, again opposite the pure noise model. As σ2 → 0 (i.e. as the variance common to the two estimates approaches zero), the weight for each estimate approaches unity. In this case, we are essentially adding together two independent pieces of information about GDP growth. To illustrate, suppose we receive news of a shock that moves ∆y? two percent above t its mean, and then receive news of another, independent shock that moves ∆y? one t percent below its mean. The logical estimate of ∆y? is then the mean plus one percent t - i.e. the sum of the two shocks. In Appendix B we work through another example, of two estimates of GDP growth, each based on the growth rate of a different sector of the economy; if the growth rates of the sectors are uncorrelated, we simply add up the net-of-mean contributions to GDP growth of the two sectors, and then add back in the mean. 2.2.3 Arbitrary Weights Finally, consider another case of interest: if χ = χ and χ = 0, then ω = χ and ω = 0, i j i j placing all the weight on variable i. If placing all the weight on either variable can be justified with such assumptions about the idiosyncratic news shares, perhaps any set of weights is possible. This turns out to be the case. Let the ratio of the weights ω1 = r, ω2 12

so: χ τ2 +(χ−χ )τ2 +χ τ 1 2τ 2 2 (6) r(χ,χ ,χ ) = 1 1 2 2 1 σ2 , 1 2 χ τ2 +(χ−χ )τ2 +χ τ 1 2τ 2 2 2 2 1 1 2 σ2 where we’ve expressed r as a function of χ, χ and χ . The following proposition shows 1 2 that, for any 0 < χ ≤ 1, any set of weights can be rationalized by making untestable assumptions about the degree of news and noise in the idiosyncratic components of the two variables: Proposition 1 Let r be any non-negative real number, and let r(χ,χ ,χ ) be given by 1 2 (6), where τ2, τ2, and σ2 are each constant, positive real numbers, and 0 < χ ≤ 1. Then 1 2 there exists a pair (χ?,χ?), with χ? ∈ [0, 1) and χ? ∈ (0, 1], such that r(χ?,χ?) = r. 1 2 1 2 1 2 Proof: Consider an example that meets the conditions of the proposition, where χ = 2 χ−χ . Then r(χ ,χ ) = χ1 . Since r(χ ,χ ) is a continuous function, r(0,χ) = 0, 1 1 2 χ−χ1 1 2 and lim r(χ ,χ−χ ) = ∞, the result holds by theorem 4.23 of Rudin (1953). We χ1→χ 1 1 have χ = χr , which produces the desired χ? ∈ [0, 1) and χ? ∈ (0, 1] for any 1 1+r 1 2 non-negative real r. One set of weights is as justifiable as any other; without further information about the estimates, the choice of weights will be arbitrary. In the empirical work below on GDP and GDI, we do bring further information to bear on the problem, and examine which news shares are likely closest to reality. 13

3 Data: The Case of GDP and GDI 3.1 Data Description The most widely-used statistic produced by the U.S. Bureau of Economic Analysis (BEA) is GDP, its expenditure-based estimate of the size of the economy; this statistic is the sum of personal consumption expenditures, investment, government expenditures, and net exports. However the BEA also produces an income-based estimate of the size of the economy, gross domestic income (GDI), from different information. National incomeisthesumofemployeecompensation,proprietors’income,rentalincome,corporate profits and net interest; adding consumption of fixed capital and a few other balancing items to national income produces GDI.11 Computing the value of GDP and GDI would be straightforward if it were possible to record the value of all the underlying transactions included in the NIPA definition of the size of the economy, in which case the two measures would coincide. However all the underlying transactions are not recorded: the BEA relies on various surveys, censuses and administrative records, each imperfect, to compute the estimates, and differences between the data sources used to produce GDP and GDI, as well as other measurement difficulties, lead to the statistical discrepancy between the two measures. Likelihood-ratio tests show breaks in the means and variances of our GDP and GDI growth series in 1984Q3; in this version of the paper we restrict our attention to the new regime - i.e. the post-1984Q3 period. Figure 1 plots the annualized quarterly growth rates of the “latest available” versions of nominal GDP (solid) and GDI (dashed) 11The definition of national income changed in the BEA’s 2003-4 benchmark revision, but this only served to reshuffle some items within GDI; continuity with earlier GDI vintages was maintained. For more information on how GDP, GDI and their components are constructed over our sample, see the October 2002 Survey of Current Business and references there-in, or visit www.bea.gov. 14

from 1984Q3 to 2004, pulled from the BEA web site in August 2007.12 This “latest available” vintage is one of numerous vintages of data released by the BEA. The “final current quarterly” vintage, released about three months after the quarter ends, is the first vintage available with a complete time series of both GDP and GDI growth over our sample period. Because the “final current quarterly” nomenclature is somewhat confusing, we call this the “first” vintage, and the “latest” available vintage the “last” vintage. Historically, each“first”vintageestimatehasbeenrevisedthreetimesatannual revisions, and then periodically every five years at benchmark revisions. We restrict our sample to end in 2004 so that all our “last” vintage observations have passed through the three annual revisions; the time series we employ was last benchmarked in 2003-2004. At each of the annual revisions and at a benchmark revision, the BEA incorporates morecomprehensiveandaccuratesourcedata. Forthecurrentquarterlyestimates, most available source data is based on samples, which may contain some noise from sampling errors. Later vintages are based on more comprehensive samples, or sometimes universe counts, so incorporation of these data has the potential to reduce noise. In addition to potentially noisy data, at the time of the current quarterly estimates the BEA has little hard data at all on some components of GDP and GDI, including much of services consumption.13 For these components the BEA often resorts to “trend extrapolations,” assuming the growth rate for the current quarter some average of past growth rates, which can be thought of as approximating conditional expectations based on past history. In later vintages when the BEA receives and substitutes actual data for these extrapolated components, news is added to the estimates. For some missing components the BEA substitutes related data instead of “trend extrapolations”; for 12We choose to focus on nominal data because the BEA does not produce a deflator for GDI. Our results using GDP and GDI deflated by the GDP deflator were broadly similar to those reported. 13For a detailed description of the missing GDP data, see Grimm and Weadock (2006). 15

example the BEA borrows data from the income-side, using employment, hours and earnings as an extrapolator from some components of services consumption. These estimates may be thought of as approximating conditional expectations based on related labor market information, although if the labor market data contain noise, it is possible that these procedures may introduce common noise to the current quarterly estimates. 3.2 Information about News and Noise from Revisions Our model for “first” and “last” vintage GDP and GDI growth (i = 1,2) is: (cid:16) (cid:17) ∆yi,f = E ∆y?|Fi,f +εi,f t t t t (cid:16) (cid:17) ∆yi,l = E ∆y?|Fi,l +εi,l. t t t t Our working assumption is that the revision from “first” to “last” brings the estimates closer to the truth ∆y?, through some combination of increased news and decreased t noise.14 On the news side, we assume Fi,f is strictly smaller than Fi,l, so Fi,f ⊂ Fi,l. t t t t Writing: (cid:16) (cid:17) (cid:16) (cid:17) E ∆y?|Fi,l = E ∆y?|Fi,f +ζi,fl, t t t t t the term ζi,fl is the increase in news embedded in the revision, and is independent t (cid:16) (cid:17) of E ∆y?|Fi,f . This increase in news increases the variance of the estimates, since t t (cid:16) (cid:16) (cid:17)(cid:17) (cid:16) (cid:16) (cid:17)(cid:17) (cid:16) (cid:17) (cid:16) (cid:17) var E ∆y?|Fi,l > var E ∆y?|Fi,f . On the noise side, var εi,l < var ε1,f , t t t t t t 14This assumption need not hold for all component revisions that comprise the grand revision we consider: we assume only that any noise added by revision is revised away over subsequent annual and benchmark revisions. 16

we write this as: εi,f = εi,l +εi,fl, t t t with εi,fl independent of εi,l. This reduction in noise decreases the variance of “last” t t relative to “first”. These noise terms are assumed independent of all relevant conditional expectations. If the revision from “first” to “last” reflects largely increased news, the variance of “last” should exceed the variance of “first,” and if the revision reflects decreased noise, the opposite should hold, as discussed in Mankiw and Shapiro (1986). Here we show how to identify the fraction of revision variance that stems from increased news, and the fraction that stems from decreased noise. The variance of the revision is: var(∆yi,l −∆yi,f) = var(ζi,fl −εi,fl) t t t t (7) = var(ζi,fl)+var(εi,fl), t t since ζi,fl and εi,fl are independent. Contrast this with the change in the variance of the t t estimate: (cid:16) (cid:16) (cid:17) (cid:17) (cid:16) (cid:16) (cid:17) (cid:17) var(∆yi,l)−var(∆yi,f) = var E ∆y?|Fi,l +εi,l −var E ∆y?|Fi,f +εi,f t t t t t t t t (cid:16) (cid:16) (cid:17) (cid:17) = var E ∆y?|Fi,f +ζi,fl +εi,l t t t t (cid:16) (cid:16) (cid:17) (cid:17) −var E ∆y?|Fi,f +εi,fl +εi,l t t t t (cid:16) (cid:16) (cid:17)(cid:17) = var E ∆y?|Fi,f +var(ζi,fl)+var(εi,l) t t t t (cid:16) (cid:16) (cid:17)(cid:17) −var E ∆y?|Fi,f −var(εi,fl)−var(εi,l) t t t t (8) = var(ζi,fl)−var(εi,fl), t t 17

again relying on the independence of various terms. Equations (7) and (8) pin down the news increase var(ζi,fl) and noise decrease var(εi,fl). t t The first two rows of Table 1 show, for GDP growth and GDI growth, the variances of their “first” and “last” vintages, the change in variance (equation 8), the revision variance (equation 7), and the increase in news and decrease in noise implied by these statistics. For GDP growth, the variances of “last” and “first” are about equal, implying the increase in variance from greater news is about equal to and offsets the decrease in variance from less noise. For GDI growth, the variance of “last” is substantially larger, implying more than 80% of the revision variance stems from increased news. The third row of the table shows covariances between GDP growth and GDI growth. Note that “first” GDI growth has virtually no idiosyncratic variance - its variance is about equal to its covariance with GDP growth - but after passing through revisions its idiosyncratic variance is substantial. Since the idiosyncratic variance of this “last” estimate stems from revisions, which add news but not noise, it is tempting to conclude that this idiosyncratic variance must be news. However as the equations in Appendix C illustrate, the increase in common news and decrease in common noise are not identified, as would be necessary to pin down precisely the increase in idiosyncratic news. Some of our intuition developed earlier for variances does apply to covariances: increased news can only increase the covariance, while decreased common noise can only decrease the covariance. The fact that the covariance falls implies that the “first” estimates must contain some common noise that is eliminated through revision. One possibility is that this common noise is eliminated from GDP growth but not GDI growth, in which case it then becomes idiosyncratic noise in GDI growth, accounting for some of its higher variance in the “last” estimates. Appendix C works through the relevant equations describing the change in common and idiosyncratic news and noise. These equations provide bounds on the admissable 18

values of the news shares for the idiosyncratic variances of the “last” vintage estimates, χ and χ , as well as bounds on the news shares of the idiosyncratic and common 1,l 2,l variances of the “first” vintage estimates, χ , χ and χ . Table 2 shows various 1,f 2,f f possibilities sketching out the edges of these boundaries. In these scenarios, we assume all common variance is news unless it is explicitly identified as noise; formally, we assume equation (C.10) holds with equality. The first column on table 2 shows news shares resulting from minimization of the total idiosyncratic news in the “last” estimates, subject to the revision equations described in Appendix C. For the “last” estimates, the pure noise model cannot be squared with the revisions information: the idiosyncratic news share for GDI growth of 0.46 is its lowest possible value.15 Under this scenario, all of the 0.96 reduction in the noise variance of “first” GDP is assumed to come from a reduction in common noise, with none of that noise removed from GDI growth so all of it becomes idiosyncratic noise in the “last” GDI estimate. This accounts for about half of the idiosyncratic variance in “last” GDI growth; the remainder of this idiosyncratic variance must be news. Two assumptions in this scenario are unlikely: (i) that all of the decrease in GDP noise occurs in the common component, and (ii) that none of the common noise removed from GDP growth is removed from GDI growth. Regarding (i), some of the idiosyncratic variance of “first” GDP growth of around 0.7 is likely noise, and revisions likely eliminate some of that; regarding (ii), the revisions to GDI growth incorporate virtual census counts from administrative and tax records, which should cut down on noise from sampling errors. The second column on table 2 shows news shares resulting from maximizing the total idiosyncratic news in the “last” estimates. While the pure news model cannot be squared with the revisions evidence either, something close to the pure news model with 15The lowest possible idiosyncratic news share for “latest” GDP growth is about 0.11; this value appears in the third scenario of the table. 19

(χ , χ ) equal to (1, 0.86) is admissable. Under this scenario, of the 0.96 reduction in 1,l 2,l “first” GDP noise variance, about one third stems from a reduction idiosyncratic GDP noise, about one third stems from a reduction in common noise also removed from GDI growth, and about one third stems from a reduction in common noise not also removed from GDI growth. This appears quite reasonable to us, and we take it as our preferred specification. The assumption that the idiosyncratic variance in “first” GDI growth is pure news is unlikely, but given the small size of that idiosyncratic component, this assumption makes little difference in the optimal combination formulas. The last two columns show news shares resulting from minimization of the ratio of optimal weights on the two components. Each of these scenarios makes some unlikely assumptions; for example the scenario in the last column assumes the idiosyncratic variance in “first” GDP growth is entirely news, so all of the 0.96 reduction in its noise variance comes from a reduction in common noise. These last two scenarios show that revisions give us little concrete information about the idiosyncratic news shares for the “first” estimates: (0, 1) and (1, 0) are possibilities for (χ , χ ); further experiments 1,f 2,f showed (0, 0) is a possibility but (1, 1) is not. 4 Estimates of “True” Unobserved GDP Table 3 reports maximum likelihood estimates of the means, covariances, and idiosyncraticvariancesofGDPandGDIgrowth,withstandarderrorsbeneaththetheestimates. These are slightly different from the statistics reported in table 1, because the estimation here imposes equality of mean GDP growth and mean GDI growth for each vintage. The statistics for the two vintages are estimated jointly, along with covariances between vintages. This allows us to decompose the revision variances into news and noise as in the previous section, and recompute the bounds on the news shares implied by the 20

equations in Appendix C; these bounds were very similar to those reported in in table 2. The news shares corresponding to each of these bounds imply optimal weights for GDP and GDI growth via equation (3); these are reported in table 3 with standard errors. As in the previous section, these weights assume equation (C.10) holds with equality; the weights for the “last” estimates assume χ = 1, making the assumption typical of l dynamic factor models that covariance is signal. Consider first the weights for the “first” vintage estimates. In all the scenarios, the weights on GDP and GDI growth sum to less than one: it is optimal to down-weight to some degree the “first” estimates, shrinking them back towards their mean. This is a consequence of the common noise in the “first” estimates implied by the revisions evidence - i.e. the fact that revisions cause the covariance between the estimates to fall; the down-weighting filters some of this noise out of the data. From the standpoint of tracking the economy in real time, for monetary policy or other purposes, these currentquaterly estimates are all that is available, and this result is certainly interesting from that perspective. Regarding the relative weight to be placed on the GDP vs GDI for the “first” estimates, the last two scenarios show the expected result that we cannot rule out anything definitively based on the revisions evidence. However the first two scenarios show that if a decent share of the idiosyncratic variance of GDP is news (see the assumptions in table 2), GDP will tend to receive the higher weight, since its idiosyncratic variance is so much larger than that of GDI. Since the first two scenarios both favor GDP, the evidence does lean slightly in that direction. We can make more definitive statements about relative weights for the “last” estimates, and the evidence favors placing a greater weight on GDI. Consider the last two w w scenarios, which place bounds on the ratio of the weights 1,l and 2,l. It is possible to w w 2,l 1,l skew the weights much more heavily in favor of GDI than GDP. One sensible way to 21

proceed may be to choose the midpoint of this range of feasible relative weights, which would then place a greater weight on GDI.16 The first two scenarios favor GDI as well. Inthefirstscenario,thelowerboundofχ basedontherevisionsevidenceisbinding. 2,l This lower bound shows that the pure noise model is inconsistent with the assumption that revisions either add news or decrease noise, but the bound is a function of estimated parameters, so there is some uncertainty about whether this lower bound is really above zero. Astatisticaltestofwhetherχ > 0isequivalenttoatestofwhetherthedifference 2,l between τ and the estimated reduction in noise in ∆y1,f is greater than zero, where 2,l t the noise reduction is computed as σ2 +τ2 −cov(∆y1,l,∆y1,f). This difference is 1.02, f 1,f t t with a standard error of 0.52; hence we may reject the pure noise model at conventional significance levels based on evidence from revisions, even taking on board the unlikely assumption that all of the reduction in noise in “final” GDP growth stems from the common component. As discussed in the previous section, the second scenario is the set of assumptions about the “last” news shares that we consider most likely. Under this scenario, the informativenessofGDIrelativetoGDPincreasesintherevisionfrom“first”to“last”, as agreateramountofusefulinformationisincorporatedintoGDI,causingitsidiosyncratic variance to surge past that of GDP. This interpretation is consistent with the findings in Nalewaik (2007a, 2007b), who shows that although GDI appears to be more informative than GDP in recognizing recessions (or, more precisely, more informative in recognizing the state of the world in a two-state Markov switching model for the economy’s growth rate), most of that greater information content comes from the information in annual and benchmark revisions. 16Minimax estimation over the unidentified parameters of the model may lead one to choose such a midpoint of the feasible set of relative weights. We thank Mark Watson for introducing us to the Minimaxapproach;seeWatson(1987)andLehmannandCasella(1998)foranexampleanddescription of the Minimax approach. 22

Placing a greater weight on GDI growth in analyzing the historical behavior of the economy leads to some interesting modifications to economic history, as illustrated in Figures2and3. Thesefiguresshow“last”GDPgrowth, GDIgrowth, andtheirweighted average using the weights from our preferred set of news shares in table 3, around the 1990-1991 and 2001 recessions. The three series shown are deflated by the GDP deflator, with the composite estimate deflated after combining. Compared with GDP, thecompositeestimateshowsweakerrecoveriesfromboththeserecessions: meangrowth in 1991 was 0.6% compared with 1.1% for GDP, and 1.5% versus 1.9% for GDP in 2002. Theeconomyleadinguptothe1990-1991recessionwasweakeraswell, withaverage1989 growth of the composite estimate at 2.0% versus 2.7% for GDP. And the 2001 recession was more severe than indicated by GDP growth, with average growth for that year -0.5% versus 0.2% for GDP. In fitting structural economic relationships, these results should be of some interest. It is interesting to note that in the fourth quarter of 1999, the growth rate of the combined estimate exceeds the growth rate of both GDP and GDI, while in the third quarter of 2001, the combined growth is less than each estimate. These examples reflect weights on the component series that sum to more than one, a consequence of the assumption that the idiosyncratic variances of the component series are largely news. χ τ and χ τ are independent pieces of information about “true” nominal GDP 1,l 1,l 2,l 2,l growth, independent of each other and the common information σ2. Adding these three l terms together gives an estimate of the variance of “true” GDP growth ∆y?, based on t the information in GDP and GDI growth, but this represents a lower bound on the actual variance of ∆y? since there is likely additional information about ∆y? contained t t in neither available estimate. This lower bound of 5.86 is greater than the variance of either GDP or GDI growth, a fact with potentially important implications for a wide class of economic models that depend importantly on the variance of the growth rate of 23

the economy, for example many real business cycle and asset pricing models. 5 Conclusions This paper makes a general point about heretofore implicit assumptions employed in taking weighted averages of imperfectly measured statisics, and uses insights from that general point to develop new estimates of aggregate economic activity - “true” unobserved GDP growth - as a weighted average of measured GDP and GDI growth. These two measures should coincide in principle since the underlying concept they attemp to measure is the same, but they do not due to differences in source data. Combining them in some way may produce an estimate that is superior to either one in isolation, but previous attempts to do so have made the strong implicit assumption that the idiosyncratic variation in each measured statistic is pure noise, or completely uncorrelated with “true” GDP. Our model relaxes this assumption, allowing the idiosyncratic variation in each measured statistic to be partly or pure news - i.e. correlated with “true” GDP. This generalized model may weight more heavily the statistic with higher variance, since it may contain a greater amount of information about “true” GDP, in contrast to previous models which always weight less heavily the statistic with higher variance, assuming it contains more measurement error. We develop new techniques for decomposing revisions into news and noise, and use the revisions evidence to place lower bounds on the shares of idiosyncratic variation in GDP and GDI that are news. Our identification scheme assumes that revisions can only add news or decrease noise, as in Mankiw, Runkle and Shapiro (1984) and Mankiw and Shapiro (1986), and numerous papers following in that tradition. The initial GDI estimates have little idiosyncratic variance, less than GDP, but after passing through revisions the idiosyncratic variance of GDI increases substantially. The fact that this 24

idiosyncratic variation stems from revisions, which add news but not noise, leads to the strong presumption that this variation is news. The techniques we develop for bounding the idiosyncratic news shares show how to test the pure noise model assumptions, which we reject at conventional significance levels: some of the idiosyncratic variation in GDI growth must be news. When combining the revised vintages of the estimates, these results indicate that placing a greater weight on GDI is optimal, precisely because of its greater idiosyncratic variation. Doing so alters economic history in interesting ways: for example both before and after the 1990-1991 recession, economic growth is substantially weaker than indicated by GDP growth. In addition, our results indicate that the true variance of the growth rate of the economy is not equal to the variance of measured GDP growth, as is often assumed in real business cycle, asset pricing, and other models; the true variance is actually higher. The news vs. noise considerations highlighted here are ubiquitous when attempting to estimate unobserveables. Take the well known index of coincident indicators as constructed by Stock and Watson (1989), used by Diebold and Rudebusch (1996) and many other economists. Stock and Watson decompose each of four time series into a common factorplusanidiosyncraticcomponent; atimeseriesthatcovariesrelativelylesswiththe other three will receive less weight in the common factor and have higher idiosyncratic variance. Stock and Watson define the state of the economy as this common factor, so a series with greater (relative) idiosyncratic variance receives less weight in this construct. Is this best weighting? There may be good reasons to define the state of the economy as this common factor, following the venerable tradition of Burns and Mitchell (1946). However if we define the state of the economy as something other than this common factor, the answer to this question is unclear: if the idiosyncratic components of the time series are noise, the Stock and Watson approach is appropriate, but if the idiosyncratic components are news, then time series that contain much idiosyncratic variation 25

are uniquely informative about the state of the economy, and should be weighted more heavily. This same point is applicable to the burgeoning literature on dynamic factor models using large datasets. For example, Bernanke et al (2005) equate linear combinations of common factors with four unobserved variables: (1) the output gap, (2) a cost-push shock, (3) output, and (4) inflation. They take these last two as unobserveable due to measurement difficulties, in the same spirit as our work here. However it is unlikely that the idiosyncratic components of all 120 time series they use to extract the common factors are uncorrelated with these four unobserveables. For example, our results indicate that information from the income side of the national accounts probably contains useful information about the growth rate of output, above and beyond the information contained in expenditure-side variables. So it may be possible to improve the results in Bernanke et al (2005), for example by allowing correlation between unobserveables (1) or (3) and the idiosyncratic components of their employment and income variables. These examples illustrate that the noise assumption, treating idiosyncratic variance as a bad, is often implicit in models of imperfect measurement. We have examined some circumstances for which this assumption may be inappropriate, where it is possible that idiosyncratic variance should be treated as a good instead. While realizing this leads to some fundamental indeterminancies, our work here has taken some initial steps towards deriving estimators appropriate for handling these situations. References [1] Andrews, Donald W.K. “Tests for Parameter Instability and Structural Change with Unknown Change Point” Econometrica, 1993 (61), pp. 821-856. 26

[2] Bernanke, Ben S., and Boivin, Jean. “Monetary Policy in a Data-Rich Environment.” The Journal of Monetary Economics, 2003 (50), pp. 525-546. [3] Bernanke, Ben S.; Boivin, Jean; and Eliasz, Piotr. “Measuring the Effects of Monetary Policy: A Factor-Augmented Vector Autoregressive (FAVAR) Approach.” The Quarterly Journal of Economics, 2005 (120), pp. 387-422. [4] Burns, A. F., and W. C. Mitchell. Measuring Business Cycles. New York, NBER (1946). [5] Byron, Ray. “The Estimation of Large Social Accounts Matrices.” Journal of the Royal Statistical Society, series A (1978), vol. 141, part 3, pp. 359-367. [6] Diebold, Francis X. and Rudebusch, Glenn D. “Measuring Business Cycles: A Modern Perspective.” Review of Economics and Statistics, 1996 (101), pp. 67-77. [7] Dynan, Karen E. and Elmendorf, Douglas W. “Do Provisional Estimates of Output Miss Economic Turning Points?” Federal Reserve Board of Governors, working paper, 2001. [8] Fixler, Dennis J. and Grimm, Bruce T. “Reliability of GDP and Related NIPA Estimates” Survey of Current Business, January 2002, pp. 9-27. [9] Fixler, Dennis J. and Grimm, Bruce T. “GDP Estimates: Rationality tests and turning point performance.” Journal of Productivity Analysis, 2006 (25), pp. 213- 229. [10] Forni, Mario; Hallin, Marc; Lippi, Marco; and Reichlin, Lucrezia. “The Generalizd Dynamic-Factor Model: Identification and Estimation” Review of Economics and Statistics, 2000 (82), pp. 540-554. 27

[11] Geweke, John. “The Dynamic Factor Analysis of Economic Time Series,” in Dennis J. Aigner and Arthur S. Goldberger (Eds.), Latent Variables in Socio-Economic Models (Amsterdam: North-Holland, 1977). [12] Giannone, Domenico; Reichlin, Lucrezia; and Small, David. “Nowcasting GDP and Inflation: The Real-Time Informational Content of Macroeconomic Data Releases.” FEDS working paper 2005-42. [13] Grimm, Bruce T. and Teresa Weadock. “Gross Domestic Product: Revisions and Source Data” Survey of Current Business, February 2006, pp. 11-15. [14] Hamilton, James D. “A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle” Econometrica, 1989 (57), pp. 357-84. [15] Hamilton, James D. Time Series Analysis (Princeton: Princeton University Press, 1994). [16] Harvey, Andrew C. Forecasting, Structural Time Series Models and the Kalman Filter (Cambridge: Cambridge University Press, 1989). [17] Howrey, E. Philip. “The Accuracy of the Government’s Estimates of GDP.” University of Michigan, working paper, December 2003. [18] Lehmann, E. L., and Casella, George. Theory of Point Estimation (New York: Springer, 1998). [19] Mankiw, N. Gregory, Runkle, David E., and Shapiro, Matthew D. “Are Preliminary Announcements of the Money Stock Rational Forecasts?” Journal of Monetary Economics, 1984 (14), pp. 15-27. [20] Mankiw, N. Gregory and Shapiro, Matthew D. “News or Noise: An Analysis of GNP Revisions” Survey of Current Business, May 1986, pp. 20-25. 28

[21] McConnell, Margaret M., and Perez-Quiros, Gabriel. “Output Fluctuations in the United States: What Has Changed Since the Early 1980s?” American Economic Review, 2000 (90), pp. 1464-1476. [22] Nalewaik, Jeremy J. “Estimating Probabilities of Recession in Real Time Using GDP and GDI.” FEDS working paper 2007-07. [23] Nalewaik, Jeremy J. “Incorporating Vintage Differences and Forecasts into Markov Switching Models.” FEDS working paper 2007-24. [24] Rudin, Walter. Principles of Mathematical Analysis (New York: McGraw-Hill 1953). [25] Sargent, Thomas J., and Christopher A. Sims, “Business Cycle Modelling without Pretending to have Too Much a Priori Economic Theory,” in Christopher A. Sims (Ed.), New Methods in Business Cycle Research (Minneapolis: Federal Reserve Bank of Minneapolis, 1977). [26] Smith, Richard J.; Weale, Martin R.; and Satchell, Steven E. “Measurement Error with Accounting Constraints: Point and Interval Estimation for Latent Data with an Application to U.K. Gross Domestic Product” Review of Economic Studies, 1998 (65), pp. 109-134. [27] Stock, James H. and Watson, Mark W. “New Indexes of Coincident anf Leading Economic Indicators.” In O. Blanchard and S. Fischer (eds.), NBER Macroeconomics Annual (Cambridge, MA: MIT Press, 1989), pp. 351-394. [28] Stock, James H. and Watson, Mark W. “Macroeconomic Forecasting Using Diffusion Indexex.” Journal of Business and Economic Statistics, 2002 (20), pp. 147-162. 29

[29] Stone, Richard. “Nobel Memorial Lecture 1984: The Accounts of Society.” Journal of Applied Econometrics, 1986 (1), pp. 5-28. [30] Stone, Richard; Champernowne, D.G.; andMeade, J.E.“ThePrecisionofNational Income Estimates” Review of Economic Studies, 1942 (9), pp. 111-125. [31] Watson, Mark W. “Uncertainty in Model-Based Seasonal Adjustment Procedures and Construction of Minimax Filters.” Journal of the American Statistical Association, (1987), vol. 82, Applications, pp. 395-408. [32] Weale, Martin. “Testing Linear Hypotheses on National Accounts Data.” Review of Economics and Statistics, 1985 (90), pp. 685-689. [33] Weale, Martin. “Estimation of Data Measured With Error and Subject to Linear Restrictions.” Journal of Applied Econometrics, 1992 (7), pp. 167-174. 30

Appendix A: Relation to Earlier Work Based on Stone, Champernowne, and Meade (1942) Equation (3’) with the pure noise assumptions yields ∆dy? = τ 2 2∆y t 1+τ 1 2∆y t 2 , essentially t τ2+τ2 1 2 the estimator presented in Weale (1992).17 This paper applied to the case of U.S. GDP and GDI the techniques developed in Stone, Champernowne, and Meade (1942) and Byron (1978); see also Weale (1985), and Smith, Satchell, and Weale (1998). In the general case, Stone et al (1942) considered a row vector of estimates x that should but do not satisfy the set of accounting constraints Ax = 0. They produce a new set of estimates xe ? that satisfy the constraints by solving the constrained quadratic minimization problem: MIN (cid:0) (cid:1)0 (cid:0) (cid:1) (A.1) xe ? xe ? −x V−1 xe ? −x S.T. Axe ? = 0. The matrix V represents a variance-covariance matrix of x? −x, where x? is the vector of “true” values estimated by x, so V−1 is an estimate of “precision”. The case at hand maps to this framework with the minimization problem looking like:   MIN (cid:18) (cid:19) ∆gy1? −∆y1 ∆gy1?,∆gy2? ∆gy1? −∆y1 ∆gy2? −∆y2 V−1 t t  t t t t t t   ∆gy2? −∆y2 t t S.T. ∆gy1? −∆gy2? = 0. t t 17Weale(1992)allowedforcovariancebetweenthemeasurementerrorsε1 andε2. Thishasnoimpact t t on the weights when they are constrained to sum to one. 31

Substituting the constraint into the objective function, we have:   MIN (cid:18) (cid:19) ∆gy? −∆y1 (A.2) ∆gy t ? ∆gy t ? −∆y t 1 ∆gy t ? −∆y t 2 V−1  t t   , ∆gy? −∆y2 t t with ∆gy? = ∆gy1? = ∆gy2?. The judgement in this approach involves the choice of V. t t t Stone et al (1942) are not so specific in their recommendations, but it seems logical to use estimates of the variance of measurement errors, as defined in the noise model, to compute V, and this is the tack taken by much of the literature following Stone et al (1942). The main point of this paper is that it is also important to consider the relative information content of the different estimates: if one estimate contains much more news than the other estimate, we may want to adjust that estimate less than the other, even if it contains more noise as well. Weale (1992) assumes the idiosyncratic variances of GDP and GDI, the τ2, are measurement errors, as in the noise model above. Under i these assumptions, we have:   τ2 0 V =  1 .   0 τ2 2 Solving the quadratic minimization problem with this V, we have ∆gy? = τ 2 2∆y t 1+τ 1 2∆y t 2 , t τ2+τ2 1 2 the same result as the restricted pure noise model. Problem (A.2) is a different minimization problem than the least squares minimizationproblemsthatwesolveinthispaper, wherewesolvefortheweightsin(1)or(1’)and then compute the predicted values ∆dy?; problem (A.2) solves for ∆gy? directly, leaving t t the weights implicit. In solving for the weights in (1) or (1’), assumptions must be made about the covariances between ∆y? and the estimates ∆yi, whereas in (A.2) assumptions t t must be made about V; as we have seen, when these assumptions are equivalent and 32

when some constraints are applied to (1), the two approaches can give the same result. Comparing the Stone, Champernowne, and Meade (1942) approach with the approach taken here, in a more general setting such as in (A.1), is beyond the scope of this paper, but is another interesting avenue for future research. Appendix B: A Simple Example of the Bivariate News Model We will consider two efficient estimates of true GDP growth, one based on consumption growth, and the other based on the growth rate of investment. After constructing each efficient estimate, we will discuss how to produce the improved estimate of true GDP growth by combining them with equation (5). Let ∆C , ∆I , ∆G , and ∆NX be the contributions to true GDP growth ∆y? of t t t t t consumption, investment, government, and net exports, so: ∆y? = ∆C +∆I +∆G +∆NX . t t t t t Our first efficient estimate of y?, ∆y1, is based on F1 = [1, ∆C ], a constant and cont t t t sumption growth, and the second is based on F2 = [1, ∆I ], a constant and investment t t growth; the constant in either information set reveals µ, the mean of y?, as well as the t means of the component growth rates. Then our efficient estimates will take the form: (cid:0) (cid:1) (cid:0) (cid:1) ∆y1 = µ+(∆C −µ )+E ∆I −µ |F1 +E ∆G +∆NX −µ −µ |F1 ; t t C t I t t t G NX t (cid:0) (cid:1) (cid:0) (cid:1) ∆y2 = µ+(∆I −µ )+E ∆C −µ |F2 +E ∆G +∆NX −µ −µ |F2 . t t I t C t t t G NX t For simplicity, we will examine the case where neither F1 nor F2 contains any useful t t information about ∆G + ∆NX − µ − µ , so the last term in each of the above t t G NX expressions is zero, and ∆G +∆NX −µ −µ represents the information about y? t t G NX t 33

contained in neither of our two estimates. The relation between ∆C and ∆I determines the nature of the efficient estimates t t andweightson∆y1 and∆y2 inequation(5). Considerfirstthecasewherethesevariables t t are independent. Then: ∆y1 = µ+(∆C −µ ) and: t t C ∆y2 = µ+(∆I −µ ). t t I There is no information common to F1 and F2, no covariance between the estimates, t t so σ2 = 0. Equation (5) instructs us to remove the mean from each estimate, and then simply add them. Adding back in the mean, we have the natural result: ∆dy? = µ+(∆C −µ )+(∆I −µ ). t t C t I The weight on each estimate (net of mean) is just one; as mentioned in the previous subsection, this is the case where we are essentially adding independent contributions to GDP growth. Next consider the case where ∆C and ∆I are perfectly correlated, so: t t (∆I −µ ) = a(∆C −µ ), t I t C where a is some constant. Then: ∆y1 = µ+(1+a)(∆C −µ ) = µ+(∆C −µ )+(∆I −µ ) and: t t C t C t I ∆y2 = µ+(1+ 1)(∆I −µ ) = µ+(∆C −µ )+(∆I −µ ). t a t I t C t I Given that ∆y1 = ∆y2, taking a weighted average of the two produces the same estimate t t 34

as long as the weights in the average sum to one. There is no idiosyncratic variance to either estimate, so τ2 = τ2 = 0, and equation (5) instructs us to use a weight of 0.5 for 1 2 each estimate.18 Finally consider the general linear case. In this case: (cid:0) (cid:1) E ∆I −µ |F1 = a(∆C −µ ) and: t I t t C (cid:0) (cid:1) E ∆C −µ |F2 = b(∆I −µ ) t C t t I Least squares projections tell us that a = σci, where σ is the covariance between ∆I σ2 ci t c and ∆C , and σ2 is the variance of ∆C . Similarly, b = σci, where σ2 is the variance of t c t σ2 i i ∆I , and the fraction of the variance of each variable explained by the other, R2, is σ c 2 i . t σ2σ2 i c The efficient estimates of ∆y? are: t ∆y1 = µ+(1+a)(∆C −µ ) and: t t C ∆y2 = µ+(1+b)(∆I −µ ). t t I The variance parameters of the news model are identified from the following relations: (cid:0) (cid:1) σ2 = cov ∆y1,∆y2 = (1+a)(1+b)σ , t t ci (cid:0) (cid:1) (cid:0) (cid:1) τ2 = var ∆y1 −cov ∆y1,∆y2 = (1+a)2σ2 −(1+a)(1+b)σ and: 1 t t t c ci (cid:0) (cid:1) (cid:0) (cid:1) τ2 = var ∆y2 −cov ∆y1,∆y2 = (1+b)2σ2 −(1+a)(1+b)σ . 2 t t t i ci Substituting a = σci and b = σci, we see that both τ2 > 0 and τ2 > 0 if σ2 < σ2σ2, or if σ2 σ2 1 2 ci i c c i R2 < 1. If R2 = 1, we are back to the perfect correlation case with τ2 = 0 and τ2 = 0; 1 2 if R2 = 0, we are back to independence with σ2 = 0. In all intermediate cases, the sum 18These weights can be derived through application of L’Hopital’s rule. 35

of the two weights (net of mean) will range between 1 and 2. It should be pointed out that, when combining ∆y1 and ∆y2 in this particular ext t ample, using equation (5) is not the most natural way to proceed. An easier and more intuitive procedure would be to set a(∆C −µ ) to zero in ∆y1, set b(∆I −µ ) to zero t C t t I in ∆y2, and then combine, producing: t ∆dy? = µ+(∆C −µ )+(∆I −µ ). t t C t I This is the best possible estimate of ∆dy? given the information in F1 and F2, so any est t t timate based on (5) can only be worse. This result highlights one of the key assumptions of the model: it assumes that the econometrician does not have enough information to settozeroorre-weightindividualcomponentsofeitherestimate∆yi; theeconometrician t must take each ∆yi in its totality. Considering different weights for different components t of GDP and GDI is an interesting avenue for future research. Appendix C: Revision Equations Determining Bounds on χ Parameters Consider first the covariance between the revision to GDP growth and the revision to GDI growth: cov(∆y1,l −∆y1,f,∆y2,l −∆y2,f) = cov(ζ1,fl −ε1,fl,ζ2,fl −ε2,fl) t t t t t t t t (C.1) = cov(ζ1,fl,ζ2,fl)+cov(ε1,fl,ε2,fl). t t t t The change in the covariance between GDP growth and GDI growth (pre- and post- 36

revision) is a more complicated expression: (cid:16) (cid:16) (cid:17) (cid:16) (cid:17) (cid:17) cov(∆y1,l,∆y2,l)−cov(∆y1,f,∆y2,f) = cov E ∆y?|F1,l +ε1,l,E ∆y?|F2,l +ε2,l t t t t t t t t t t (cid:16) (cid:16) (cid:17) (cid:16) (cid:17) (cid:17) −cov E ∆y?|F1,f +ε1,f,E ∆y?|F2,f +ε2,f . t t t t (cid:16) (cid:16) (cid:17) (cid:16) (cid:17)(cid:17) (C.2) = cov E ∆y?|F1,l ,E ∆y?|F2,l +cov(ε1,l,ε2,l) t t t t t t (cid:16) (cid:16) (cid:17) (cid:16) (cid:17)(cid:17) −cov E ∆y?|F1,f ,E ∆y?|F2,f −cov(ε1,f,ε2,f), t t t t t t using the independence of the noise terms from the conditional expectations. Drilling down further, for the covariance between the conditional expectations in (cid:16) (cid:16) (cid:17) (cid:16) (cid:17)(cid:17) (C.2), we have cov E ∆y?|F1,f ,E ∆y?|F2,f = χ σ2, and: t t t t f f (cid:16) (cid:16) (cid:17) (cid:16) (cid:17)(cid:17) (cid:16) (cid:16) (cid:17) (cid:16) (cid:17) (cid:17) cov E ∆y?|F1,l ,E ∆y?|F2,l = cov E ∆y?|F1,f +ζ1,fl,E ∆y?|F2,f +ζ2,fl t t t t t t t t t t (cid:16) (cid:16) (cid:17) (cid:17) = χ σ2 +cov E ∆y?|F1,f ,ζ2,fl f f t t t (cid:16) (cid:16) (cid:17)(cid:17) (C.3) +cov ζ1,fl,E ∆y?|F2,f +cov(ζ1,fl,ζ2,fl) t t t t t = χ σ2. l l The common news in the “last” estimates is equal to the common news in the “first” estimates plus terms stemming from the revisions. The last term cov(ζ1,fl,ζ2,fl) is t t informationrevealedtobothestimatesthatwasreflectedinneither“first”estimate. The (cid:16) (cid:16) (cid:17) (cid:17) two cov E ∆y?|Fj,f ,ζi,fl terms are information reflected in one “first” estimate but t t t not the other, that is then revealed to the other estimate through revisions, thus making the information common to the “last” estimates. Put differently, this is information in Fj,f (and thus Fj,l since these information sets can only increase), not in Fi,f, but t t t in Fi,l. Each of these terms is positive, so common news can only increase through t revisions. 37

Similarly, for the noise terms in (C.2), cov(ε1,l,ε2,l) = (1−χ )σ2, and: t t l l (cid:16) (cid:17) (cid:16) (cid:17) cov ε1,f,ε2,f = cov ε1,l +ε1,fl,ε2,l +ε2,fl t t t t t t (cid:16) (cid:17) (cid:16) (cid:17) = (1−χ )σ2+cov ε1,fl,ε2,l +cov ε1,l,ε2,fl +cov(ε1,fl,ε2,fl) l l t t t t t t = (1−χ )σ2, so: f f (cid:16) (cid:17) (cid:16) (cid:17) (C.4) (1−χ )σ2 = (1−χ )σ2 −cov ε1,fl,ε2,l −cov ε1,l,ε2,fl −cov(ε1,fl,ε2,fl). l l f f t t t t t t The common noise in the “last” estimates equals the common noise in the “first” estimates minus three revision terms. The last term cov(ε1,fl,ε2,fl) is the common noise t t (cid:16) (cid:17) inthe“final”estimatesremovedfrombothestimatesbyrevision. Thetwocov εi,l,εj,fl t t terms are common noise in the “first” estimates removed from one estimate by revision, butnottheother. Thesethreetermsallreducethecommonnoiseinthe“last”estimates, so common noise can only fall through revision. Substituting (C.3) and (C.4) into (C.2) yields: (cid:16) (cid:16) (cid:17) (cid:17) cov(∆y1,l,∆y2,l)−cov(∆y1,f,∆y2,f) = cov E ∆y?|F1,f ,ζ2,fl t t t t t t t (cid:16) (cid:16) (cid:17)(cid:17) +cov ζ1,fl,E ∆y?|F2,f +cov(ζ1,fl,ζ2,fl) t t t t t (cid:16) (cid:17) (cid:16) (cid:17) −cov ε1,fl,ε2,l −cov ε1,l,ε2,fl t t t t (C.5) −cov(ε1,fl,ε2,fl). t t The relation between (C.1) and (C.5) is evidently a bit more complicated than the relation between (7) and (8); there is no unique solution for the six terms appearing in these two equations. Next consider the idiosyncratic news in the “last” estimate of i. This is equal to the idiosyncratic news in the “first” estimate of i, minus the part of this idiosyncratic news revealed to j by revision (and hence transforming it to common news), plus the 38

idiosyncratic news added to i by revision, γ τ2: i,fl i,l (cid:16) (cid:16) (cid:17) (cid:17) (C.6) χ τ2 = χ τ2 −cov E ∆y?|Fi,f ,ζj,fl +γ τ2, i,l i,l i,f i,f t t t i,fl i,l The overall increase in news from revisions, computed from (7) and (8), is the sum of this change in idiosyncratic news (C.6) and the change in common news as computed from (C.3): var(ζi,fl) = var(ζi,l)−var(ζi,f) t t t = (cid:0) χ σ2−χ σ2(cid:1) l l f f + (cid:0) χ τ2 −χ τ2 (cid:1) i,l i,l i,f i,f (cid:16) (cid:16) (cid:17) (cid:17) (cid:16) (cid:16) (cid:17)(cid:17) = cov E ∆y?|Fi,f ,ζj,fl +cov ζi,fl,E ∆y?|Fj,f +cov(ζi,fl,ζj,fl) t t t t t t t t (cid:16) (cid:16) (cid:17) (cid:17) −cov E ∆y?|Fi,f ,ζj,fl +γ τ2 t t t i,fl i,l (cid:16) (cid:16) (cid:17)(cid:17) (C.7) = cov ζi,fl,E ∆y?|Fj,f +cov(ζi,fl,ζj,fl)+γ τ2. t t t t t i,fl i,l Finally consider the idiosyncratic noise in each “last” estimate. Let (1−ψ )τ2 be i,fl i,f the idiosyncratic noise in ∆yi,f eliminated by revision. Noise common to the two “first” t estimates that is eliminated from j but not i now appears as idiosyncratic noise in the “last” i estimate, so: (cid:16) (cid:17) (C.8) (1−χ )τ2 = (1−χ )τ2 +cov εj,fl,εi,l −(1−ψ )τ2 . i,l i,l i,f i,f t t i,fl i,f The overall noise reduction from revisions, computed from (7) and (8), is the sum of this change in idiosyncratic noise (C.8) and the change in common noise as computed 39

from (C.4): var(εi,fl) = var(εi,f)−var(εi,l) t t t = (cid:0) (1−χ )σ2 −(1−χ )σ2(cid:1) f f l l + (cid:0) (1−χ )τ2 −(1−χ )τ2(cid:1) i,f i,f i,l i,l (cid:16) (cid:17) (cid:16) (cid:17) = cov εj,fl,εi,l +cov εj,l,εi,fl +cov(εj,fl,εi,fl) t t t t t t (cid:16) (cid:17) −cov εj,fl,εi,l +(1−ψ )τ2 t t i,fl i,f (cid:16) (cid:17) (C.9) = cov εj,l,εi,fl +cov(εj,fl,εi,fl)+(1−ψ )τ2 . t t t t i,fl i,f Equations (C.7) and (C.9) for i = 1,2, (C.1) and (C.5) are six equations in ten unknowns (ψ and γ for i = 1,2 and the six terms on the right-hand side of (C.5)). i,fl i,fl These six equations limit the admissable values for the ten unknowns, which in turn limit the range of admissable values for χ and (1−χ ) as can be seen from (C.6) and i,l i,l (C.8). For the “first” estimates, the admissable values for (1−χ ) are constrained by i,f (cid:16) (cid:16) (cid:17) (cid:17) (1 − ψ )τ2 ≤ (1 − χ )τ2 , while χ is constrained by cov E ∆y?|Fj,f ,ζi,fl ≤ i,fl i,f i,f i,f i,f t t t χ τ2 . We also have: i,f i,f (cid:16) (cid:17) (cid:16) (cid:17) (C.10) (1−χ )σ2 ≥ cov ε1,fl,ε2,l +cov ε1,l,ε2,fl +cov(ε1,fl,ε2,fl). f f t t t t t t 40

Table 1: Summary Statistics: Variances and Covariances, Growth Rates of GDP and GDI, 1984Q3-2004 (1) (2) (3) (4) (5) (6) Measure ∆yi,f ∆yi,l (2)-(1) Revision: ∆yi,l −∆yi,f Total ↑ News ↓ Noise var, GDP (i = 1) 4.18 4.18 0.00 1.91 0.96 0.96 var, GDI (i = 2) 3.61 5.15 1.64 2.31 1.93 0.39 cov, GDP and GDI 3.48 3.15 -0.33 0.71 ? ? Table 2: Lower and Upper Bounds on News Shares (cid:16) (cid:17) (cid:16) (cid:17) (cid:16) (cid:17) (cid:16) (cid:17) min χ 1,l τ 1,l + max χ 1,l τ 1,l + min w 1,l min w 2,l χ τ χ τ w w 2,l 2,l 2,l 2,l 2,l 1,l χ 0.22 1.00 0.11 1.00 1,l χ 0.46 0.86 0.61 0.65 2,l χ 0.41 0.58 0.00 1.00 1,f χ 0.08 1.00 1.00 0.00 2,f χ 0.61 0.81 0.66 0.73 f 41

Table 3: Estimates of True Unobserved GDP Growth (cid:16) (cid:17) (cid:16) (cid:17) min χ 1,l τ 1,l + max χ 1,l τ 1,l + χ τ χ τ 2,l 2,l 2,l 2,l Vintage µ σ τ2 τ2 w w w w 1 2 GDP GDI GDP GDI First 5.56 3.44 0.72 0.13 0.44 0.16 0.45 0.39 (0.21) (0.57) (0.23) (0.20) (0.02) (0.03) (0.16) (0.19) Last 5.71 3.11 1.03 1.98 0.40 0.55 0.53 0.63 (0.21) (0.61) (0.41) (0.48) (0.04) (0.03) (0.11) (0.08) (cid:16) (cid:17) (cid:16) (cid:17) w w min 1,l min 2,l w w 2,l 1,l Vintage w w w w GDP GDI GDP GDI First -0.05 0.73 0.96 -0.23 (0.07) (0.09) (0.06) (0.07) Last 0.26 0.69 0.65 0.46 (0.04) (0.03) (0.08) (0.06) 42

Figure 1: 1985 to 2004 Growth Rates of Nominal GDP and GDI, Percent Latest Available data as of August 2007 12 10 GDP GDI 8 6 4 2 0 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 8 8 8 8 8 9 9 9 9 9 9 9 9 9 9 0 0 0 0 0 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 2 2 2 2 -2

Figure 2: 1989Q1-1991Q4 Growth Rates of Real GDP, Real GDI, and Percent Estimated "True" Growth Rate, 6.00 Latest Available data as of August 2007 5.00 GDP Growth GDI Growth 4.00 Estimated 'True' Growth 3.00 2.00 1.00 0.00 1 1 1 1 1 1 1 1 1 1 1 1 9 9 9 9 9 9 9 9 9 9 9 9 8 8 8 8 9 9 9 9 9 9 9 9 9 9 9 9 0 0 0 0 1 1 1 1 Q Q Q Q Q Q Q Q Q Q Q Q -1.00 1 2 3 4 1 2 3 4 1 2 3 4 -2.00 -3.00 -4.00

Figure 3: Percent 1999Q4-2003Q2 Growth Rates of Real GDP, Real GDI, and Estimated "True" Growth Rate, 8.00 Latest Available data as of August 2007 GDP Growth 6.00 GDI Growth Estimated 'True' Growth 4.00 2.00 0.00 1 2 2 2 2 2 2 2 2 2 2 2 2 2 2 9 0 0 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 1 1 1 1 2 2 2 2 3 3 Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q 4 1 2 3 4 1 2 3 4 1 2 3 4 1 2 -2.00 -4.00

Cite this document
APA
Dennis J. Fixler and Jeremy J. Nalewaik (2007). News, Noise, and Estimates of the "True" Unobserved State of the Economy (FEDS 2007-34). Board of Governors of the Federal Reserve System, Finance and Economics Discussion Series. https://whenthefedspeaks.com/doc/feds_2007-34
BibTeX
@techreport{wtfs_feds_2007_34,
  author = {Dennis J. Fixler and Jeremy J. Nalewaik},
  title = {News, Noise, and Estimates of the "True" Unobserved State of the Economy},
  type = {Finance and Economics Discussion Series},
  number = {2007-34},
  institution = {Board of Governors of the Federal Reserve System},
  year = {2007},
  url = {https://whenthefedspeaks.com/doc/feds_2007-34},
  abstract = {Which provides a better estimate of the "true" state of the U.S. economy, gross domestic product (GDP) or gross domestic income (GDI)? Past work has assumed the idiosyncratic variation in each estimate is pure noise, taking greater variability to imply lower reliability. We develop models that relax this assumption, allowing the idiosyncratic variation in the estimates to be partly or pure news; then greater variability may imply higher information content and greater reliability. Based on evidence from revisions, we reject the pure noise assumption for GDI growth, and our results favor placing a higher weight on GDI due to its relatively large idiosyncratic variability. This calls into question the suitability of the pure noise assumption in other contexts, including dynamic factor models.},
}