feds · July 31, 2012

Estimating Changes in Supervisory Standards and Their Economic Effects

Abstract

The disappointingly slow recovery in the U.S. from the recent recession and financial crisis has once again focused attention on the relationship between financial frictions and economic growth. With bank loans having only recently started growing and still sluggish, some bankers and borrowers have suggested that unnecessarily tight supervisory policies have been a constraint on new lending that is hindering recovery. This paper explores one specific aspect of supervisory policy: whether the standards used to assign commercial bank CAMELS ratings have changed materially over time (1991-2011). We show that models incorporating time-varying parameters or economy-wide variables suggest that standards used in the assignment of CAMELS ratings in recent years generally have been in line with historical experience. Indeed, each of the models used in this analysis suggests that the variation in those standards has been relatively small in absolute terms over most of the sample period. However, we show that when this particular aspect of supervisory stringency becomes elevated, it has a noticeable dampening effect on lending activity in subsequent quarters.

Finance and Economics Discussion Series Divisions of Research & Statistics and Monetary Affairs Federal Reserve Board, Washington, D.C. Estimating Changes in Supervisory Standards and Their Economic Effects William F. Bassett, Seung Jung Lee, and Thomas W. Spiller 2012-55 NOTE: Staff working papers in the Finance and Economics Discussion Series (FEDS) are preliminary materials circulated to stimulate discussion and critical comment. The analysis and conclusions set forth are those of the authors and do not indicate concurrence by other members of the research staff or the Board of Governors. References in publications to the Finance and Economics Discussion Series (other than acknowledgement) should be cleared with the author(s) to protect the tentative character of these papers.

Estimating Changes in Supervisory Standards and Their Economic Effects William F. Bassett Seung Jung Lee Thomas W. Spiller∗ August 24, 2012 Abstract ThedisappointinglyslowrecoveryintheU.S.fromtherecentrecessionandfinancial crisis has once again focused attention on the relationship between financial frictions and economic growth. With bank loans having only recently started growing and still sluggish, some bankers and borrowers have suggested that unnecessarily tight supervisory policies have been a constraint on new lending that is hindering recovery. This paper explores one specific aspect of supervisory policy: whether the standards used to assign commercial bank CAMELS ratings have changed materially over time (1991- 2011). We show that models incorporating time-varying parameters or economy-wide variables suggest that standards used in the assignment of CAMELS ratings in recent years generallyhave been in line with historicalexperience. Indeed, eachof the models used in this analysis suggests that the variation in those standards has been relatively small in absolute terms over most of the sample period. However, we show that when this particular aspect of supervisory stringency becomes elevated, it has a noticeable dampening effect on lending activity in subsequent quarters. JEL Classification: G21, G28, L25 Keywords: BankSupervisionandRegulation,FinancialFrictions,CAMELSRatings. WearegratefultoBill English, BillFrancis,Matt Mattson,Bill Nelson,Marcelo Rezende,Jim Sheerin, RickWatkins,Egon Zakrajˇsek andseminarparticipantsattheFederalReserveBoard forhelpfulcomments andsuggestions. Allerrorsandomissionsareourresponsibilityalone. Theviewsexpressedinthispaperare solely theresponsibility oftheauthorsandshould notbeinterpretedasreflectingtheviewsof theBoard of Governors of theFederal ReserveSystem or of anyoneelse associated with theFederal Reserve System. ∗ DivisionofMonetaryAffairs,FederalReserveBoard,21st StreetandConstitutionAvenue,NW,Washington,DC20551. E-mail:william.f.bassett@frb.gov,seung.j.lee@frb.gov,thomas.w.spiller@frb.gov, respectively.

1 Introduction Thefinancialcrisisthatbeganinmid2007andcontinuedwellinto2009hassparkedrenewed interest in the channels through which changes in the cost and availability of credit are linked to economic performance, as well as the magnitudes of the effects generated by such financial frictions. Particular attention regularly focuses on the unique role of commercial banks in the financial system, in large part because they are often viewed as the most 1 efficient orsometimes thesole providersofcredittomany householdsandsmallbusinesses. For instance, Lown and Morgan (2006) showed that changes in bank lending standards have importantmacroeconomic effects, andBassett, Chosak, Driscoll, andZakrajˇsek (2010) document the large contractionary shock to lending standards during the recent financial crisis and its material effects on lending and GDP. The excesses of the mid-2000s that contributed importantly to the crisis left many commercial banks in a significantly weakened state that resulted in downgrades of their supervisory ratings over the 2007 to 2009 period. The share of banks that supervisors consider “weak” remains elevated to this day, and the pace of decline in the share of weak banks has lagged significantly behind the pace seen following the banking crisis of the early 1990s, despite noticeable improvements in banking conditions since the height of the financial crisis. Moreover, as in the recession and slow recovery in the early 1990s, weak banks have contributed disproportionately to the contraction in loans over the past several years (exhibit 1). In addition, Peek, Rosengren, and Tootell (2003b) identify loan supply shocks by the fraction of banks that receive the worst supervisory risk rating, and find that this measure is important in explaining inventory movements, the component of GDP most dependent on bank lending, from 1978 to 1998. Two earlier papers by the same authorsarguethatexploitingsuchconfidentialsupervisoryinformationgenerates important synergies in the Federal Reserve’s monetary policymaking process by allowing the FOMC to account for potential swings in credit supply in setting interest rates (Peek, Rosengren, and Tootell (1999) and Peek, Rosengren, and Tootell (2003a)). Therefore, if CAMELS ratings are currently unduly stringent, then supervisors could be a source of headwinds in the economy. Tobesure,bankscontinuetofaceongoing,heightenedscrutinyoftheirriskmanagement practices by both supervisors and market participants as they also adjust to a host of new regulations. Among the vast array of financial regulatory reforms required under the Dodd-Frank Act and Basel III, one important goal is to provide a framework for enhanced macroprudential supervision of financial institutions. As part of that goal, regulators are more closely considering the potential feedback loops between bank supervision and the 1In a more historical context, Bernanke (1983), for example, emphasized the role such a credit squeeze on aggregate demand played in the protraction of the Great Depression. 1

broader economy. For instance, a common refrain is that the worst performing loans are made during the late stages of economic expansions, in part because banks and regulators 2 have become less attuned to risks (Berger and Udell (2004)). A corollary might be that many good loans are not made during and shortly after the end of economic downturns because risk aversion lingers too long. Exhibit 1: CAMELS Ratings and Loan Growth Contributions to growth in total loans at domestic banks by CAMELS ratings FFoouurr--qquuaarrtteerr ppeerrcceenntt cchhaannggee 1166 Strong banks 1122 Weak banks 88 44 00 Q2 --44 --88 --1122 11999900 11999933 11999966 11999999 22000022 22000055 22000088 22001111 NNoottee:: Strong banks have CAMELS ratings of 1 or 2; weak banks have CAMELS ratings of 3, 4, or 5. Shaded lines represent recessions as identified by the NBER. Source. Call Reports, FFIEC. Recognizing these parallel risks, the new regulations seek to ensure that banks retain adequate capital and liquidity cushions to support lending. In particular, they include provisions directing supervisors to implement a countercyclical capital buffer that will lean againstadditionallendingduringaboomandsupportlendingduringadownturn. But,capital standards and other quantitive measures of bank health are importantly complemented by direct supervisory oversight of institutions and their practices. While good arguments exist against regulatory forbearance to stimulate lending during downturns, macroprudential goals might at least seek to ensure that supervisors are consistently applying these more-subjective standards through time. Many bankers and some borrowers, particularly small businesses, have suggested that that regulators have maintained an excessive level of scrutiny of bank lending practices in 2See also Greenspan, A. 2001. “The Financial Safety Net.” Speech at the 37th Annual Conference on Bank Structureand Competition of theFederal Reserve Bank of Chicago, May 10, Chicago, IL. 2

recent years. Further, they note that this scruitiny is contributing to the weakness in bank 3 lending and by extension the sluggish recovery. In response to those concerns, the federal bank regulatory agencies issued joint guidance to their examination teams and reviewed their performance to ensure that examination standards are not unduly affecting the flow 4 of credit. In addition, the Federal Reserve has engaged in extensive community outreach and discussions with various stakeholders to identify policies and strategies that would help 5 ensure that creditworthy borrowers have access to appropriate financing sources. Thispaperconsiderstheextenttowhichvariationinsupervisorystringencyisevidentin composite CAMELS ratings, the overall supervisory assessment of the conditions of banks, 6 between thethirdquarter of 1991 to thesecond quarter of 2011. Thatsampleperiodspans two eras often referred to as “credit crunch” periods—the first in the early 1990s and the most recent sincethe endof 2008. Importantly, such ratings aresupposedto beinvariant to business cycle fluctuations, instead conveying an absolute assessment of a bank’s condition and risk of failure at any given point in time. Because of the various peculiarities of the process used to assign CAMELS ratings and the relatively short time series dimension of our dataset, standard econometric models for panel data are somewhat imperfect for the task. Likely in part for that reason, most of a small existing literature attempted to model stringency using time-period fixed effects estimated from pooled cross-sectional data, and generally concluded that supervisors were more stringent in the early 1990s than during other periods. In this study, we expand upon the existing literature in three ways. First, we extend the sample used in previous studies to include the most recent financial crisis. Second, we incorporate an improved measure of local economic conditions facing the bank as well as various macroeconomic indicators and financial market variables (hereafter, “economy-wide variables”) in several alternative statistical modelstocapturesupervisoryreactions notonlytothebank’sobservedcondition butalso to theeconomic environment it faces. Third,in hopesof mitigating concerns about thepotentialshortcomings ofany particular model,weuseavariety ofdifferentpanel-based econometric specifications for comparison, as well as a series of repeated cross-sectional regressions. Thelattermethodologyhasnotbeenfullyexploredintheexistingliteratureand provides greater flexibility in modeling the time variation of both the thresholds associated 3See, for example, The Wall Street Journal, June 21, 2010, “A Credit Crunch That Lingers.” 4Supervision and Regulation (SR)Letter10-2, “Interagency Statement on Meeting theNeedsof Creditworthy Small Business Borrowers.” 5Information about the community outreach initiatives of the Federal Reserve are available at http : //www.federalreserve.gov/newsevents/conferences/conferences.htm 6The acronym CAMELS is derived from the components of a bank’s condition that supervisors assess usingamixofpubliclyavailable andprivateinformation toassign acomposite overallrating. Theseare: C (Capital Adequacy,A(Asset Quality),M(Management),E(Earnings),L (Liquidity),andS(Sensitivityto Market Risk). Thelast componentconcerningsensitivity tomarketrisk wasadded in1997. Thecomposite CAMELS rating is then the supervisory rating of theoverall condition of a bank. 3

with a given CAMELS rating and the coefficients on the explanatory variables. Ouranalysis resultsin threefairly robustconclusions. First, supervisorystandardsused in the assignment of CAMELS ratings appear to have been reasonably constant across the sample period, with some evidence that they were somewhat tighter than average during the early-1990s and in 2008. Second, the extent of stringency estimated from CAMELS ratings is somewhat model-dependent: our use of economy-wide variables instead of time fixed effects (which were used in much of the existing literature) to control for macroeconomic conditions reduces the extent of supervisory stringency commonly observed in the early 1990s and also suggests that much less stringency existed during the recent financial crisis. Third, the degree of supervisory stringency identified by our model is associated with statistically significant changes in lending standards and with changes in bank lending. Although the effects are relatively small, these results provide support for an active bank lending channel in the transmission of monetary policy. Thenextsection ofthepaperplaces ouranalysisinthecontextoftheexistingliterature. The following section describes the data and specific variable definitions used in the analysis. Section 4 describes the tradeoffs involved in the methodologies used to estimate the relationship between CAMELSratings andobserved data. Section 5 describestheresults of that estimation and the calculation of aggregate supervisory stringency. Section 6 explores the relationship between aggregate supervisory stringency, lending, and economic growth. Section 7 concludes. 2 Review of Existing Literature A small number of authors have studied the extent to which bank supervisors change their standards and policies over the economic and financial cycle, with some extending the analysis to how such changes affect lending behavior (and, by extension, broader economic performance). Previousworkatthecommercialbanklevel, suchasBerger,Kyle,andScalise (2001), concluded that supervisors indeed were “tougher” during the credit crunch in the early1990sthantheywereinthemid-1990s. Curry,Fissel,andHanweck(2008)andKrainer and Lopez (2009) examine bank-holding company supervisory ratings - BOPEC ratings over the 1987 to 2004 period and arrive at similar conclusions. Controlling for some bank balancesheetandaggregatemacroeconomicvariables,Bizer(1993)findsstrictersupervisory standards in the 1989 to 1992 period relative to 1988 as well as an economically significant association between CAMELS ratings and loan growth. Curry, Fissel, and Ramirez (2008) also provide some evidence that bank lending was sensitive to ratings between 1985 and 1993, but then show that ratings and lending were not as intertwined in subsequent years. Finally, though they do not model supervisory ratings per se, Kiser, Prager, and Scott 4

(2012) examine the extent to which changes in banks’ CAMELS ratings are associated with changes in the rate of growth of their lending to small businesses, and find that small banks that experienced ratings downgrades between 2007 and 2010 exhibited significantly lower rates of growth in small business loans outstanding compared with banks that maintained their ratings at healthy levels during the same period. ThestandardapproachinmostofthosepapershasbeentomodelthediscreteCAMELS ratings distribution within a pooled cross section using an ordered limited-dependent variableframework. Thecontrols generally includedarangeof bank-specificcharacteristics and a set of regional indicator variables or state-level variables for local economic conditions. With the exception of Bizer (1993), who estimated bank CAMEL ratings for limited time periods separately, all of the studies incorporate time-period fixed effects, and interpret the series of coefficients onthose indicator variables as therelative degreeof “tightness” applied by bank supervisors over time. However, the results of our study suggest that this approach has two critical weaknesses. First, the time fixed effects could also be picking up the response of regulators to conditions in broader financial markets or the macroeconomic environment that are not accounted for by regional or state-level control variables. If we define supervisory stringency as stricter supervisory standards than what can be explained by identifiable factors, economy-wide variables may explain an important portion of supervisory standards that 7 were deemed “stricter” in the previous literature. Second, by construction, the time fixed effects shift each of the cutoff points simultaneously and by equal amounts across different rating categories. Therefore, the approach does not allow for standards to change differentially across the various CAMEL rating categories. For example, regulators may become stricter in assigning ratings for only the weakest set of banks. Therefore, we also devise a methodology that allows the thresholds to vary through time separately for each rating, while still incorporating economy-wide variables. 3 Data The paper combines confidential supervisory data on CAMELS ratings with bank-specific balance sheet and income items from the commercial bank Call Report. In addition, we use the annual Summary of Deposits survey data to identify the location of the branches in which banks book their deposits, and combine that information with state-level economic indicators to generate bank-specific economic conditions variables. Finally, we ob- 7Cecchetti(2001)showedthattheestimatesofsupervisorystandardsinBerger,Kyle,andScalise(2001) were correlated with indicators of conditions in the broader national economy. Although macro variables might be highly correlated with home state economic conditions, which are accounted for in the paper, we show that theseeffects are both economically and statistically significant. 5

tain macroeconomic and financial sector variables from a variety of commonly referenced sources. The sample begins in the third quarter of 1991, which is the first period in which we have enough quarters of data on regulatory capital ratios, a key determant of CAMELS over the past two-plus decades, to estimate all of our specifications. It ends in the second quarter of 2011, because data on CAMELS ratings sometimes enters the database with a significant lag, at times making very recent quarters unrepresentative. 3.1 CAMELS Ratings For our dependent variable that describes the conditions of a bank, we use composite CAMELS ratings taken from a confidential supervisory database maintained by federal bank regulatory agencies that includes key information about the timing and scope of the exams. Banks with composite ratings of 1 or 2 are considered “strong,” while banks with ratings of 3, 4, 5 are considered “weak” and subjected to increasing levels of regulatory 8 scrutiny as they progress down the scale. So called ”full-scope” exams, in which an on-site team of examiners assesses the full range of bank operations, are mandated every 12 to 18 months for strong banks (depending on a threshold of total assets), and every 6 months for 9 weak banks. We begin by including all commercial bank examination data that led to a designation by bank regulators (the Federal Reserve, the OCC, the FDIC, and the state agencies) of CAMELS ratings between the third quarter of 1991 and the second quarter of 2011. Sometimes a bank may have more than one exam registered in a given quarter; in those 10 cases, the exam closest to quarter-end was used. 8More specifically, a composite CAMELS rating of a 1 means that the bank is basically sound in every respect. A CAMELS rating of 2 means that the bank is fundamentally sound, but may have modest weaknesses correctable in the normal course of business. A CAMELS rating of a 3 means that a bank has a combination of financial, operational, or compliance weaknesses ranging from moderately severe to unsatisfactory. A CAMELS rating of a 4 means that a bank has a immoderate volume of serious financial weaknessesoracombination ofotherconditionsthatareunsatisfactory tosupervisors. Finally,aCAMELS rating of a 5 means that the bank has an extremely high immediate or near term probability of failure. For further information, see Commercial Bank Examination Manual, A.5020.1, pp. 3-4: Uniform Financial Institutions RatingSystem, effective3/84. 9Prior to The Federal Deposit Insurance Corporation Improvement Act of 1991(FDICIA) effective in December 1992, the three federal regulators and many state banking departments examined banks on frequenciesthat variedbybanks’condition orpast ratings. FDICIA thenestablished auniform criteria based on size and risk profile, which has, since then, changed over time. The threshold for the risk profile last changed as part of The Riegle Community Development and Regulatory Improvement Act of 1994 and the threshold for size last changed in 2007 as part of theInterim RulestoImplement theExamination Amendmentsof2006, whichtothisdayrequiresbankswithassets ofmorethan$500 million tobeexaminedmore frequently every year. See Rezende(2011) for more details. 10Some previous researchers suggest that only full-scope on-site exams should be used in the type of analysisdoneinthispaper. Weincludeoff-siteandtargetedexamsinoursampletouseamorerepresentative sampleofthebankinguniverseineachindividualtimeperiod. Ourresultsarerobusttousingonlyfull-scope exams. 6

As shown in the second exhibit, the number of exams for a given bank in our 20 year sample varies considerably. This variation is accounted for by new commercial banks, the staggered exam schedule that depends on both the size of the bank and the previous CAMELS rating, and exits from the sample due to mergers, aquisitions and failures. The average bank in the sample has been examined about 14 times, but even when examination data for banks with fewer than five exams over the sample period are removed, about 35 percent of the banks in our sample have been examined no more than ten times. Exhibit 2: Bank Exams Distribution of Bank Exams Number of banks 750 600 450 300 150 0 5 8 11 14 17 20 23 26 29 32 35 40 Number of exams Source. Call Reports, FFIEC. Exhibit 3 shows the average CAMELS rating of banks examined during each quarter over the full sample period that is used in the panel data models. In addition, in order to constructrelevant andlarge samples for our repeated cross-section analysis, weusearolling two-year window of exams and consider only the most recent exam for each bank within that window. The average CAMELS rating for this two-year grouped data is also displayed in the top panel in the first exhibit. Each point on that line is centered two quarters from the end of the two-year window, reflecting the average date of the exams conducted during the typical subsample. The two CAMELS averages are highly correlated. Bank ratings were significantly worse than average during the credit crunch of the early 1990s and they worsened quickly and substantially during the most recent financial crisis. This pattern in theaverage ratingreflectschangesinthenumberofbanksratedineachofthefiveCAMELS rating categories, as shown in the middle and bottom panels in the third exhibit. 7

Exhibit 3: Average and Distribution of CAMELS ratings Average CAMELS ratings Mean rating 2.4 Quarterly Quarterly Quarterly - grouped data 2.2 2.0 1.8 1.6 1.4 1991 1993 1995 1997 1999 2001 2003 2005 2007 2009 2011 Percent of strong* banks Percent 140 120 CAMEL = 1 CAMEL = 2 100 80 60 40 20 0 1991 1993 1995 1997 1999 2001 2003 2005 2007 2009 2011 * Strong banks are those with a CAMELS rating of 1 or 2. Percent of weak** banks Percent 64 56 CAMEL = 3 CAMEL = 4 48 CAMEL = 5 40 32 24 16 8 0 1991 1993 1995 1997 1999 2001 2003 2005 2007 2009 2011 ** Weak banks are those with a CAMELS rating of 3, 4, or 5. Source. Call Reports, FFIEC. 8

Large banks are usually reviewed in a much different manner than their smaller counterparts, including by a team of resident examiners that are in consistent contact with bank management. Further, large banks have much broader scope and complexity of their operations, much of which cannot be adequately assessed with the limited number of Call Report items that could be included in an econometric model. Therefore, we excluded from our sample any banks that are subsidiaries of the 25 largest bank holding companies in any given quarter. However, this still accounts for about 40 percent of industry loans, on 11 average, over our sample period. 3.2 Explanatory Variables Bank Balance Sheet and Income Items The majority of the explanatory variables are constructed from bank balance sheet and income data from the CallReports. Thosevariables are are detailed in Table 1. Inchoosing explanatory variables, we used those bank balance sheet and income items that are closely 12 related to the components of the CAMELS ratings. • Capital adequacy: Total risk-based capital ratio, the leverage ratio as defined in FDICIA, and the ratio of delinquencies to loan loss reserves • Asset quality: Noncurrent loan ratio, and the ratio of private security holdings (which excludes Treasuries, agency securities, and agency MBS) to total assets, the ratio of loans secured by commercial real estate (CRE) to total assets, the ratio of loans secured by residential real estate (RRE) to total assets, and the ratio of other loans (not secured by real-estate) to total assets • Management quality: Noninterest expense to revenue (net interest income plus noninterest income) 11We also exclude individual bank exam observations identified as outliers based on extreme time lags between the financial as of date (the date of the financial statements used in the exam) and the close date (the end of the exam) or the start date (the beginning of the exam) for a given exam. For the purpose of dating the observations in this paper, we use the financial as of date - if the financial as of date is exactly at the end of a quarter, the exam is considered to be conducted during the following quarter, but if the financial as of date is during a quarter, the exam is considered to be conducted during that quarter. Most exams are conducted with financial as of date at the end of the quarter. 12In our regressions, we omit observations if a financial ratio (or the four-quarter changes in the ratio) based on bank balance sheet and income statements are above the 99.5th percentile or below the 0.5th percentile. In addition, we remove banks with loans less than 10 percent of assets. After that stage of data cleaning, we end up with 123,344 unique bank-quarterobservations for the panel regressions. Further cleaningthesampletoeliminatebankswithobservationsinwhichtheirfinancialratiosdeviatesubstantially from their own long-run averages of various financial ratios, which improves the stability of the modified random-effectsregressions,decreasesthesampleto116,921observations. Aminimumof830andamaximum of 2,617 banksare present in a given quarterduringthe sample period. 9

• Earnings: Return on assets (ROA) and the net interest margin (NIM) • Liquidity: The ratio of core deposits to total assets and the “volatile liability dependence ratio,” which measures the extent to which a bank is funding long-term 13 investments with short-term liabilities. • Sensitivity to market risk: Return on risky assets defined as noninterest income net of deposit fees and fiduciary income divided by average total assets As in the literature, we also include the log of total assets to account for factors such as the degree of portfolio diversification and potential to exploit scale economies, in addition to possible differences in supervisory treatment of larger institutions. For all of the balance sheet items, we use the average value of the four quarters preceding the exam, while for the income and flow items, we use four-quarter cumulative amounts scaled by relevant balance sheet or income items when necessary. All the financial ratios based on flow items are normalized by Schedule K balance sheet items (i.e., reflect the average outstandings in that itemduringthequarteroryear,asappropriate). Thefinancialratiosbasedsolelyonbalance sheet items are based on end-of-period values with the exception of the volatile liability dependence ratio, which is more subject to quarter-end window dressing and therefore based on Schedule-K values. We use data only if it would be available to examiners at the time of the exam. If the exam began on the last day of the quarter, we assume that the examiners were able to use the data for that quarter and consider the exam to have been conducted in the following quarter. Other Items We include several variables to control for the structure of the bank and the agency performing the exam. They are composed of indicators for whether a bank is part of a Bank Holding Company (BHC), and also for which of the federal or state regulatory agencies was the lead agency in the bank examination. All else equal, banks that are part of a larger bank holding company may be stronger because they can be supported by the financial strength of the parent. Whereas state chartered member banks are supervised jointly by state regulators and the Federal Reserve, non-member banks are supervisedjointly by state regulators and the FDIC. Moreover, national banks are subject to the regulation of the OCC. Because the Federal Reserve has the authority to examine bank holding companies, 13The core deposits ratio is defined as the sum of transactions deposits, savings deposits, and smalldenomination time deposits divided by total assets. The volatile liability dependence ratio is defined as: (interest-bearing foreign liabilities + large time deposits + federal funds borrowed and repos + demand notesissued toU.S.Treasury andotherborrowed money-federalfundslent andreverserepos -assetsheld in thetrading account) divided by total assets. 10

Table 1: Summary Statistics Variable Average Deviation Acronym Leverage Ratio 9.007 2.629 LEV Total Capital Ratio 14.905 6.617 TCR Non-Interest Expense Ratio 257.41 51.739 NIE Noncurrent Loan Ratio 2.291 2.130 NON Delinquent Loans to Reserves Ratio 163.92 138.966 D2R Return-on-Assets 4.465 2.577 ROA Net Interest Margin 17.364 3.132 NIM Core Deposits Ratio 75.443 9.157 CORE Volatile Liability Ratio 10.163 10.524 VOL Return on Risky Assets 0.889 1.685 RISK Security Holdings Ratio 4.805 5.340 SEC Commercial Real Estate Loan Ratio 11.801 12.516 CRE Loans Secured by Real Estate (Non-CRE) Ratio 19.799 10.257 RE Other Loans Ratio 22.693 11.213 OTH Log of Total Assets 11.317 1.181 TA Table 2: Transition Matrix CAMELSt+1 CAMELSt+1 CAMELSt+1 CAMELSt+1 CAMELSt+1 =1 =2 =3 =4 =5 CAMELSt=1 85.01% 14.42% 0.54% 0.03% 0.00% CAMELSt=2 10.25% 84.51% 4.68% 0.53% 0.03% CAMELSt=3 0.19% 35.35% 58.60% 5.56% 0.30% CAMELSt=4 0.00% 4.88% 33.11% 57.76% 4.25% CAMELSt=5 0.00% 3.16% 4.21% 38.95% 53.68% Numberof banks 41,834 69,076 10,270 2,069 95 those banks that are part of a BHC but regulated by the OCC or FDIC effectively have two federal supervisors, an arrangement that may improve the oversight of such entities. In addition, systematic differences in the manner in which banks are reviewed by their lead regulators may exist as in Agarwal, Lucca, Seru, and Trebbi (2012). A dummy variable for whether the bank changed its charter since the previous exam is included as Rezende (2011) finds evidence of more favorable ratings for banks that changed charters. We also control for mergers, because many mergers involve a stronger bank acquiring a weakened bank, and balance sheet and income statement data may not be sufficient to control for conditions of banks when they go through structural changes. 11

A set of indicator variables for the previous CAMELS ratings accounts both for sample selection, in that banks with poorer ratings are reviewed more frequently, and for the “stickiness”intheratingsfoundintheliteraturesuchasinBerger, Kyle,andScalise(2001). Table 2 describes the transition matrix from one CAMELS rating category to another for the banks in our sample in percentage terms and by count, respectively. For example, 85 percent of the banks that enter an exam with an existing CAMELS rating of 1 or 2, exit the exam with the rating unchanged. For banks rated a three, four, or five, they are also more likely than not to retain the same rating in the next exam. In addition, about 17 percent of banks maintained their CAMELS rating throughout the whole sample, while 21 14 percent of banks had just one switch. We also include indicator variables for the quarter in which the exam was performed. Banks tend to be examined more frequently in quarters 1 and 3 (mostly using financial statements from December and June, respectively), than in quarters 2 and 4 of each year. In addition, we include several dummies and weighted indexes to allow for bank assessments based on the broader economic environment. First, following the lead of existing literature, we include dummies for each of the census divisions in which a particular bank is headquartered. This is to control for the differences in economic performancein the various regions of the United States. Nonetheless, because these variables are identified by the location of the headquarters, they do not capture the full exposure to local conditions that banks face throughout their branch networks. Therefore, we also include bank-level series for the unemployment rate and annual growth in house prices. Those are constructed by weighting state-level economic data by the share of total deposits held in branches of the bank operating in that state. Finally, we use a set of financial and macro indicators to control for national economic conditions, which have been underutilized in the literature to date. The variables included are the BBB spread over the 10-year Treasury rate, the four-quarter growth rate of the CoreLogic house price index, the four-quarter growth rate of GDP, the effective federal funds rate, the national unemployment rate, and the four-quarter total retun on the S&P 500. 14Furthermore, more than half of the banks switched back and forth between only two ratings over the sample period. 12

4 Methodology 4.1 Panel Analysis We first consider econometric specifications based on the analysis of time fixed effects used 15 in most of the previous studies of this and related topics. Because the ratings are ordered discrete responses and due to the likelihood of significant unobserved heterogeneity across banks, the preferred approach would be to use limited dependent variable models that are consistent for estimating bank-specific fixed effects in panel data. However, the existing literature mainly uses pooled cross-sections rather than bank-level fixed- or random-effects, presumably in part because the time series dimensions of the panels were insufficient to thoroughly mitigate the well-known biases owing to the estimation of dynamic panels or nonlinear models with incidental parameters. Although some methodshave been developed to address those issues, they have only been proven to be consistent estimators for balanced panels. Unfortunately, supervisory exams are infrequent and irregularly timed, making it difficult ot construct a representative balanced panel. Therefore, we take the approach of comparingseveral imperfectmodels, andfindthatthey reach similar conclusions in theface of their shortcomings and competing biases. Specifically, we start by ignoring the categorical nature of CAMELS ratings and use the linear bank-fixed effects model. Although the standard errors may beinefficient, this model provides consistent estimates even on our unbalanced panel (whereas the nonlinear fixed effects model is biased, particularly for small T) and is preferred to a random effects model if, as is likely, the bank specific factors are correlated with the other regressors. Therefore,webeginwiththissimplealternativetothepooledcross-sectionprobitmodels used in previous studies as our benchmark, Y = πP +ρF +δS +ωL +λE +a +ξ , (1) i,t i,t i,t i,t i,t t i i,t where Y is a quantitative variable that is descriptive of the conditions of bank i in quarter i,t t obtained by a linear transformation - in order to provide a more intuitive relationship between the sign of the coefficients and bank conditions, we designate Y to be equal to i,t 6 minus the CAMELS rating for bank i in period t so that higher values are associated with better conditions for the bank; P is a vector that contains indicators of a bank’s i,t previous supervisory assessment, which includes indicators for having a previous rating of a 1, 2, 3, 4, 5, or no rating at all; F is a vector that contains the time-varying variables i,t from bank-specific balance sheet and income items; S is a vector that contains variables i,t that relate to bank structural characteristics which may, but usually do not, change over 15Afonso, Gomes, andRother(2011) also used similar methodstostudythecyclicality anddeterminants of sovereign debt ratings from rating agencies. 13

time; L is a vector that contains variables that describe the local and regional economic i,t conditionsofaparticularbank; E isavector oftimefixedeffects orvariablesthatdescribe i,t the national economic environment, but not both; and a denotes the bank-specific effects i for bank i; and ξ are disturbances that are independent across banks and across time. i,t However, CAMELS ratings change very infrequently, and the bank-fixed effects fully capture the bank’s average rating. Therefore, the explanatory variables compete to explain only the limited movements in the ratings across time. In order to test whether this feature of the data drives the results of the fixed-effects model, we also consider a second specification based on Mundlak (1978), which modifies a random-effects framework to account for likely correlation between the random effect and the control variables by employing an additional functional form assumption. If valid, that assumption removes the correlation betweenthebank-specificeffects, a inequation1andbanks’financialratios. Thisisaccomi plished by assuming that the correlation can be modeled as a function of both the average values of the bank specific variables and the deviations from those averages. In effect, we explicitly model the expected value of the bank-specific disturbance term as a linear combination of time-averages of the time-varying financial ratios derived from a bank’s balance sheet and income items, F , or i E[a |P ,F ,S ,L ,E ,ξ ]= ψF . i i,t i,t i,t i,t t it i Then plugging in a = νF +b , where b is not correlated with F , we get i i i i i Y = πP +ρ(F −F )+(ψ+ρ)F +δS +ωL +λE +b +ξ , (2) it i,t i,t i i i,t i,t t i i,t where b is a disturbance term not correlated with the explanatory variables. One added i benefitof thisframework is thatthecoefficients on thedeviations fromtheaverage financial ratios can be interpreted as short-run effects on a bank’s rating and condition, while the coefficients on the average values can be considered the long-run effects of that ratio as in Afonso, Gomes, and Rother (2011). However, both the linear fixed-effects and linear random-effects model assume that the numerical CAMELS ratings have cardinal (as opposed to ordinal) meaning. Therefore, the third specification tested is a modified random-effects ordered probit model, which is a more natural approach for modeling categorical variables such as CAMELS ratings. Here, ∗ we interpret the unobserved latent variable in the probit specification, Y , as a continuous i,t measure of a bank’s underlying condition. The framework is a nonlinear generalization of the Mundlak (1978) specification, and it is described in Wooldridge (2010). ∗ Y = πP +ρ(F −F )+(ψ+ρ)X +δS +ωL +λE +b +ξ . (3) i,t i,t i,t i i i,t i,t t i i,t 14

and ∗  1 if Y i,t > c1 ∗    2 if c1 ≥ Y i,t > c2 CAMELS i,t =     3 if c2 ≥ Y i ∗ ,t > c3 (4) ∗  4 if c3 ≥ Y i,t > c4      5 if c4 ≥ Y i ∗ ,t  The parameters of equation 3 and 4, and the cut-off points c1 to c4 are estimated using maximum likelihood, assuming that b and ξ are normally distributed. i i,t Although a nonlinear fixed effects regression also might be considered, given the large cross-sectional sample and a comparatively limited time series, that model would likely be hampered by the well known “incidental parameters problem.” The estimation procedure outlined above overcomes this limitation (if one accepts the assumption required to model the correlation between the random effects and independent variables) and, as noted, correctly models the ordinal nature of the ratings. However, to our knowledge, these estimates have not been proven to be consistent when applied to unbalanced panel datasets (as our data is basedon exams beingconductedat differentintervals for differentbanks). Agreater challenge arises when we consider accounting for the persistent and dynamic nature of the designation of CAMELS ratings by including lagged CAMELS ratings in the specification despite the relatively short panel available for many banks in the sample. Wooldridge (2005)’s framework to deal with such unobserved heterogeneity from serial correlation in nonlinear panel models has only been shown to produce consistent estimates in balanced panel data, or at the very least, an unbalanced panel dataset that uses specified sample selection mechanisms, which we do not have, to create an adequate balanced subset that spans the entire sample period. Separately, in our robustness checks we incorporate a first-stage probit model for the probability of being examined within a given quarter within a selection equation system to account for sample selection that may arise in the timing and frequency of exams. The identification assumption is that, controlling for the general risk profile of a bank and it’s previous rating (whether it was a strong or weak bank), the number of quarters since the 16 last exam should only affect whether a bank is examined or not, not its rating. Within that framework, standard statistical tests also indicate that the number of quarters since the previous exam is a valid instrument. 16As such, the rest of the full set of variables were included in this estimation as well with the exception of the macro variables. 15

4.2 Repeated Cross-Section Analysis In our fourth approach, we estimate a series of ordered probit models using repeated cross 17 sections. This approach generates time-varying coefficients and thresholds that, under certainassumptions,implythattheevolutionofthecoefficientsontheexplanatoryvariables and the changes in the estimated thresholds for each rating category partly reflect changes in supervisory standards. Of course, this approach is not optimal either, as it has the disadvantage of discarding the information that can be gleaned from the panel structure of the data. ∗ Specifically, for each time period, t, we assume a latent variable, Y , that proxies for i,t 18 the condition of bank i at time t : ∗ Y = X β +ǫ , (5) i,t i,t t i,t where X , is a vector of of bank-specific variables, β is a vector of corresponding coeffii,t t cients, andǫ isanormallydistributedrandomvariable. Wecanthentracktheevolutionof i,t the cutoffs in an ordered probit framework by assuming that CAMELS rating CAMELS i,t ∗ is designated based on the relationship between Y and cutoff, c , where the cutoff point i,t t,j ∗ is defined as the threshold value of Y needed to achieve a CAMELS rating of j, a value i,t that varies through time t. More specifically, ∗  1 if Y i,t > c t,1 ∗    2 if c t,1 ≥ Y i,t > c t,2 CAMELS i,t =     3 if c t,2 ≥ Y i ∗ ,t > c t,3 (6) ∗  4 if c t,3 ≥ Y i,t > c t,4      5 if c t,4 ≥ Y i ∗ ,t  Thus, we are able to estimate the supervisory assessment of aggregate bank conditions, ∗ Y , at time t, by taking the average of the X βˆ across all banks i in a given sample, where t i,t t βˆ is the estimated β . Then, due to the properties of the probit framework, the average t t CAMELS rating, CAMELS , can also be expressed by the following equation, t 17This can be thought of as a generalization of theBizer (1993) approach. 18We transform the dependent variable to associate higher thresholds, or cutoffs, with lower (i.e. better) CAMELSratingsinourrepeatedcrosssectionspecification,justaswehaddoneinthebank-randomeffects ordered probit specification for paneldata. 16

Nt Nt 5 1 1 CAMELS = E[CAMELS ] = J ×P(CAMELS = J|X ) (7) t i,t i,t i,t N X N XX t i=1 t i=1J=1 Nt 4 1 = [1+ {Φ(c −X βˆ)}]. (8) t,J it t N X X t i=1 J=1 4.2.1 Decomposing changes in aggregate bank conditions ∗ Our measures of aggregate bank conditions at any point in time, Y , can be decomposed t into the “composition” component and “risk” component based on the Blinder-Oaxaca decomposition method (Blinder (1973) and Oaxaca (1973)). Algebraically, ∗ ∗ 1 1 Y t −Y t−1 = 2 (βˆ t +βˆ t−1)(X t −X t−1)+ 2 (βˆ t −βˆ t−1)(X t +X t−1). (9) The first term on the right hand side is the compositional component at time t and the ∗ second term is the risk component. Theportion of the change in Y assigned to the compot sition component reflects improvement or deterioration in bank profitability, bank balance sheets, or regional economic conditions holding supervisory assessments of the importance ∗ of those factors constant. Meanwhile, the portion of the change in Y assigned to the risk t component reflects changes in the coefficients over time, holding constant the condition of the banks and the factors affecting them. We define this as the risk component because changes in the coefficients can be interpreted as reflecting changes in the supervisory assessment of the risks inherent in each of the bank-specific factors and regional or state-level economic indicators. Theestimated portion of the change in Y assigned to each component across adjacent time periods is then chained to construct a time series of the compositional effects and risk assessments for the whole sample. Because lowvalues ofthelatent variableareassociated withpoorbankconditions, lower values of risk assessment index indicate that supervisors see larger risks facing the banking industry, ceteris paribus. Algebraically, this can be illustrated as follows, with R denoting t the aggregate change in risk tolerance: t ∗ 1 R t = Y 0 + (βˆ k −βˆ k−1)(X k +X k−1). (10) X2 k=1 However, that measure of the supervisory risk assessment includes not only changes in the “true” risks associated with a particular factor, such as might be expected from a reassessment of the riskiness of residential mortgage lending in light of the large, sustained nationwide declines in home prices over the past five years, but also with any changes in supervisory attitudes toward various factors that are not strictly based on economic funda- 17

mentals. Weassumethattheportionoftheaggregate riskcomponentthatcanbeexplained bychangesineconomy-widevariablesrepresentsanendogenouschangeintheaggregate risk tolerance of supervisors, while the portion that is not captured by those variables is more closely associated with an exogenous change in the tolerance for risk of supervisors. The exogenous changes are most closely related to what we consider “supervisory stringency.” Therefore, in order to better identify the portion of the risk component that is attributable to supervisory stringency, we regress the time series of that component, R , on t 19 the vector of time series for economy-wide variables, E . More formally, t B = E γrisk +η (11) t t t where γrisk is the vector of coefficients corresponding to the economy-wide variables and η is the residual. Holding composition constant, higher values of the R ’s (explained by t t macrofundamentals)implybetteroverallbankingconditionsandthuslessriskinthesector. Therefore, a higher value of R , in the aggregate, means that examiners are showing greater t toleranceforrisk. Asaresult,anegative residual,ηˆ,intheequationforR meanseconomic t t factors suggest supervisors should be less strict than they are and represents supervisory stringency in terms of “perceived” risk. 4.2.2 Decomposing changes in rating thresholds Under the strong assumption that all changes in the true riskiness of the banking sector are captured by changes in the β ’s or changes in the explanatory variables, then absent t changes in supervisory standards, the thresholds, or c ’s, should be constant. Therefore, t,j any changes in thec ’s could beinterpreted as changes insupervisorystandards. However, t,j asshownabove, itislikely thatchanges intheoverall riskinessoftheeconomy (forinstance, ifthefinancialcrisisledtoareassessmentofthelikelihoodoflargeshocks)wouldbereflected in both the c ’s and the β ’s. Therefore, we also attempt to parse the thresholds into a t,j t componentrelatedtothe“true”changeinriskinessandchangesinhowsupervisorsperceive those risks. Hence, we separately regress the thresholds for each rating category on the economy-wide variables according to the following equation: c =E γthres+ν . (12) t,j t t,j 19RecallthateachcrosssectioncontainsthemostrecentCAMELSratingforeachbankovertheprevious two years. Thus, the number of banks in each quarter within the two year sample varies significantly. Therefore, to construct a single value for each of the economy-wide variables for the two year period, the values of the financial and macroeconomic indicators in each quarterare weighted by the share of banks in thetwo-year sample that were examined in that particular quarter. 18

Then the estimated residual from those regressions, νˆ is a better estimate of the supervit,j sory stringency present in the application of the threshold values for each rating j than the just the raw changes in the estimates of the cut-off points themselves. InordertocalculateadjustedCAMELSratingsforindividualbanks,weusetheresiduals from equations 11 and 12. The residuals from equation 11, η , representing the changes in t aggregate perceived risk, are applied uniformly across all banks within the given two-year subsample. Then, the adjusted bank conditions for individual banks are: ∗ adjY = X β −η +ǫ . (13) i,t i,t t t i,t ∗ The adjusted CAMELS ratings, adjCAMELS , are then based on both adjY and the i,t i,t adjusted cutoffs for the different thresholds, i.e., the components of the cutoff values that are explained by macro fundamentals. These are represented by the predicted value from equation 12. ∗ In other words, the adjusted latent variables, adjY , and adjusted thresholds, c −ν i,t t,j t,j map to adjusted CAMELS, adjCAMELS : i,t ∗  1 if adjY i,t > c t,1−ν t,1 ∗    2 if c t,1−ν t,1 ≥ adjY i,t > c t,2−ν t,1 adjCAMELS i,t =     3 if c t,2−ν t,2 ≥ adjY i ∗ ,t > c t,3−ν t,3 (14) ∗  4 if c t,3−ν t,3 ≥ adjY i,t > c t,4−ν t,4      5 if c t,4−ν t,4 ≥ adjY i ∗ ,t  Then the adjusted average CAMELS rating for the banking system as a whole, denoted adjCAMELS , can be written as follows: t Nt 4 1 adjCAMELS = [1+ {Φ(c −νˆ −βˆX +µˆ )}], (15) t N X X t,J t,J t it t t i=1 J=1 In the last step, we compute the difference between the actual CAMELS rating (which reflects supervisory stringency in perceived risk and the thresholds) and the counterfactual (which does not), or CAMELS −adjCAMELS . (16) t t 19

We interpret this difference as a measure that reflects overall supervisory stringency. In our opinion, this difference is a more accurate depiction of supervisory stringency than what 20 can be found with the period fixed effects traditionally used in the literature. Not only do we gain flexibilty of the time-vaying parameters, this method also appears to reduce the selection bias in the resulting sample. As can be seen in the fourth exhibit, the grouped data for the repeated cross-section analysis is a better representation of the universe of banks (not in the top 25 BHCs) than the samples in the panel datasets; this is true whether you look at profitability measures, such as ROA, or balance sheet measures, such as the 21 regulatory leverage ratio. 20Of course, as with any residual, the unexplained component in those equations could be attributed to any omitted variable or exogenous shock. 21The mean aggregate leverage ratio are higher than the average for the grouped data due to the fact that banks with high leverage ratios tend to be examined at very low frequencies, sometimes in excess of two-year intervalsaccording to thefinancial as of date. 20

Exhibit 4: Representativeness of Sample Return on assets (ROA) 5.0 Quarterly 4.5 4.0 3.5 3.0 2.5 Grouped average Banking universe Panel data 2.0 1.5 1.0 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Leverage ratio 11.0 Quarterly 10.5 10.0 9.5 Grouped average Banking universe Panel data 9.0 8.5 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Source. Call Reports. 21

5 Empirical Results 5.1 Panel Regression Results Selected results for the panel regressions are shown in Table 3. It compares three models: the linear model with bank fixed effects, the linear model with bank random effects, and the ordered probit model with bank random effects. These specifications include economywide variables in lieu of time-fixed effects. Positive coefficients are associated with a better assessment of banks (i.e. lower CAMELS ratings). Below we discuss the interpretation of the residuals. 5.1.1 Discussion of Control Variables Across thethree models, the same variables are typically statistically significant, suggesting that the overall results may in fact be robust to the various potential specification errors discussedabove. Moreover, whereexperienceconfersapriorexpectationaboutthedirection of the effect of a bank-specific variable, the coefficients have the anticipated sign. Banks with stronger capital ratios, fewer nonperforming assets, greater shares of stable funding, and higher earnings than their peers tend to be rated better by supervisors. Most of the broader economic variables also enter each of the specifications significantly with the expected sign. For example, increases in both the bank-specific regional home price index and the national home price index are associated with better CAMELS ratings, as is stronger GDP growth. A high unemployment rate at the national level is associated with worse CAMELS ratings, and the magnitude of the coefficient on the national unemployment rate dominates the estimated effect at the regional level. Indeed, the coefficients on the bank-specific unemployment rate are economically small and at times also statistically insignificant. In addition, supervisory ratings are negatively related to the spread on BBB-rated corporate bonds, suggesting that high risk aversion in financial markets is internalized by examiners. Finally the growth in returns on the S&P 500 are also associated with better CAMELS ratings, but for the random-effects models, these effects are statistically insignificant. The response of ratings to interest rates is also of note. High federal funds target rates are associated with lower CAMELS ratings, ceteris paribus, suggesting that examiners are somewhat forward looking in their ratings assignments. Increases (decreases) in the funds rate are likely to cool (strengthen) an economy that is growing quickly (weakly), and that slowdown in activity could be expected to negatively affect loan performance and hence the condition of the bank. In addition, if the federal funds rate is considered a proxy for the level of short-term interest rates in general, supervisors may also be attuned to higher funding costs faced by banks which may lead to reduced expectations of future profits as 22

noted in English, Van den Heuvel, and Zakrajˇsek (2011). A steeper slopein theyield curve, despite studies such as Stock and Watson (1989) that have shown it to be a predictor of economic expansion, is associated with a worse CAMELS rating. However, English, Van den Heuvel, and Zakrajˇsek (2011) have also noted that while the slope of the yield curve maybeassociated withhigherinterestmarginsatbanks,total profitabilitydependsonboth the margin and volume, which may decline when margins are high. In addition, conditional on short-term interest rates, higher long-term interest rates may result in capital losses on long-term assets that banks typically hold. In order to compare the relative magnitudes of the marginal effects across the three specifications, we report the change in the average CAMELS rating implied by a one standard deviation move in the listed variables. For marginal effects from the modified random effects model reported in Panel B, we look at the impact of changes in particular variables on the CAMELS rating of a bank with the median characteristics of a bank rated a three. Because lower values of CAMELS ratings are better ratings, negative impacts on CAMELS ratings implies positive impacts on supervisory assessment of banks. As shown in Panel A and the last column of Panel B of Table 4, in general, return on assets has the largest marginal effect on CAMELS ratings, followed by the noncurrent assets ratio and the ratio of CRE loans to total assets. Some economy-wide variables, such as the national unemployment rate and the Fed Funds target rate, also are among the more economically important factors in determining CAMELS ratings. Based on linear econometric specifications, a one standard deviation decrease in the national unemployment rate leads to about 5 percent of banks being rated one notch better, on average, than otherwise. A one standard deviation decrease in the federal funds rate leads to 3 to 5 percent of banks being rated one notch better, on average. The marginal effect of that change in the aggregate unemployment rate in the randomeffects ordered probit specification, setting all other explanatory values at their median levels, leads to a slightly larger effect on the average CAMELS rating, of about 8 percent. That effect is accounted for by an increase in the probabilities of the bank being rated a three or a four and a lower probability of it being rated a four, as described in Panel B of Table 4 23

Table 3: Determinates of Supervisory Assessments Specification Explanatory Variable (I) (II) (III) Level Dev. Avg. Dev. Avg. LEVit .0217 ∗∗∗ .0165 ∗∗∗ .0134 ∗∗∗ .0474 ∗∗∗ .0380 ∗∗∗ (.0016) (.0018) (.0019) (.0075) (.0082) TCRit .0013 ∗ .0033 ∗∗∗ .0000 .0320 ∗∗∗ .0154 ∗∗∗ (.0007) (.0009) (.0008) (.0038) (.0038) NIEit .0002 ∗∗∗ .0004 ∗∗∗ .0001 .0006 ∗∗∗ .0000 (.0000) (.0001) (.0001) (.0002) (.0003) NONit −.0444 ∗∗∗ −.0325 ∗∗∗ −.0601 ∗∗∗ −.1035 ∗∗∗ −.2159 ∗∗∗ (.0012) (.0014) (.0018) (.0052) (.0069) D2Rit −.0001 ∗∗∗ −.0002 ∗∗∗ .0001 ∗∗ −.0010 ∗∗∗ .0000 (.0000) (.0000) (.0000) (.0001) (.0001) ROAit .0556 ∗∗∗ .0522 ∗∗∗ .0573 ∗∗∗ .1535 ∗∗∗ .2026 ∗∗∗ (.0009) (.0009) (.0018) (.0036) (.0074) NIMit .0052 ∗∗∗ .0059 ∗∗∗ −.0006 .0305 ∗∗∗ .0005 (.0008) (.0009) (.0009) (.0035) (.0022) COREit .0017 ∗∗∗ .0015 ∗∗ .0005 .0065 ∗∗∗ −.0006 (.0005) (.0005) (.0006) (.0022) (.0026) VOLit −.0017 ∗∗∗ −.0018 ∗∗∗ −.0024 ∗∗∗ −.0068 ∗∗∗ −.0121 ∗∗∗ (.0004) (.0004) (.0006) (.0017) (.0023) RISKit −.0044 ∗∗∗ −.0031 ∗∗ −.0023 ∗ −.0111 ∗ −.0034 (.0010) (.0015) (.0014) (.0059) (.0055) SECit .0005 .0004 −.0022 ∗∗∗ .0058 ∗∗∗ −.0057 ∗∗∗ (.0004) (.0004) (.0005) (.0018) (.0019) CREit −.0074 ∗∗∗ −.0060 ∗∗∗ −.0064 ∗∗∗ −.0185 ∗∗∗ −.0201 ∗∗∗ (.0003) (.0003) (.0003) (.0014) (.0014) REit −.0023 ∗∗∗ −.0017 ∗∗∗ −.0031 ∗∗∗ −.0033 ∗∗ −.0095 ∗∗∗ (.0003) (.0003) (.0003) (.0013) (.0011) OTHit −.0065 ∗∗∗ −.0065 ∗∗∗ −.0041 ∗∗∗ −.0212 ∗∗∗ −.0134 ∗∗∗ (.0003) (.0004) (.0003) (.0014) (.0014) TAit −.0215 ∗∗∗ −.0320 ∗∗∗ .0310 ∗∗∗ −.1030 ∗∗∗ .1272 ∗∗∗ (.0044) (.0051) (.0021) (.0205) (.0084) UNEit −.0034 ∗ .0010 .0075 (.0019) (.0016) (.0063) SHOit .0010 ∗∗∗ .0015 ∗∗∗ .0038 ∗∗ (.0004) (.0004) (.0016) BBBt −.0204 ∗∗∗ −.0241 ∗∗∗ −.0778 ∗∗∗ (.0022) (.0022) (.0093) FFERt −.0241 ∗∗∗ −.0159 ∗∗∗ −.0665 ∗∗∗ (.0017) (.0017) (.0067) TERMt −.0174 ∗∗∗ −.0063 ∗∗∗ −.0436 ∗∗∗ (.0022) (.0022) (.0088) HOUSEt .0015 ∗∗∗ .0010 ∗∗∗ .0053 ∗∗∗ (.0003) (.0003) (.0012) GDPt .0022 ∗∗ .0022 ∗∗ .0097 ∗∗ (.0009) (.0009) (.0038) AGUNEt −.0287 ∗∗∗ −.0284 ∗∗∗ −.1036 ∗∗∗ (.0021) (.0021) (.0082) SP500t .0099 .0103 ∗ .0407 (.0062) (.0062) (.0255) Note: A positive coefficient is an indication that a higher value of the associated variable isassociated with a favorable supervisory assessment. The sample period is 1991:Q3–2010:Q4. Explanatory variables: LEV = leverage ratio; TCR = total capital ratio; NON = noncurrentloanratio;D2R=delinquentloanstoreservesratio;ROA=return-on-assets;NIM=netinterestmargin;VOL=volatileliability ratio;RISK=returnonriskyassets; andSEC=securityholdingsratioCRE=ratioofcommercialrealestateloanstototalassets; RE= ratio of loans secured byreal estate (other than CRE) to total assets; OTH = ratio of other loans to total assets; CORE = ratio of core deposits to total assets; TA = log of total assets; P1 = indicator if previous CAMELS = 1; P2 = indicator if previous CAMELS = 2; P3= indicator ifpreviousCAMELS = 3; P4= indicator ifpreviousCAMELS = 4; for a state-agency lead exam; BHC =indicator for BHCmembership;UNE=bank-levelunemploymentrate;SHO=annualgrowthinbank-levelhousepriceindex;BBB=BBBspreadover 10-yearT-Bill;HOUSE=annualgrowthinthenationalhousepriceindex;GDP=annualGDPgrowth;FFER=FedFundseffectiverate; TERM=termpremium;AGUNE=growthinthenationalunem2pl4oymentrate;NIE=non-interestexpenseratio;MGR=mergerindicator; CHTR=charterchangeindicator;SP500=annualgrowthintheS&P500. Allregressionsincludeaconstant,indicatorsforCensusDivision, andindicatorsforthequartertheexamtookplaceinthatarenotreported. Heteroskesdasticy-consistent asymptoticstandarderrorsarein ∗ ∗∗ ∗∗∗ parenthesis. denotessignificanceatthe10%level, denotessignificanceatthe5%level,and denotessignificanceatthe1%level. Dev. isdifferencebetweenthethecurrentvalueandtheaverage. Avg. istheaverageoverthebank’stimeinthesample. Indicator,macroeconomic, andlocaleconomyvariablesarenotaveraged,butsimplytheirvalueattimet.

Table 4: Impact on Expected CAMELS Rating for Selected Variables Panel A: Linear Specification Explanatory Variable Fixed Effects Random Effects Avg. Dev. Return on assets -0.14 -0.11 -0.09 Leverage ratio -0.06 -0.03 -0.02 Noncurrent ratio 0.09 0.05 0.09 CRE loans ratio 0.09 0.07 0.03 RRE loans ratio 0.02 0.03 0.01 Non-real-estate loans ratio 0.07 0.04 0.03 Term premium 0.02 0.01 – Fed Funds effective rate 0.05 0.03 – Aggregate unemployment rate 0.05 0.04 – R-squared 0.752 0.730 – Number of banks 9,038 9,120 – Number of observations 123,344 116,921 – Panel B: Modified Random Effects Ordered Probit Explanatory Variables CAMELS = 2 = 3 = 4 E[CAMELS] Return on assets (avg.) 0.122 -0.090 -0.033 -0.156 Return on assets (dev.) 0.126 -0.093 -0.034 -0.160 Leverage ratio (avg.) 0.022 -0.016 -0.006 -0.028 Leverage ratio (dev.) 0.019 -0.014 -0.005 -0.024 Noncurrent ratio (avg.) -0.120 0.088 0.032 0.153 Noncurrent ratio (dev.) -0.065 0.048 0.017 0.083 CRE loans ratio (avg.) -0.074 0.054 0.020 0.094 CRE loans ratio (dev.) -0.040 0.029 0.011 0.051 RRE loans ratio (avg.) -0.029 0.021 0.008 0.037 RRE loans ratio (dev.) -0.034 0.025 0.009 0.043 Non-real-estate loans ratio (avg.) -0.045 0.033 0.012 0.058 Non-real-estate loans ratio (dev.) -0.040 0.029 0.011 0.051 Volatile liability ratio (avg.) -0.005 0.004 0.001 0.006 Volatile liability ratio (dev.) -0.015 0.011 0.004 0.019 Log of total assets (avg.) 0.042 -0.031 -0.011 -0.054 Aggregate unemployment rate -0.061 0.045 0.016 0.077 Fed Funds effective rate -0.049 0.036 0.013 0.062 Term premium -0.019 0.014 0.005 0.025 Note: Impactisfromonestandarddeviationincreaseinselectedvariablesinmodelswitheconomy-widevariables(ratherthantimefixedeffects) on abankwithapreviousCAMELSratingof3withthemediancharacteristicsofallbankswithCAMELSratingsof 3. Because lower values of CAMELS ratings are better ratings, negative impacts on CAMELS ratings implies positive impacts on supervisoryassessment ofbanks. Alllistedvariablesaresignificantatthe1%level. Avg. istheaverage over thebank’stimeinthe sampleforbank-specificvariablesorthelevelforeconomy-wideva2ri5able. Dev. isdifferencebetweenthethevalueinthecurrentperiod andtheaverage. TheimpactonP(CAMELS=1)andP(CAMELS=5)isnegligible.

Table 5: Summary of prediction errors Estimation Obs. Prediction error (notches) % Correctly % Within procedure -2 -1 0 1 2 3 predicted 1 notch Time-fixed effects 116,921 41 8,494 96,850 11,090 421 25 82.83 99.58 Macro variables 116,921 44 8,651 97,053 10,787 362 24 83.01 99.63 Baseline 116,921 48 8,625 96,974 10,872 379 23 82.94 99.62 Note: Negative numbers represent the prediction of a better CAMELS rating than assigned. GoodnessoffitmeasuresareshowninTable5. TheR-squaredsforthebank-fixedeffects and random effects linear models in the specifications with macro variables are 0.74 and 0.73, respectively. When we look at the ordered-probit models, regardless of whether we use macro variables or not, about 83 percent of actual CAMELS ratings match the rating that the model predicts is most likely. With only a few exceptions, the rest of the ratings are predicted to be different by only one notch. The strong fit of the models presages the conclusions aboutchanges insupervisorystringency over time, as CAMELSseem tobewell explained by observable characteristics of the bank and the macroeconomic environment. 5.1.2 Relative Supervisory Stringency Implied by Panel Data Models We now turn to an analysis of the residuals from the three panel data models, i.e., the difference between the actual and the model-implied aggregate CAMELS ratings. These residuals are what we will define as the aggregate degree of “supervisory stringency,” and areshownbytheblack linesinthethreepanelsofexhibit5. Inpractice, thevertical scale of those panels can be interpreted as the percentage of banks that would have been upgraded one notch–when the line is in the positive region–or downgraded one notch–when the line is in the negative region–during a given period had supervisory standards been at the average 22 level that prevailed over the sample period. Importantly, therefore, we are measuring the degree of stringency relative to the average, not the absolute level of stringency over time. 22However, in theory, the scale is not restricted to the range between -100 percent and 100 percent, as more bankscould havebeen rated differently than what the model implies bytwo (or more) notches. 26

Exhibit 5: Measures of Supervisory Stringency Linear bank-fixed-effects specification Percent 25 Quarterly Time-fixed effects No time-fixed effects, residual 20 With economy-wide variables, residual 15 10 5 0 -5 -10 1991 1993 1995 1997 1999 2001 2003 2005 2007 2009 2011 Linear bank-random-effects specification Percent 25 Quarterly Time-fixed effects No time-fixed effects, residual 20 With economy-wide variables, residual 15 10 5 0 -5 -10 1991 1993 1995 1997 1999 2001 2003 2005 2007 2009 2011 Ordered probit bank-random-effects specification Percent 25 Quarterly Time-fixed effects No time-fixed effects, residual 20 With economy-wide variables, residual 15 10 5 0 -5 -10 1991 1993 1995 1997 1999 2001 2003 2005 2007 2009 2011 Note. Supervisory stringency is an index that can be interpreted as the percent of banks, on average, that deserve to be upgraded to the next rating according to each model’s benchmark standards. 27

The results are striking in two important aspects: 1) supervisory standards exhibit, in absolute terms, little variation across time, and 2) the three models suggest both quantitatively and quantitatively similar results. In the beginning of the sample, which was the second half of 1991, each of the three models with economy-wide variables indicated that about 5 percent of banks, on average, would have been rated one notch better under the average supervisory standards, whereas the mid-1990s was a period of relatively less stringent supervision. This measure of supervisory stringency peaked early in the 2007-2009 recession and then dropped off as the crisis came to a head in late 2008 and early 2009. Indeed, for most of the period from the first quarter of 2009 to the second quarter of 2011, panel data models that account for the macroeconomic environment show little deviation in CAMELS ratings from the model predictions. In addition, although 2008 can be seen as a period where supervisors were relatively stringent conditional on bank-specific, regional, and national economic factors, only about 5 percent of the banks, on average, can be interpreted as being rated worse compared to the benchmark period than what the model predicts, roughly the same fraction as in the less severe downturn of the early 1990s. Next, we re-estimated the panel data models without the macroeconomic control variables (and with no time fixed effects). As shown by the red lines in the exhibit, the failure to account for those macroeconomic factors materially alters the conclusions. The fraction of banks that appear to warrant a rating upgrade increases about two-fold in the early 1990s. Likewise, without the macroeconomic controls, we would have concluded that there had been no leveling off of supervisory stringency until most recently. However, note that even this specification suggests that the degree of stringency in the 2007 to 2009 recession was similar to the degree seen as the country exited the 1990s recession. To compare our results with the previous literature, we next run the panel regression modelswiththesamebank-specificandstructuralvariablesasintheprevioustwoexercises, 23 but with time fixed effects. For each model with the time-fixed effects, we index the level ofsupervisorystringencytotheaverageofthefixedeffectsoverwholesampleperiodinorder to place it on the same scale as the residuals. Once again, whether we used a fixed-effects linear model, a random-effects linear model with an identifying assumption to mitigate the problem of correlation between the random effect and the regressors, or the analogous modified random-effects ordered-probit model, the estimates of the time fixed effects are very similar to each other–mainly, supervisory standards were strict in the early 1990s and became strict again in the beginning of 2008. However, the magnitude of the fixed effects 23In the linear models, the changes in time fixed effects represent a parallel shift in the ratings by the amount of the estimated coefficient. In the panel ordered probit model with random effects, the changes in the time fixed effects need to be translated through the cumulative normal distribution into a shift in the probability that each of the CAMELS ratings was assigned, and then a probability-weighted average CAMELS rating computed for each bank. 28

estimates in the early 1990s and from 2008 to present are much larger than the estimates of supervisory stringency inferred instead from the residuals in models that include economywide variables. The coefficients on the time fixed effects across the different specifications peak at 15 to 20 percent in the middle of 2009, before retreating some in more recent quarters, though to levels that remain still elevated as compared to supervisory stringency prior to 2008. In addition, across all three specifications with time fixed effects, supervisory stringency, as of the middle of 2011, was still between 5 percent and 10 percent. However, recall that time fixed effects control for all factors that are invariant across banks in a given time period, including both economy-wide conditions and exogenous shifts in supervisory attitudes. Thus, those much larger effects include both the change in the supervisoryassessmentthatis related tothechangeinthemacroeconomic environmentand the exogenous change in supervisory stringency. Therefore, the difference between actual average CAMELS ratings with the average model-implied ratings when time fixed effects are removed and when they are replaced with economy-wide variables, likely represents a 24 cleaner estimate of supervisory stringency. 5.2 Repeated Cross-Section Results The results from the cross-section analysis are qualitatively similar to results of the panel regressions. Exhibit 6 includes various charts that plot the time-varying estimates of the coefficients and standard errors for various capital adequacy, asset quality, and asset composition indicators. Some of the more consistently statistically significant estimates of coefficients include those on the leverage ratio, the noncurrent loan ratio, the ratio of commercial realestate loans tototal assets, andtheratio of non-realestate loans to total assets, results that are broadly consistent with the qualitative results in the panel regressions. 5.2.1 Time-Varying Coefficient Estimates Exhibit 7 includes charts that plot the coefficients for various profitability and liability composition measures, which show the consistent prominence of return on assets in the results and the general significance of the volatile liabilities ratio. The latter becomes more negative and significant during and after the recent financial crisis, a change in emphasis that might be expected given the increased focus on short-term funding implied by the adoption of the Liquidity Coverage Ratio and Net Stable Funding Ratio under Basel III. That coefficient also became fairly deeply negative in the period after the failure of Long- Term Capital Management in 1998 and associated Emerging Market crisis. This pattern 24In addition,a regression of thecoefficients on time-period fixedeffectsfrom those modelson thevector of economy-wide variables used in our other models yields residuals that are similar to the results of our models that control directly for economy-wide variables. 29

underlinestheimportanceofconsideringtimevariationintheweightsthatsupervisorsplace on certain bank conditions rather than assuming that they remain constant. The top panels of exhibit 8 plot the coefficients for two structure variables, which show significant variation across time, with the BHC indicator fluctuating between periods in which it is statistically significant and those that are not. The bottom of exhibit 8 shows the coefficients on local economic indicators. The unemployment rate was generally not significant in the cross section, probably because much of the variation was captured by indicator variables for the census region. However, examiners appear to have been slightly more tuned into the local unemployment rate by the end of 2008. House prices in regions where the bank had branches were generally not significant, though the weight on house prices became significant and positive as the home price bubble burst in 2007 and 2008, as banks in regions not as exposed to the bubble likely outperformed. Exhibit 9 describes the key results from the repeated cross-section analysis. The black ∗ line in the top panel plots the estimated aggregate bank conditions, adjY . The line i,t indicates that the supervisory assessment of bank conditions was fairly constant through the 1990s, before strengthening noticeably between 2000 and 2006. That improvement corresponds to a period in which almost all banks retained CAMELS ratings of 1 or 2 despite a recession and episodes of considerable geopolitical uncertainty. However, overall bank conditions drop precipitiously well before the onset of the crisis, reaching a nadir near 25 the end of the recession and recovering somewhat by the end of 2010. 25Asinthetoppanelinthesecondexhibit,theresultsareplottedbycenteringtheestimatetwoquarters from the end of the subsample. 30

Exhibit 6: Effect of Capital Adequacy, Asset Quality, and Asset Composition Total capital ratio Leverage ratio 0.06 0.20 Quarterly Quarterly 0.04 0.15 0.02 0.10 0.00 0.05 -0.02 0.00 -0.04 -0.05 1992 1995 1998 2001 2004 2007 2010 1992 1995 1998 2001 2004 2007 2010 Noncurrent loan ratio Noncurrent loans to reserves ratio 0.05 0.0010 Quarterly Quarterly 0.00 0.0005 -0.05 0.0000 -0.10 -0.0005 -0.15 -0.20 -0.0010 -0.25 -0.0015 1992 1995 1998 2001 2004 2007 2010 1992 1995 1998 2001 2004 2007 2010 Ratio of private securities to total assets Ratio of commercial real estate loans (excludes Treasury, agency and agency MBS) to total assets 0.02 0.01 Quarterly Quarterly 0.01 0.00 0.00 -0.01 -0.01 -0.02 -0.02 -0.03 -0.03 -0.04 1992 1995 1998 2001 2004 2007 2010 1992 1995 1998 2001 2004 2007 2010 Ratio of residential real estate loans to total assets Ratio of non-real estate loans to total assets 0.010 0.01 Quarterly Quarterly 0.005 0.00 0.000 -0.005 -0.01 -0.010 -0.02 -0.015 -0.03 -0.020 -0.025 -0.04 1992 1995 1998 2001 2004 2007 2010 1992 1995 1998 2001 2004 2007 2010 Note: Solid line represents the time-varying coefficient and the dotted lines represent the 95% confidence interval. 31

Exhibit 7: Effect of Profitability and Liability composition Non-interest expense ratio Return on assets (ROA) 0.003 0.30 Quarterly Quarterly 0.25 0.002 0.20 0.001 0.15 0.000 0.10 -0.001 0.05 -0.002 0.00 -0.003 -0.05 1992 1995 1998 2001 2004 2007 2010 1992 1995 1998 2001 2004 2007 2010 Net interest Margin Risky returns ratio 0.04 0.04 Quarterly Quarterly 0.03 0.02 0.02 0.00 0.01 0.00 -0.02 -0.01 -0.04 -0.02 -0.06 -0.03 -0.04 -0.08 1992 1995 1998 2001 2004 2007 2010 1992 1995 1998 2001 2004 2007 2010 Volatile liabilities ratio Core deposit ratio 0.04 0.04 Quarterly Quarterly 0.03 0.03 0.02 0.02 0.01 0.01 0.00 0.00 -0.01 -0.01 -0.02 -0.02 -0.03 -0.03 -0.04 -0.04 1992 1995 1998 2001 2004 2007 2010 1992 1995 1998 2001 2004 2007 2010 Note: Solid line represents the time-varying coefficient and the dotted lines represent the 95% confidence interval. 32

Exhibit 8: Selected Regulatory and Local Economic Effects BHC indicator Charter change 0.4 1.5 Quarterly Quarterly 0.3 1.0 0.2 0.1 0.5 0.0 0.0 -0.1 -0.2 -0.5 1992 1995 1998 2001 2004 2007 2010 1992 1995 1998 2001 2004 2007 2010 State level unemployment State level house price growth 0.20 0.06 Quarterly Quarterly 0.15 0.04 0.10 0.02 0.05 0.00 0.00 -0.02 -0.05 -0.04 -0.10 -0.15 -0.06 1992 1995 1998 2001 2004 2007 2010 1992 1995 1998 2001 2004 2007 2010 Note: Solid line represents the time-varying coefficient and the dotted lines represent the 95% confidence interval. 33

5.2.2 Decomposition of Changes in Aggregate Bank Conditions Index A breakdown of the aggregate supervisory assessment of bank conditions into the risk tolerance component (adjusted for macroeconomic conditions, denoted η in equation 11) t and the composition component reveals that for most of the period aggregate conditions largely paralleled risk tolerance rather than composition. The composition portion (based on actual changes in bank balance sheets and economic indicators, etc.) started out fairly low in the early 1990s and recovered steadily through the mid 1990s. It then remained roughly at that same level until early 2007, except for a small dip though the recession of 2001. However, withthetroublesinsubprimemortgageindustryemerginginearly2007and the onset of the recession at the end of that year, bank health and economic performance worsened, and the intensification of the financial crisis and deepening recession drove the composition factor into increasingly negative territory in 2009. Moreover, this factor had shown no improvement through the end of 2010. In contrast, adjusted supervisory risk tolerance swung quite widely over the sample period. Risk tolerance was about average in the early 1990s even as overall sentiment and the composition component were low, suggesting that supervisors were not unduly penalizing banks through that channel in the assignment of CAMELS ratings. Risk tolerance rose through the recession of 2001, likely resulting in fewer downgrades than if supervisory attitudes toward risk had remained constant or tightened. Although supervisory risk tolerance reached alocalpeakinthemid-2000s, itis notablethatrisktolerance declined precipitously well before the onset of the crisis and even before the observable factors captured in the compositioncomponentbegantosignaldeterioration. Sincereachingitslowestpointduring the sample period at the height of the financial crisis, the risk index has eased considerably. At the end of 2010, it was near the at its peak. However, because the composition componentof bankconditionsremainsextraordinarily weak, theaggregate supervisoryassessment of the condition of the banking industry in the fourth quarter of 2010 has, according to the model, improved only to levels last seen in the middle of 2006. For reference, the dotted line in the middle panel of exhibit 9 plots the risk component prior to adjustment with economy-wide variables. The contour of the unadjusted series is qualitatively similar to the adjusted series, suggesting that while the adjustments are material they act appropriately to smooth the series rather than drive the results. The dip in risk tolerance at the height of the financial crisis is significantly attenuated by controlling for the macroeconomic factors, as is a smaller decline just before the recession of 2001. The attenuation isexactly consistent withourdecomposition ofchanges inexaminers’risk tolerance into an endogenous portion that is related to the deterioriation in economic conditions and a portion that is exogenous or described as a change in the tastes or preferences of the examiners toward risk. 34

Exhibit 9: Supervisory Stringency Based on Repeated Cross-Section Regressions Aggregate bank conditions adjusted for supervisory stringency 4 Quarterly 3 2 1 0 Aggregate Adjusted risk tolerance component -1 Composition component -2 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Note. Aggregate bank conditions are aggregated predicted latent values (excluding thresholds) of bank conditions with macro indicators and is the sum of the risk tolerance and composition components. The risk component is adjusted with economy-wide variables. Risk tolerance component 4 Quarterly 3 2 1 0 Adjusted risk tolerance component -1 Unadjusted risk tolerance component -2 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Note. The unadjusted risk tolerance component is the risk tolerance component prior to adjustment with economy-wide variables. Threshold estimates for each CAMELS rating adjusted for supervisory stringency 6 Quarterly 3 0 -3 -6 CAMELS=1 CAMELS=2 CAMELS=3 -9 CAMELS=4 -12 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Note. Banks must exceed the threshold to be acheive the particular rating. No banks were rated 5 in 1995:Q4, the threshold for that quarter is interpolated. Dotted lines represent the threshold estimates prior to adjustment with economy-wide variables. 35

Table 6: Regression Results of Aggregate Risk Tolerance and Thresholds Specification Explanatory Variable Risk Component Threshold 1 Threshold 2 Threshold 3 Threshold 4 BBBt −.3964 ∗∗ −.3598 ∗∗ −.1909 −.2081 −.2858 (.1609) (.1681) (.1775) (.1967) (.2263) HOUSEt .0539 ∗∗∗ .0567 ∗∗∗ .0428 ∗∗∗ .0425 ∗∗ −.0119 (.0146) (.0153) (.0161) (.0170) (.0206) GDPt −.0126 −.0191 .0676 0.0510 .2329 ∗ (.0893) (.0933) (.0985) (.1036) (.1256) AGUNEt .3417 ∗∗∗ .3346 ∗∗∗ .3585 ∗ .2642 ∗∗ .1296 (.1014) (.1060) (.1119) (.1177) (.1427) FFERt −.3590 ∗∗∗ −.4095 ∗∗∗ −.4029 ∗∗∗ −.4501 ∗∗∗ −.9582 ∗∗∗ (.0939) (.0982) (.1037) (.1090) (.1322) TERMt −.2884 ∗∗ −.3351 ∗∗ −.3066 ∗∗ −.3204 ∗∗ −.8005 ∗∗∗ (.1224) (.1279) (.1351) (.1421) (.1722) SP500t −1.178 −1.358 −1.762 −1.955 −2.637 (2.078) (2.171) (2.293) (2.412) (2.924) Constant 1.524 ∗∗∗ 3.318 ∗∗∗ −.5920 −1.279 −.0434 (.9493) (1.081) (1.142) (1.201) (1.456) Note: The sample period is 1992:Q4–2010:Q4. Explanatory variables: BBB = BBB spread over 10-year T-Bill; HOUSE = annual growth in the national house price index; GDP = annual GDP growth; FFER = Fed Funds effetive rate; TERM = term premium; AGUNE = growth in the national unemployment rate; SP500 = annual growth in the S&P500. Heteroskesdasticy-consistent asymptotic standard errors are in parenthesis. ∗ ∗∗ ∗∗∗ denotes significance at the 10% level, denotes significance at the 5% level, and denotes significance at the 1% level. 5.2.3 Decomposition of Changes in Threshold Estimates Thebottompanelinexhibit9plotsthetimeseriesoftheestimatesforeachofthethresholds 26 to achieve the next rating. The threshold estimates prior to adjusting for economy-wide variables are plotted in dotted lines. The solid lines are the adjusted threshold values, i.e., the predicted values of c from equation 12, and are the values that would maintain if t,j supervisory stringency in this aspect of ratings remained constant over time. Nonetheless, important distinctions are evident over time in the adjusted thresholds. For instance, the threshold to achieve a rating of a 4 rather than a rating of 5 began to increase slightly earlier in the most recent financial crisis than those for other ratings. Moreover, even as the financial crisis has receded, each of the thresholds has risen further, indicating that a bank must have a better conditions score during the post crisis period to achieve the same CAMELS rating as before the crisis. Table 6 describes how the various economy-wide factors are related to risk tolerance and the various thresholds to achieve a higher CAMELS ratings. First, it is important that 26Again, theresults are plotted bycentering the estimate two quarters from the end of the subsample. 36

aggregate risk tolerance and thresholds are highly positively correlated, so if one financial or macro factor is positively associated with risk tolerance, it is usually the case that it is also positively associated with the level of a given threshold. Therefore, the best way to interpret the effects of a change in a specific macroeconomic variable on stringency is to consider its effect on risk tolerance in combination with its effect on the various thresholds. For instance, the coefficient estimates in this set of regressions suggest that an increase in the BBB spread will reduce the risk component, a result suggesting that examiners are attuned to changes in risk tolerance by market participants. However, somewhat counterintuitively, this change also induces a reduction in the four thresholds for achieving a certain CAMELSrating. But, thechanges inthethresholdsforachieving aCAMELSratingof2, 3, or 4 are smaller in absolute value than the change in risk tolerance, and insignificantly different from zero. Thus, an increase in the BBB spread generally results in worse CAMELS ratings, ceteris paribus. Most other macroeconomic variables also have combined marginal effects that move CAMELS in the expected direction. An increase in the federal funds target rate pushes down risk tolerance, but reduces the estimates of all four threshold values by a greater extent, resulting,onbalance,inbetterCAMELSratingsastheFederalReserveistightening monetary policy. A steep term structure, a predictor of expected improvement in economic performance, is associated with less risk tolerance, but far lower thresholds, i.e., a higher probabilityofbetterCAMELSratings. Theeffectofgrowthinhousepricesonrisktolerance and the thresholds has only a small net effect on CAMELS ratings of 1, 2 and 3, but does make it more likely that bank will avoid being rated a 5. GDP is generally insignificant in theregressions for risktolerance and thethresholds, whiletheunemployment rate generally enters with the wrong absolute and net effects–it is associated with increased risk tolerance that is about equal to or greater than the effect on the thresholds–thus, the model implies that an increase in the unemployment rate generally results in improved CAMELS ratings, all else equal. The growth in returns of the S&P 500 is intuitive, with higher growth rates associated with lower thresholds, but are statistically insigificant in all the regressions. 5.2.4 Combining the Adjusted Conditions Index and Adjusted Thresholds In sum, as changes in thresholds have been positively correlated with changes in the risk component, the combined effect of changes in those two measures on the assignment of CAMELS is ambiguous without further analysis. Therefore, we next construct a combined index of stringency based on movements in both measures. Exhibit 10 shows the difference between the average actual CAMELS rating and the average CAMELS rating based on the adjusted thresholds and adjusted risk component, which is the measure of supervisory stringency. Thedifferenceintheseratingswasabout9percentinthefourthquarterof1992, 37

but fell rapidly in subsequent quarters. The average actual ratings were also somewhat worse than what the adjusted model suggests prior to the 2001 recession, largely driven by a decrease in risk tolerance. Supervisory standards apparently tightened gradually between 2004 and 2008, and peaked in the first half of 2008, near the beginning of the financial crisis, this time largely driven by an increase in overall thresholds. However, that peak value was just slightly higher than the level that was reached around the prior recession, and the highest levels reached in both of those more recent recessionary periods were less than half the peak level seen at the beginning of the sample period. Moreover, the estimate of stringency began declining at the end of 2008, and by the end of 2010 our measure suggests that about 4 percent of banks, on average, could be downgraded one notch. Thus, the analysis provides little evidence that CAMELS ratings are currently, on balance, too stringent given the condition of banks and the state of the economy and financial markets. Exhibit 10: Supervisory Stringency Based on Repeated Cross-Section Regressions Supervisory stringency with macro indicators and time-varying parameters Percent 25 Quarterly 20 15 10 5 0 -5 -10 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Note. Supervisory stringency is an index that can be interpreted as the percent of banks, on average, that deserve to be upgraded to the next rating according to each model’s benchmark standards. 5.3 Robustness Each of our estimates, whether based on panel data with economy-wide control variables or repeated cross sectional regressions subsequently adjusted for macroeconomic conditions, supervisory stringency is high in the beginning of the 1990s and at the beginning of the recent crisis. Moreover, all of those specifications suggest that stringency in the assingment ofCAMELSratingsdissipatedrecently. Themodelsdifferslightlyinthedegreeofstringency apparent in the early 1990s, with the measure for the repeated cross-section somewhat 38

higher than the equivalent measure in the ordered-probit panel regression. Moreover, the repeated-cross-section methodology indicates that supervisory stringency was much worse during the early 1990s than it was at the height of the recent crisis, whereas the panel data models suggest that the degree of stringency was about equal across all three of the extented periods where it was evident. Nonetheless, the broad agreement in the qualitative path of stringency over the past two-plus decades across all four specifications adds to the confidence in the results in the face of the potential for specification errors discussed earlier. We also perform several additional robustness checks on our results. First, instead of using all exam information that resulted in a designation or confirmation of CAMELS ratings,weexcludeanyexaminationsthatwerenotfull-scope. Ourresultsarerobusttothis omission, though the standard errors become larger due to the decrease in the number of observations. We try a specification that includes the changes in balance sheet and income measures of all the explanatory variables in addition to the levels. Again, our results carry through, and many of the coefficients on the additional variables are not significant. As we are concerned that we do not have a good proxy for the quality of management, we also include a dummy for whether the category-specific rating of the bank’s management (i.e., the M in CAMELS) was worse than the composite CAMELS rating in the previous exam. Although the coefficient on this “bad management” variable comes in statistically signficant, it does not alter our results. Our results are also robust to the inclusion of different sets of macroeconomic and financial indicators. In addition, we construct alternative indexes of supervisory stringency by weighting the thestringencyestimatesforeachbankbytheamountofloansonitsbalancesheet. Although the degree of stringency is somewhat more variable, our main results hold qualitatively– in particular, including macro variables explains much of stringency that appeared to be prevalent after 2008. Finally, we also runeach of the panel specifications in a two-stage framework to account for sample selection in the banks examined each period. The first stage regression uses the identification assumption that the date since the last exam and the date since the last exam interacted with an indicator variable of whether the bank was a weak bank should be related only to whether a bank is examined and not necessarily to the current condition of the bank. Thecoefficient on themills ratio in the second stage turnsout to besignificant in onlytherandom-effects linear model, butits inclusiondoesnotchangeourresultsas seenin exhibit 11. Therefore, although this can be interpreted to mean that there is selection bias, it is apparently of limited economic magnitude. This may be due to the tension between the fact that worse-off banks are both more likely to be examined and more likely to fail or be acquired by another bank. In addition, larger banks, though maybe of higher quality, are examined more frequently due to their size. 39

Exhibit 11: Measures of Supervisory Stringency Controlling for Selection Bias Linear bank-fixed-effects specification Percent 25 Quarterly Time-fixed effects No time-fixed effects, residual 20 With economy-wide variables, residual 15 10 5 0 -5 -10 1991 1993 1995 1997 1999 2001 2003 2005 2007 2009 2011 Linear bank-random-effects specification Percent 25 Quarterly Time-fixed effects No time-fixed effects, residual 20 With economy-wide variables, residual 15 10 5 0 -5 -10 1991 1993 1995 1997 1999 2001 2003 2005 2007 2009 2011 Ordered probit bank-random-effects specification Percent 25 Quarterly Time-fixed effects No time-fixed effects, residual 20 With economy-wide variables, residual 15 10 5 0 -5 -10 1991 1993 1995 1997 1999 2001 2003 2005 2007 2009 2011 Note. Supervisory stringency is an index that can be interpreted as the percent of banks, on average, that deserve to be upgraded to the next rating according to each model’s benchmark standards. 40

6 Macroeconomic Effects Banks with poor CAMELS ratings are less likely to be significant providers of new credit as they focus on repairing their balance sheets or addressing other shortcomings that led to the poor rating. Thus, the misclassification of CAMELS ratings, particularly if it were widespread, could potentially affect macroeconomic outcomes. Thus, the conclusions of this study, showing the relatively muted degree to which CAMELS ratings appear to have been misclassified over time are somewhat reassuring. Nonetheless, even small distortions in markets can have widespread effects, and periods in which examiners are marginally more stringent in assigning CAMELS ratings may also be periods in which they exert other pressures on banks that affect lending volumes. Therefore, small deviations in our index may have large effects on other variables of interest. Therefore, we next turn to whether theseestimates ofsupervisorystringencyareassociated withchanges inlendingorinoverall output. For this analysis, we turn to a fairly standard vector autoregression (VAR) model that incorporates the time series of supervisory stringency produced by the modified randomeffects ordered probit specification. Because this series is constructed to be orthogonal in thecurrentperiodtoanumberofmacroeconomicvariables,includingGDPandtheeffective 27 federal funds rate, we choose to order it first. The other variables in the model, as they are ordered, are growth of nominal GDP, inflation as measured by the GDP deflator, the growth of total loans, the aggregate change in bank lending standards to households and 28 businesses as constructed from the Federal Reserve’s Senior Loan Officer Opinion Survey , and the effective federal fundsrate. We also run a second VAR in which we substitute total 29 lending capacity for total loans to narrow in on the supply restraints. Exhibit 12 displays the impulse response functions for the level of each variable generated by the VAR for a one standard deviation (about 2 percentage point) increase in supervisory stringency as measured by the modified random-effects ordered probit regressionwitheconomy-wide variablesforthespecification withtotal loans. Theshock generates a statistically significant and long-lasting decline in total loans that peaks at between 1 to 1.5 percent below trend, and remains less than 1 percent below trend 20 quarters after the shock. The propagation mechanism could be a tightening of lending standards, shown in the bottom left, as banks respond to increased scrutiny by rationing available loans to their highestquality borrowers. However, thedegreeof tightening ismarginally statistically significant for only afew quarters. Themodelalso suggests that thedip in lendingis poten- 27The choice of ordering has little material effect on theestimated effects. 28SeeBassett,Chosak,Driscoll,andZakrajˇsek(2010)forfurtherdiscussionofhowthisindexiscalculated. 29Lendingcapacityisadefinedasoutstandingloansplusunusedcommitmentstomakeloans,asinBassett, Gilchrist, Weinbach,and Zakrajˇsek (forthcoming). 41

tially detrimental to broader economic performance, cumulating to about a 0.5 percentage pointdeclineinnominalGDPabout6quartersafter theshock, after whichtheeffectbegins to unwind and becomes statistically insignificant. Thespecification with lending capacity instead of total loans is described by Exhibit 13. This model shows a relatively greater effect of the shock on lending–lending capacity drops by more than 2 percentage points–though the other effects remain similar in magnitude. However, it is important to note that lending capacity over the recent financial crisis fell morethan20percent,whereastotalloansfellbymorethan10percentsincethebeginningof themostrecentrecession. Comparedwiththeestimatedeffects ofsupervisorystringencyon trend growth in both loans and lending capacity, those drops were far larger in magnitude. We also conduct a similar exercise with the stringency estimates based on the repeated cross section analysis and find similar results. As shown in exhibit 14 and 15, a onestandard deviation in stringency estimates has similar or smaller effects on nominal GDP, loan growth, and lending capacity. One important difference, however, is that the positive impact on lending standards becomes statistically insignificant over the medium term. 42

Exhibit 12: Implications of Supervisory Stringency on Loans Supervisor stringency Real GDP* PPeerrcceennttaaggee ppooiinnttss PPeerrcceennttaaggee ppooiinnttss 22..55 00..22 Predicted response 22..00 00..00 95% Confidence interval 90% Confidence interval --00..22 11..55 --00..44 11..00 --00..66 00..55 --00..88 00..00 --11..00 --00..55 --11..22 00 22 44 66 88 1100 1122 1144 1166 1188 2200 00 22 44 66 88 1100 1122 1144 1166 1188 2200 QQuuaarrtteerrss aafftteerr tthhee sshhoocckk QQuuaarrtteerrss aafftteerr tthhee sshhoocckk GDP deflator* Total loans* PPeerrcceennttaaggee ppooiinnttss PPeerrcceennttaaggee ppooiinnttss 00..33 00..55 00..00 00..22 --00..55 00..11 --11..00 --11..55 00..00 --22..00 --00..11 --22..55 --00..22 --33..00 00 22 44 66 88 1100 1122 1144 1166 1188 2200 00 22 44 66 88 1100 1122 1144 1166 1188 2200 QQuuaarrtteerrss aafftteerr tthhee sshhoocckk QQuuaarrtteerrss aafftteerr tthhee sshhoocckk Lending standards Federal funds effective rate PPeerrcceennttaaggee ppooiinnttss PPeerrcceennttaaggee ppooiinnttss 4400 00..33 3300 00..22 00..11 2200 00..00 1100 --00..11 00 --00..22 --1100 --00..33 --2200 --00..44 --3300 --00..55 00 22 44 66 88 1100 1122 1144 1166 1188 2200 00 22 44 66 88 1100 1122 1144 1166 1188 2200 QQuuaarrtteerrss aafftteerr tthhee sshhoocckk QQuuaarrtteerrss aafftteerr tthhee sshhoocckk * Cumulative impulse response. 43

Exhibit 13: Implications of Supervisory Stringency on Lending Capacity Supervisor stringency Real GDP* PPeerrcceennttaaggee ppooiinnttss PPeerrcceennttaaggee ppooiinnttss 22..55 00..22 Predicted response 22..00 00..00 95% Confidence interval 90% Confidence interval --00..22 11..55 --00..44 11..00 --00..66 00..55 --00..88 00..00 --11..00 --00..55 --11..22 00 22 44 66 88 1100 1122 1144 1166 1188 2200 00 22 44 66 88 1100 1122 1144 1166 1188 2200 QQuuaarrtteerrss aafftteerr tthhee sshhoocckk QQuuaarrtteerrss aafftteerr tthhee sshhoocckk GDP deflator* Lending capacity* PPeerrcceennttaaggee ppooiinnttss PPeerrcceennttaaggee ppooiinnttss 00..33 11 00 00..22 --11 00..11 --22 --33 00..00 --44 --00..11 --55 --00..22 --66 00 22 44 66 88 1100 1122 1144 1166 1188 2200 00 22 44 66 88 1100 1122 1144 1166 1188 2200 QQuuaarrtteerrss aafftteerr tthhee sshhoocckk QQuuaarrtteerrss aafftteerr tthhee sshhoocckk Lending standards Federal funds effective rate PPeerrcceennttaaggee ppooiinnttss PPeerrcceennttaaggee ppooiinnttss 5500 00..22 4400 00..11 3300 00..00 2200 --00..11 1100 --00..22 00 --00..33 --1100 --2200 --00..44 --3300 --00..55 00 22 44 66 88 1100 1122 1144 1166 1188 2200 00 22 44 66 88 1100 1122 1144 1166 1188 2200 QQuuaarrtteerrss aafftteerr tthhee sshhoocckk QQuuaarrtteerrss aafftteerr tthhee sshhoocckk * Cumulative impulse response. 44

Exhibit 14: Implications of Supervisory Stringency on Loans - Repeated Cross-Section Supervisor stringency Real GDP* PPeerrcceennttaaggee ppooiinnttss PPeerrcceennttaaggee ppooiinnttss 11..22 00..55 11..00 00..00 Predicted response 00..88 95% Confidence interval 00..66 90% Confidence interval --00..55 00..44 00..22 --11..00 00..00 --00..22 --11..55 00 22 44 66 88 1100 1122 1144 1166 1188 2200 00 22 44 66 88 1100 1122 1144 1166 1188 2200 QQuuaarrtteerrss aafftteerr tthhee sshhoocckk QQuuaarrtteerrss aafftteerr tthhee sshhoocckk GDP deflator* Total loans* PPeerrcceennttaaggee ppooiinnttss PPeerrcceennttaaggee ppooiinnttss 00..55 11..00 00..44 00..55 00..00 00..33 --00..55 00..22 --11..00 00..11 --11..55 00..00 --22..00 --00..11 --22..55 00 22 44 66 88 1100 1122 1144 1166 1188 2200 00 22 44 66 88 1100 1122 1144 1166 1188 2200 QQuuaarrtteerrss aafftteerr tthhee sshhoocckk QQuuaarrtteerrss aafftteerr tthhee sshhoocckk Lending standards Federal funds effective rate PPeerrcceennttaaggee ppooiinnttss PPeerrcceennttaaggee ppooiinnttss 6600 00..22 5500 4400 00..00 3300 2200 --00..22 1100 00 --00..44 --1100 --2200 --00..66 00 22 44 66 88 1100 1122 1144 1166 1188 2200 00 22 44 66 88 1100 1122 1144 1166 1188 2200 QQuuaarrtteerrss aafftteerr tthhee sshhoocckk QQuuaarrtteerrss aafftteerr tthhee sshhoocckk * Cumulative impulse response. 45

Exhibit 15: Implications of Supervisory Stringency on Lending Capacity - Repeated Cross-Section Supervisor stringency Real GDP* PPeerrcceennttaaggee ppooiinnttss PPeerrcceennttaaggee ppooiinnttss 11..22 00..55 11..00 00..00 Predicted response 00..88 95% Confidence interval 00..66 90% Confidence interval --00..55 00..44 00..22 --11..00 00..00 --00..22 --11..55 00 22 44 66 88 1100 1122 1144 1166 1188 2200 00 22 44 66 88 1100 1122 1144 1166 1188 2200 QQuuaarrtteerrss aafftteerr tthhee sshhoocckk QQuuaarrtteerrss aafftteerr tthhee sshhoocckk GDP deflator* Lending capacity* PPeerrcceennttaaggee ppooiinnttss PPeerrcceennttaaggee ppooiinnttss 00..55 22 00..44 11 00 00..33 --11 00..22 --22 00..11 --33 00..00 --44 --00..11 --55 00 22 44 66 88 1100 1122 1144 1166 1188 2200 00 22 44 66 88 1100 1122 1144 1166 1188 2200 QQuuaarrtteerrss aafftteerr tthhee sshhoocckk QQuuaarrtteerrss aafftteerr tthhee sshhoocckk Lending standards Federal funds effective rate PPeerrcceennttaaggee ppooiinnttss PPeerrcceennttaaggee ppooiinnttss 6600 00..44 00..22 4400 00..00 2200 --00..22 00 --00..44 --2200 --00..66 --4400 --00..88 00 22 44 66 88 1100 1122 1144 1166 1188 2200 00 22 44 66 88 1100 1122 1144 1166 1188 2200 QQuuaarrtteerrss aafftteerr tthhee sshhoocckk QQuuaarrtteerrss aafftteerr tthhee sshhoocckk * Cumulative impulse response. 46

7 Conclusion This paper investigates several alternative statistical models that could help explain the assignment of bank CAMELS ratings over the period 1991 to 2011. Despite the potential shortcomings of any particular model choice (given the limitations inherent in the irregular frequencyandtimingofCAMELSdataandprivateinformationavailableonlytoexaminers), the key results are highly consistent across the different specifications used in this paper. In general, we find that swings in supervisory stringency are quite modest, implying quite little misclassification in CAMELS ratings at most points over the past two plus decades. Nonetheless, as in earlier studies by other authors using a different empirical strategy, we find that supervisory standards appeared to be somewhat tighter than average in the early 1990s. In addition, we show that supervisory standards likely tightened noticeably at the beginning of the recent financial crisis. However, we find little evidence that supervisors continued to be unusually stringent in the assignment of CAMELS ratings after the end of the recent recession. DespitetherelativelysmalldisrepanciesbetweenthemodelimpliedandactualCAMELS ratings over time, thosechanges appear to berelated to swingsin thelendingcycle. A standard VAR model suggests that a one-standard-deviation shock to a measure of supervisory stringency is associated with a statisically significant decline in total loans and lending capacity from their trends, and that the effect persists for several years. Moreover, that decline in lending may also be concommitant with a tightening of lending standards and a dip in the level of real GDP below trend of about 0.4 to 0.6 percent after a year or two. In comparing our results with those of earlier researchers, we show that the estimated degree of stringency can be influenced importantly by the choice of conditioning variables and to a lesser extent the econometric framework. Whereas most earlier researchers had interpreted the coefficients on time fixed effects in a pooled cross-sectional regression as the degree of stringency, in this paper, we use frameworks that control directly for the overall macroeconomic environment at the time of the exam. Specifically, we use economywide real and financial variables rather than time fixed effects in three panel data models, and separately we use those variables to adjust the time-varying parameter estimates from repeated cross-sectional regressions. Our approaches generally produce smaller estimates of stringency in both the early 1990s and throughout the period of 2007 to 2011 than the strategy used by previous researchers of interpreting the coefficients on time fixed effects. Although one may question whether supervisorystandards should reflect assessments of both the local and the national economic environment, this is a normative critique. Both on average and in the aggregate, banks lend to firms, for example, that operate in markets other than the market where the 47

banks or firms are headquarted (or where banks hold most of their deposits). Also, the macroeconomic and financial environment may be good indicators of expected changes in bank conditions over the next several quarters and broader risks facing banks. Therefore, the the national economic environment and financial conditions may well be an important factor in determining aggregate supervisory standards. We conclude by noting a few caveats and further investigation necessary in these types of analyses. • The assignment of CAMELS ratings is only one way in which supervisors can apply pressure on the risk management practices of banks. This paper does not examine changes in supervisory standards for loan classifications, memorada of understanding, or in the other interactions between bank management and supervisors. • Our analysis was based on a sample of banks that were not a part of the top 25 BHCs, an important set of institutions that may have been subject to more or less stringent supervisory standards. If so, these institutions would disproportionately affect a weighted estimate for the entire banking industry. • We acknowledge that our proxies for management quality and sensitivity to market risk may be inadequate. Changes in the supervisory assessments of these components may be related to the financial cycle in ways that bias the results toward finding unusually stringent standards during recessions (that is, good times can mask a lot of deficiencies in risk management from both markets and regulators). In terms of management quality, this is also reflected in the various loan shares that we use as explanatoryvariables. Asforsensitivitytomarketrisk,becauseweexcludethelargest BHCsinoursample,webelievethatwearestartingoffwithasamplethathasminimal exposure to market risk as measured by the exposures in the trading book. • Though we tried various specifications and included not only levels but also changes in bank balance sheet variables in robustness checks, we may have omitted other variables that are related to the financial cycle. • Bank exams are not randomly timed through the cycle. Though we also estimated a selection model for whether a bank was examined in a given quarter as a robustness test, we still note that any selection bias in determining the banks that are examined during a given quarter may affect the results for the panel regressions. 48

References Afonso, A., P. Gomes, and P. Rother (2011): “Short-and Long-Run Determinants of Sovereign Debt Credit Ratings,” International Journal of Finance and Economics, 16, 1–15. Agarwal, S., D. Lucca, A. Seru, and F. Trebbi (2012): “Inconsistent Regulators: Evidence from Banking,” Working Paper. Bassett, W. F., M. B. Chosak, J. C. Driscoll, and E. Zakrajˇsek(2010): “Changes in Bank Lending Standards and the Macroeconomy,” Working Paper. Bassett, W. F., S. Gilchrist, G. C. Weinbach, and E. Zakrajˇsek (forthcoming): “Improving Our Ability to Monitor Bank Lending,” in Systemic Risk and Macro Modeling, ed. by M. K. Brunnermeier, and A. Krishnamurthy. University of Chicago Press. Berger, A. N., M. Kyle, and J. Scalise (2001): “Did U.S. Bank Supervision Get Tough During the Credit Crunch? Did They Get Easier During the Banking Boom? Did It Matter to Bank Lending?,” in Prudential Supervision: What Works and What Doesn’t?, ed. by F. Mishkin, pp. 301–349. University of Chicago Press. Berger, A. N., and G. F. Udell (2004): “The Institutional Memory Hypothesis and the Procyclicality of Bank Lending Behavior,” Journal of Financial Intermediation, 13, 458–495. Bernanke, B. S.(1983): “Nonmonetary Effects of the Financial Crisis in the Propagation of the Great Depression,” American Economic Review, 73(3), 257–276. Bizer, D. S.(1993): “Regulatory Discretion andtheCreditCrunch,”WorkingPaper, U.S. Securities and Exchange Commission, Washington DC, April. Blinder, A. S. (1973): “Wage Discrimination: Reduced Form and Structural Estimates,” Journal of Human Resources, 8(4), 436–455. Cecchetti, S. G. (2001): “Comment,” in Prudential Supervision: What Works and What Doesn’t?, ed. by F. Mishkin, pp. 349–352. University of Chicago Press. Curry, T. J., G. S. Fissel, and G. A. Hanweck (2008): “Is There a Cyclical Bias in Bank Holding Company Risk Ratings?,” Journal of Banking and Finance, 32(7), 1297– 1309. Curry, T. J., G. S. Fissel, and C. D. Ramirez (2008): “The Impact of Bank Supervision on Loan Growth,” The North American Journal of Economics and Finance, 19(2), 113–134. 49

English, W. B., S. J. Van den Heuvel, and E. Zakrajˇsek (2011): “Interest Rate Risk and Bank Equity Valuations,” Working Paper. Kiser, E. K., R. A. Prager, and J. R. Scott (2012): “Supervisor Ratings and the Contraction of Bank Lending to Small Businesses,” Federal Reserve Board Working Paper. Krainer, J., and J. A. Lopez (2009): “Do Supervisory Rating Standards Change Over Time?,” Federal Reserve Bank of San Francisco Economic Review, pp. 13–24. Lown, C. S., and D. P. Morgan (2006): “The Credit Cycle and the Business Cycle: New Findings Using the Loan Officer Opinion Survey,” Journal of Money, Credit, and Banking, 38(6), 1575–1597. Mundlak, Y. (1978): “On the Pooling of Time Series and Cross Section Data,” Econometrica, 46(1), 69–85. Oaxaca, R. (1973): “Male-Female Wage Differentials in Urban Labor Markets,” International Economic Review, 14(3), 693–709. Peek, J., E. S. Rosengren, and G. M. B. Tootell (1999): “Is Bank Supervision Central to Central Banking?,” The Quarterly Journal of Economics, 114(2), 629–653. (2003a): “Does the Federal Reserve Possess an Exploitable Informational Advantage?,” Journal of Monetary Economics, 50(4), 817–839. (2003b): “Identifying the Macroeconomic Effect of Loan Supply Shocks,” Journal of Money, Credit and Banking, 35(6), 931–946. Rezende, M. (2011): “The Effects of Bank Regulator Switching on Supervisory Ratings,” Working Paper. Stock, J. H., and M. W. Watson (1989): “New Indexes of Concident and Leading Economic Indicators,” in NBER Macroeconomics Annual 1989, Volume 4, ed. by O. J. Blanchard, and S. Fischer, pp. 351–409. MIT Press. Wooldridge, J. M. (2005): “Simple Solutions to the Initial Conditions Problem in Dynamic,NonlinearPanelDataModelswithUnobservedHeterogeneity,” Journal of Applied Econometrics, 20, 39–54. (2010): Econometric Analysis of Cross Section and Panel Data. MIT Press. 50

Cite this document
APA
William F. Bassett, Seung Jung Lee, & and Thomas W. Spiller (2012). Estimating Changes in Supervisory Standards and Their Economic Effects (FEDS 2012-55). Board of Governors of the Federal Reserve System, Finance and Economics Discussion Series. https://whenthefedspeaks.com/doc/feds_2012-55
BibTeX
@techreport{wtfs_feds_2012_55,
  author = {William F. Bassett and Seung Jung Lee and and Thomas W. Spiller},
  title = {Estimating Changes in Supervisory Standards and Their Economic Effects},
  type = {Finance and Economics Discussion Series},
  number = {2012-55},
  institution = {Board of Governors of the Federal Reserve System},
  year = {2012},
  url = {https://whenthefedspeaks.com/doc/feds_2012-55},
  abstract = {The disappointingly slow recovery in the U.S. from the recent recession and financial crisis has once again focused attention on the relationship between financial frictions and economic growth. With bank loans having only recently started growing and still sluggish, some bankers and borrowers have suggested that unnecessarily tight supervisory policies have been a constraint on new lending that is hindering recovery. This paper explores one specific aspect of supervisory policy: whether the standards used to assign commercial bank CAMELS ratings have changed materially over time (1991-2011). We show that models incorporating time-varying parameters or economy-wide variables suggest that standards used in the assignment of CAMELS ratings in recent years generally have been in line with historical experience. Indeed, each of the models used in this analysis suggests that the variation in those standards has been relatively small in absolute terms over most of the sample period. However, we show that when this particular aspect of supervisory stringency becomes elevated, it has a noticeable dampening effect on lending activity in subsequent quarters.},
}