Written from 76 named sources Operational Breakdowns in U.S. Pandemic Preparedness: A Plan-versus-Outcome Analysis, 2020–2023 Prepared for public health professionals, researchers, and oversight officials Introduction The U.S. federal pandemic response apparatus entered 2020 with a defined operational architecture. The Pandemic Crisis Action Plan (PanCAP) was developed in 2013 in response to emerging avian influenza and MERS-CoV and updated in 2018 at the direction of the Emergency Support Function Leadership Group [3]. The PanCAP aligns CDC intervals outlined in the Pandemic Intervals Framework with traditional emergency management response phases, outlining graduated response activities for HHS and interagency partners with defined triggers for movement between phases and providing a sample coordination structure for each phase [3]. Parallel guidance for the Strategic National Stockpile (SNS), overseen by HHS's Office of the Assistant Secretary for Preparedness and Response (ASPR), defined the stockpile as a repository to provide for emergency health security, with inventory recommendations generated through an interagency review process coordinated by the Public Health Emergency Medical Countermeasures Enterprise (PHEMCE) [22] [24] [42]. This white paper evaluates actual pandemic response performance against these pre-2020 baselines across three operational domains. The analysis distinguishes among four categories of breakdown: failures of planning design, failures of execution or logistics, limitations of measurement, and genuine disagreements in the evidence. Critically, not every operational shortfall constitutes a plan failure; some adaptations — such as FEMA's assumption of response coordination under the Stafford Act — were contemplated by the PanCAP-Adapted, which layers in Phases of U.S. Government Response to novel coronavirus and notes triggers for federal coordination [3]. Domain 1: Strategic National Stockpile Management The pre-2020 SNS operational framework rested on two pillars: PHEMCE-conducted annual reviews to recommend inventory quantities, and a stopgap mission definition limiting the stockpile's intended role to bridging immediate supply gaps [22] [42]. The PHEMCE was created to coordinate medical countermeasure production, procurement, and use across federal agencies and nonfederal partners [48]. Both pillars eroded before COVID-19 reached the United States. GAO found that ASPR suspended annual SNS reviews from 2017 through 2019 during a PHEMCE reorganization, leaving inventory decisions for fiscal years 2020 through 2022 guided by past reviews and agency discretion rather than current threat assessments [22] [41] [61]. GAO's inventory data, sourced from ASPR and covering December 2019 through February 2022, indicate that pre-pandemic SNS holdings included approximately 12.6 million N95 respirators — a figure that represents a unit count on hand as of December 2019, not a days-of-supply estimate, which is a distinct metric requiring demand-model assumptions and burn-rate calculations [22] [41]. Most personal protective equipment (PPE) in the SNS had been acquired for the 2009 H1N1 response and was not replenished to prior levels [22] [40]. GAO-21-108 documented that by March 2020, within one month of the start of the pandemic, HHS had distributed most of the PPE supplies in the SNS to states and other entities, and FEMA received requests for millions of N95 respirators and gloves that far exceeded domestic supply [9]. The HHS Office of Inspector General (OIG) reached a notably different characterization than GAO regarding the SNS's operational performance. In its October 2023 audit (A-04-20-02028), OIG concluded that the SNS was operationally effective in distributing its limited inventory according to established procedures, while acknowledging that it was not equipped to handle the COVID-19 pandemic due to factors outside of its control [40] [43] [45]. GAO's analysis, by contrast, emphasized that the suspension of annual reviews and the absence of a formal risk-management approach for inventory gaps constituted execution failures within ASPR's control [22] [41]. The disagreement is not about whether the SNS met demand — it clearly did not — but about causal attribution: OIG frames the shortfall primarily as a consequence of external supply chain disruption and statutory mission ambiguity, while GAO identifies internal governance decisions — specifically, the suspension of reviews and the failure to manage inventory-gap risks — as proximate causes [22] [40]. ASPR concurred with GAO's recommendations to update review procedures and document risk-management approaches [22]. This domain illustrates a planning design failure — the stopgap mission definition was never intended for sustained nationwide demand — compounded by an execution failure — suspended reviews left inventory decisions unstructured. The National Academies evaluation noted that even with coordinated efforts, the pandemic revealed significant gaps in national preparedness, including lack of overall coordination [48]. ASPR's use of direct vendor shipment and FEMA's assumption of lead federal agency for supply chain coordination on March 19, 2020 were reasonable logistics adaptations to overwhelming demand, not plan deviations [9] [40]. Domain 2: CDC Case and Data Reporting Infrastructure The PanCAP aligned federal response phases with CDC's Pandemic Intervals Framework, presupposing a functional national surveillance system capable of timely case detection and reporting [3]. Pre-pandemic law, including the Pandemic and All-Hazards Preparedness Act of 2006 and the Pandemic and All-Hazards Preparedness and Advancing Innovation Act of 2019 (PAHPAIA), mandated that HHS establish a near real-time electronic nationwide public health situational awareness capability through an interoperable network of systems [19] [35] [51]. GAO found that, as of March 2022 — more than 15 years after the initial statutory mandate — this network did not exist, and HHS had not implemented most requirements of the 2019 act [19] [36] [37]. GAO-22-104600 summarized that HHS had adopted technical and reporting standards but had not developed a plan for sharing and securing information, had not established the near real-time capability, had not facilitated coordination among relevant agencies, and had not conducted required public meetings or strategy reviews [19] [35]. CDC's own surveillance publications document the consequences. An MMWR report covering January 22–May 30, 2020, found that the upper quartile of lag between symptom onset and reporting to CDC was 15 days [31]. That same analysis, based on 1,320,488 laboratory-confirmed cases individually reported to CDC, found race/ethnicity data were missing from approximately 55% of case reports during the early pandemic period [31]. A subsequent analysis covering April 5–September 30, 2020, identified multiple data transmission mechanisms across jurisdictions with limited interoperability in the National Notifiable Diseases Surveillance System (NNDSS), noting that the unprecedented volume and velocity of COVID-19 cases have strained the limited resources of jurisdictions [11]. By January 1, 2020–May 31, 2021, analyzing approximately 26.7 million cumulative case reports, race data remained missing from 26.7% and ethnicity data from 35.2% of reports [32] [72]. A key tension emerges between CDC's internal characterizations and GAO's structural critique. CDC's MMWR publications frame data limitations as inherent challenges of an overburdened system, emphasizing the voluntary nature of jurisdictional reporting and the diversity of state data systems [11] [31]. GAO, however, attributes the absence of a real-time network to HHS's failure to prioritize statutory requirements and establish governance structures — framing it as an execution failure rather than a measurement limitation [19] [38]. The dispute centers on the definition of readiness: CDC's publications implicitly define readiness as the capacity to adapt existing systems under crisis conditions, while GAO defines it as compliance with statutory mandates for pre-event infrastructure [19] [31]. Notably, CDC's decision to prioritize 26 core data elements over the full 72-element case report form during periods of high case volume was a reasonable operational adaptation, not a plan deviation [11]. The underlying failure was the absence of interoperable, automated reporting infrastructure before the pandemic — a measurement limitation rooted in long-term underinvestment and compounded by reliance on faxes, email and spreadsheets documented in contemporary reporting [15]. Domain 3: Federal-State Health Agency Coordination The PanCAP designated HHS as lead federal agency and provided a sample coordination structure for each response phase, while the National Response Framework's Emergency Support Function-8 assigned HHS the coordinating role for public health and medical services [3]. GAO's analysis of 74 interagency biological incident exercises conducted from 2009 through 2019, including the 2019 HHS Crimson Contagion exercise, found that federal partners lacked clarity on interagency roles and responsibilities during a pandemic [26]. The Crimson Contagion after-action report specifically found that the Biological Incident Annex and PanCAP Version 2.0 do not outline the organizational structure of the federal government when HHS is designated as the lead federal agency [2] [75]. When FEMA assumed leadership of the federal response in March 2020 — the first time FEMA led a public health incident — FEMA's own self-assessment acknowledged that the 2018 PanCAP did not envision FEMA as the agency leading federal response [76]. The PanCAP-Adapted, released March 13, 2020, did contemplate that HHS might request FEMA coordination support, making FEMA's expanded role a reasonable adaptation within the plan's framework rather than a deviation [3] [76]. However, the absence of pre-existing FEMA regional pandemic plans represents a planning design failure [2] [29]. GAO placed HHS's leadership and coordination of public health emergencies on its High Risk List in January 2022, citing persistent deficiencies in establishing clear roles and responsibilities across federal, state, local, tribal, and territorial partners [18] [65]. HHS disagreed with GAO's September 2020 recommendations to document supply chain management roles, citing its existing efforts [16]. This disagreement reflects a tension between HHS's process-based self-assessment — efforts undertaken — and GAO's outcome-based evaluation — persistent coordination gaps documented across multiple after-action reports and real-time state surveys [18] [26]. GAO noted that 72 recommendations regarding public health emergencies remained open since fiscal year 2007 as of early 2022 [18]. Structured Comparative Matrix Domain Plan Requirement Operational Outcome Mechanism of Breakdown Evidence Evaluation SNS Stockpile Management PHEMCE annual reviews to recommend inventory quantities; SNS defined as short-term stopgap buffer for immediate supply gaps, not sole-source for prolonged nationwide event [22] [42] [48] SNS inventories substantially below outbreak-scale demand; PPE acquired for H1N1 not replenished; ~12.6M N95 respirators unit count on hand Dec 2019 per ASPR inventory data Dec 2019-Feb 2022 [22] [40]; requests far exceeded supply by March 2020 [9] Planning design failure (stopgap mission inadequate for sustained pandemic) compounded by execution failure (annual reviews suspended 2017-2019 during PHEMCE reorganization; no risk-management approach for inventory gaps) [22] [41] Contested. OIG (A-04-20-02028, 2023) attributes shortfall to external supply chain disruption and mission ambiguity, finding SNS operationally effective in distribution per established procedures [40] [43]. GAO (GAO-23-106210, 2022) identifies internal governance failures within ASPR's control [22]. Dispute concerns causal attribution, not factual shortfall. CDC Data Reporting Near real-time electronic nationwide situational awareness capability through interoperable network mandated since 2006, reaffirmed in PAHPAIA 2019 [19] [35] [51] 15-day upper-quartile reporting lag (Jan–May 2020, symptom onset to CDC report) [31]; 55% missing race/ethnicity initially, declining to 26.7% race / 35.2% ethnicity missing Jan 2020-May 2021 (26.7M cases) [31] [32]; NNDSS interoperability limited, multiple transmission mechanisms [11] Measurement limitation (underinvestment in interoperable infrastructure, reliance on manual processes) rooted in execution failure (HHS did not implement statutory mandates for situational awareness network over 15+ years; no lead operational division defined) [19] [36] [38] Contested. CDC MMWR publications frame gaps as inherent system strain under unprecedented volume and voluntary reporting [11] [31]. GAO (GAO-22-104600, June 2022) attributes to HHS non-implementation of statutory requirements [19] [35]. Dispute concerns definition of readiness (adaptive capacity vs statutory compliance) and data completeness. Federal-State Coordination PanCAP designates HHS as lead federal agency with sample coordination structure per phase; ESF-8 assigns HHS coordination role; Biological Incident Annex outlines support [2] [3] [5] Interagency roles unclear between HHS and FEMA; states lacked clarity on information channels for requesting/reporting; FEMA regional pandemic plans absent; identical challenges documented 2009-2019 and recurred in COVID-19; 74 exercises 2009-2019 [2] [26] [76] Planning design failure (PanCAP did not envision FEMA-led response; organizational structure not outlined; regional plans absent) with execution failure (persistent role ambiguity across multiple after-action exercises unaddressed over a decade) [2] [75] Contested. HHS cites efforts undertaken and disagrees with GAO recommendations [16]. GAO cites persistent coordination gaps across after-action reports and places HHS on High Risk List Jan 2022; 72 recommendations open since FY2007 [18] [65]. Dispute concerns process vs outcome evaluation criteria and attribution of responsibility. Conclusion and Policy Implications The plan-versus-outcome analysis reveals that U.S. pandemic preparedness failures between 2020 and 2023 were not monolithic. Each domain exhibits a distinct configuration of breakdown types, and the most consequential disagreements between agency self-assessments and independent audits concern not facts but frameworks — specifically, how readiness is defined and where causal responsibility is assigned. In the SNS domain, the OIG–GAO divergence illustrates a fundamental tension in preparedness evaluation. OIG's finding that the SNS was operationally effective in executing its distribution procedures is not incompatible with GAO's finding that ASPR's governance decisions left the stockpile strategically unprepared [22] [40]. Both can be simultaneously true: the system worked as designed, but the design was inadequate and the governance processes meant to update it were suspended. Resolving this tension requires explicit acknowledgment that operational effectiveness within a flawed framework is not the same as preparedness. GAO's finding that HHS obligated nearly $5 billion in non-COVID appropriations FY2015-2021 mostly for anthrax and smallpox, while obligations for PPE were minimal, underscores the design mismatch [22] [41] [61]. In the data reporting domain, CDC's MMWR publications and GAO's audits describe the same phenomenon from different analytical vantage points. CDC's framing — emphasizing voluntary reporting, jurisdictional heterogeneity, and system strain — describes the measurement limitation [11] [31]. GAO's framing — emphasizing HHS's failure to implement a mandated network — identifies the execution failure that produced the measurement limitation [19]. The COVID-19 pandemic did not create the data reporting gap; it exposed a decade-long infrastructure deficit documented since PAHPA 2006 [19] [51]. In the coordination domain, the recurrence of identical challenges across after-action reports from 2009 through 2019 and into the COVID-19 response indicates a systemic planning design failure that no amount of crisis-period adaptation could fully overcome [26] [28]. The PanCAP-Adapted's flexibility in allowing FEMA coordination was a reasonable adaptation, but the absence of pre-existing FEMA regional plans and the persistent ambiguity in interagency roles represent failures that were documented, predicted, and unaddressed [2] [75]. FEMA's Initial Assessment Report and DHS OIG lessons-learned review both identified similar gaps in WebEOC data reliability and allocation processes [76]. For public health professionals and oversight officials, the central lesson is that future preparedness frameworks must distinguish between operational metrics — did the system execute its procedures? — and preparedness metrics — were the procedures adequate for the threat? The repeated finding across GAO reports — that HHS had not identified, documented, or shared lessons learned from COVID-19 as of March 2022 [19] — suggests that without institutional mechanisms for translating after-action findings into structural reform, the same breakdowns will recur. The National Academies' 2021 recommendation that PHEMCE commission an independent, evidence-based root cause assessment of SNS-specific lessons learned [24] [48] offers one such mechanism, but its implementation remains pending. Sources [2] ia801901.us.archive.org — https://ia801901.us.archive.org/30/items/crimson-contagion-2019/Crimson_Contagion_2019.pdf [3] 1Cb)(6) — https://www.dhs.gov/sites/default/files/2022-05/buzzfeed_vs._dhs_20-cv-00722_second_interim_release%20%281%29.pdf [5] FEDERAL PANDEMIC RESPONSE PLANS — https://centerforhealthsecurity.org/sites/default/files/2022-12/clade-x-federal-pandemic-response-plans.pdf [9] GAO-21-108, DEFENSE PRODUCTION ACT: Opportunities Exist to Increase Transparency and Identify Future Actions to Mitigate Medical Supply Chain Issues — https://www.gao.gov/assets/gao-21-108.pdf [11] COVID-19 Case Surveillance: Trends in Person-Level Case Data Completeness, United States, April 5–September 30, 2020 — https://pmc.ncbi.nlm.nih.gov/articles/PMC8203037/ [15] How faxes and email are slowing the U.S. COVID-19 response AP News — https://apnews.com/article/2176771ec102c4352cba5b85dbbaf3dd [16] COVID-19: Urgent Actions Needed to Better Ensure an Effective Federal Response U.S. GAO — https://www.gao.gov/products/gao-21-191 [18] COVID-19: Significant Improvements Are Needed for Overseeing Relief Funds and Leading Responses to Public Health Emergencies U.S. GAO — https://www.gao.gov/products/gao-22-105291 [19] GAO-22-104600, COVID-19: Pandemic Lessons Highlight Need for Public Health Situational Awareness Network — https://www.gao.gov/assets/gao-22-104600.pdf [22] Public Health Preparedness: HHS Should Address Strategic National Stockpile Requirements and Inventory Risks U.S. GAO — https://www.gao.gov/products/gao-23-106210 [24] HHS's Medical Countermeasures Enterprise Should Be Re-envisioned Post-COVID-19 — https://www.nationalacademies.org/news/hhs-s-medical-countermeasures-enterprise-should-be-re-envisioned-post-covid-19 [26] Biodefense: After-Action Findings and COVID-19 ... — https://www.gao.gov/products/gao-21-513 [28] Biodefense: Opportunities to Address National Strategy and Programmatic Challenges U.S. GAO — https://www.gao.gov/products/gao-22-105733 [29] Biodefense: Actions Needed to Address Long-Standing Challenges U.S. GAO — https://www.gao.gov/products/gao-23-106476 [31] Coronavirus Disease 2019 Case Surveillance — United States, January 22–May 30, 2020 MMWR — https://www.cdc.gov/mmwr/volumes/69/wr/mm6924e2.htm [32] Alternative Methods for Grouping Race and Ethnicity to Monitor COVID-19 Outcomes and Vaccination Coverage — https://www.cdc.gov/mmwr/volumes/70/wr/mm7032a2.htm [35] COVID-19: Pandemic Lessons Highlight Need for Public ... — https://www.gao.gov/products/gao-22-104600 [36] GAO-22-104600, Accessible Version, COVID-19: Pandemic Lessons Highlight Need for Public Health Situational Awareness Network — https://www.gao.gov/assets/730/721426.pdf [37] COVID-19 - Pandemic Lessons Highlight Need for Public ... — https://www.gao.gov/assets/gao-22-104600-highlights.pdf [38] Public Health Emergencies: Data Management Challenges Impact National Response U.S. GAO — https://www.gao.gov/products/gao-22-106175 [40] The Strategic National Stockpile Was Not Positioned To ... - OIG — https://oig.hhs.gov/documents/audit/7373/A-04-20-02028-Complete%20Report.pdf [41] HHS Should Address Strategic National Stockpile ... — https://www.gao.gov/assets/gao-23-106210.pdf [42] The Strategic National Stockpile: Overview and Issues for ... — https://www.congress.gov/crs_external_products/R/PDF/R47400/R47400.2.pdf [43] The Strategic National Stockpile Was Not Positioned To ... - OIG — https://oig.hhs.gov/reports/all/2023/the-strategic-national-stockpile-was-not-positioned-to-respond-effectively-to-the-covid-19-pandemic/ [45] The Strategic National Stockpile Was Not Positioned To Respond Effectively to the COVID-19 Pandemic Oversight.gov — https://www.oversight.gov/reports/audit/strategic-national-stockpile-was-not-positioned-respond-effectively-covid-19-pandemic [48] Read "Ensuring an Effective Public Health Emergency Medical Countermeasures Enterprise" at NAP.edu — https://www.nationalacademies.org/read/26373/chapter/3 [51] [PDF] Pandemic and All Hazards Preparedness Act - ASTHO — https://www.astho.org/globalassets/pdf/legal-preparedness/11-pahpa-fs-final-3-12-v2.pdf [61] PUBLIC HEALTH PREPAREDNESS - HHS Should ... — https://www.gao.gov/assets/gao-23-106210-highlights.pdf [65] GAO-22-105291 Highlights, COVID-19: Significant Improvements Are Needed for Overseeing Relief Funds and Leading Responses to Public Health Emergencies — https://www.gao.gov/assets/gao-22-105291-highlights.pdf [72] MMWR, Volume 70, Issue 32 — August 13, 2021 — https://www.cdc.gov/mmwr/volumes/70/wr/pdfs/mm7032a2-H.pdf [75] Department of Health and Human Services (HHS) Crimson ... — https://www.governmentattic.org/38docs/HHSaarCrimsonContAAR_2020.pdf [76] OIG-21-64 - Lessons Learned from FEMA's Initial Response to COVID-19 — https://www.oig.dhs.gov/sites/default/files/assets/2021-09/OIG-21-64-Sep21.pdf - PREPARING FOR THE NEXT PUBLIC HEALTH EMERGENCY: REAUTHORIZING THE PANDEMIC AND ALL-HAZARDS PREPAREDNESS ACT — https://www.govinfo.gov/content/pkg/CHRG-118shrg54475/html/CHRG-118shrg54475.htm "Fixing Emergency Management: Examining Improvements to FEMA's Disaster Response" Congress.gov Library of Congress — https://www.congress.gov/index.php/event/119th-congress/house-event/118485/text [PDF] California Department of Public Health - COVID-19 After Action Report — https://www.cdph.ca.gov/Programs/CID/DCDC/CDPH%20Document%20Library/COVID-19/CDPH-COVID19-after-action-report.pdf [PDF] GAO-21-551, COVID-19: Continued Attention Needed to Enhance ... — https://www.gao.gov/assets/gao-21-551.pdf 2019-nCoV Case Report Data Dictionary Last Updated: May 06 2022 — https://archive.cdc.gov/www_cdc_gov/coronavirus/2019-ncov/downloads/php/COVID-19-Case-Reporting-Data-Dictionary.pdf Completeness of Race and Ethnicity Reporting in Person-Level COVID-19 Surveillance Data, 50 States, April 2020–December 2021 — https://pmc.ncbi.nlm.nih.gov/articles/PMC10051003/ Correlations and Timeliness of COVID-19 Surveillance .. ... — https://www.cdc.gov/mmwr/volumes/72/wr/mm7219e2.htm COVID-19 — https://files.gao.gov/reports/GAO-22-105291/index.html COVID-19 Case Investigation and Contact Tracing Efforts from Health Departments — United States, June 25–July 24, 2020 MMWR — https://www.cdc.gov/mmwr/volumes/70/wr/mm7003a3.htm COVID-19 Case Surveillance Public Use Data — https://stacks.cdc.gov/view/cdc/97908/cdc_97908_DS1.pdf COVID-19 Case Surveillance Public Use Data Data Cent