Evaluating Data Integrity and Reporting Challenges in Public Health: Lessons from COVID-19 Data Collection in Washington State

"Background

Between July 2020 and August 18, 2021, multiple emails and ten Public Records Requests were submitted to the Washington State Department of Health requesting data and answers to a variety of questions. The questions and requests were based around the data about testing and defining Covid cases, hospitalizations, and deaths as well as definitions and criteria surrounding the Covid vaccinations... In all cases, there were no datasets returned in response to official Public Records Requests that did not include at least one of the data errors identified...

Summary Findings

There were six distinct types of data errors discovered through Public Records Requests (Table 1). These errors often overlapped with other error types, which compounded the other error calculations. The effects of these errors on the quality of the data collected by the Washington State Department of Health rendered the data irreparably damaged and unfit for use...

Conclusion

The analysis of the data obtained from the Washington State Department of Health reveals critical flaws in data classification, methodology, and overall data mismanagement during the COVID-19 era. The identified errors, including misclassification of dates and vaccination status, inclusion of unknown and unverified data, and methodological inconsistencies, significantly compromised the reliability of the data. These issues not only distorted the visualizations used for public health decision-making, but also posed serious risks of misinforming the public and policymakers. The study highlights the necessity of rigorous data quality standards and transparent data management practices to ensure that public health interventions are based on accurate and reliable information, particularly during emergencies where health could be negatively impacted."