Originally published December 2016. Updated March 2023 by SHADAC Research Assistant Adey Fentaw.
This technical brief provides guidance on how to run tests for statistically significant differences using estimates and their associated margins of error from SHADAC’s State Health Compare web tool.
The brief first explains how to conduct a quick visual scan for statistically significant differences using the margins of error (MOE) output in State Health Compare's state ranking charts, and then goes on to provide step-by-step instructions for using margins of error to conduct a more robust test of statistical significance through a type of hypothesis testing known as a “t-test.” Download a PDF of the brief.
Changing Population Estimates: Implications for Data Users
February 21, 2022:
.
How the CDC’s recent shift will impact calculations for birth and death rates
The National Center for Health Statistics (NCHS) at the Centers for Disease Control (CDC) recently changed the population estimates they use to calculate population-level rates in their National Vital Statistics System (NVSS), such as birth rates and mortality rates that are commonly accessed through tools such as CDC WONDER. These population estimates allow for the production of rates by providing a population denominator against which to compare the number of births or deaths.
This move to single-race population estimates has several implications for data users:
Statistics based on the single-race population estimates are only made available via CDC WONDER for data years 2018 forward, and statistics based on bridged-race population estimates are only available through data year 2020. Data users should not make comparisons between statistics based on bridged-race population estimates and statistics based on single-race population estimates. Further, because of changes made in 2020 to how Census measures race and ethnicity, caution should be used when comparing statistics by race and ethnicity from 2020 and later to data from 2019 and earlier.
The single-race population estimates produced by Census suppress the number of persons less than five years of age at the county level to comply with Census' privacy policies. This prevents users from calculating age-adjusted rates at the county level or by level of urbanization using the single-race data, though crude rates can still be calculated at these levels of geography.
This change also affects SHADAC’s Suicide Deaths measure on State Health Compare. That measure’s Race and Ethnicity breakdown is now available in separate series for data years 1999–2020 and 2018–2021; estimates should not be compared between these series. Furthermore, SHADAC is unable to update the Metropolitan Status breakdown for this measure past data year 2020 due to the previously explained county-level suppressions.
Going forward, data users should keep changes in the denominator in mind when comparing annual estimates based on CDC vital statistics data. SHADAC strives to account for these types of considerations on State Health Compare by making clear when data years aren’t comparable and providing data users with relevant context around changes in methodology and data collection.
Issue Brief: Unwinding the Medicaid Continuous Coverage Requirement - Transitioning to Employer-Sponsored Coverage (State Health & Value Strategies Cross-Post)
January 2023:
The following content is cross-posted from State Health and Value Strategies, published on January 19, 2023.
Authors: Elizabeth Lukanen and Robert Hest, SHADAC
Medicaid and the Children’s Health Insurance Program (CHIP) have played a key role in the response to the COVID-19 pandemic, providing a vital source of health coverage for millions of people. The Families First Coronavirus Response Act (FFCRA) implemented a continuous coverage requirement in Medicaid, coupled with an increase in federal payments to states. The requirement has prevented states from disenrolling Medicaid enrollees, except in limited circumstances, allowing millions of Americans continued access to healthcare services during the pandemic.
Enrollment in Medicaid and CHIP has grown sharply since February 2020, with more than 20 million enrollees added to state rosters as of September 2022. Continuous coverage can also likely be credited for the decrease in the number of people who were uninsured in 2021, down to 8.6% from a pre-pandemic level of 9.2% in 2019. This was driven by a 1.4 percentage point increase in public coverage in 2021, to 36.8% from 35.4% in 2019. These trends were mirrored across states, with 28 states experiencing significant decreases in their rates of uninsurance. Meanwhile, 36 states saw rising rates of public coverage with none seeing a decline in public coverage.
When the unwinding of the Medicaid continuous coverage requirement begins, states will restart eligibility redeterminations, and millions of Medicaid enrollees will be at risk of losing their coverage. Estimates vary, but most approximate that in the range of 15 million to 18 million people will lose Medicaid coverage, with some portion exiting because they are no longer eligible, some losing coverage due to administrative challenges despite continued eligibility, and some transitioning to another source of coverage. While much attention has been paid to how states can approach the unwinding of the continuous coverage requirement to prioritize the retention of Medicaid coverage and transitions to marketplace coverage, less attention has been paid to the role of employer-sponsored insurance.
To get a sense for the size of the group that might have employer-sponsored coverage as an option, this issue brief discusses the proportion of individuals with an offer of employer-sponsored coverage by income and state, and the proportion of those offers that are considered affordable based on premium cost. The issue brief also discusses the importance of a Medicaid disenrollment survey to monitor the coverage transitions associated with the unwinding.
To support communications efforts during the unwinding, SHVS has also produced sample messaging for state departments of labor to share with the employer community which explains the unwinding and coverage options for employees.
Check out our new video to learn tips and tricks for using SHADAC’s State Health Compare
SHADAC’s State Health Compare is a go-to resource for more than 45 data measures on a range of health topics including insurance coverage; cost of care; health behaviors; health outcomes; access to and utilization of care; care quality; public health; and social and economic determinants of health. Estimates are regularly updated from more than 17 data sources and can be broken down across subcategories such as age, education level, race/ethnicity, and other characteristics.
This new video walks through how to create customized data sets and visualizations of state-level health estimates on State Health Compare, allowing analysts, policymakers, and other data users to seamlessly view and download their state’s estimates.
Overview of SHADAC's Minnesota Community and Uninsured Profile for MDH's Health Equity Data Community of Practice
On September 19, 2022, SHADAC investigator Kathleen Thiede Call presented at the Minnesota Department of Health's Health Equity Data Community of Practice Meeting. This presentation included a guided tour of SHADAC's Minnesota Community and Uninsured Profile, along with a brief history of how this resource was created. Click the image below to download the slide deck from this presentation.