COVID vaccine surveillance efforts are a global priority, but safety monitoring for vaccines should not reflect a single global population. The largest international network study ever completed on the background rates of adverse events of special interest (AESI) being monitored in vaccine surveillance efforts identified that these rates vary substantially by age, sex, and database.
Led by researchers at the University of Oxford, Columbia University, Erasmus MC, UCLA, and Janssen, an international team of collaborators within the Observational Health Data Sciences and Informatics (OHDSI) network provided a timely reference of the background rates of AESIs in the recent study "Characterising the background incidence rates of adverse events of special interest for covid-19 vaccines in eight countries: multinational network cohort study" published by The BMJ.
"We knew regulators would be monitoring a long list of events for the surveillance of COVID vaccines safety," said co-senior author Dani Prieto-Alhambra MD MSc PhD, Professor of Pharmacoepidemiology at the NDORMS. "To do this, they need robust estimates of the background rates of these events in historical data. These results can be used as benchmark for the monitoring of these potential safety events and for any upcoming COVID-19 vaccines."
There were 15 prespecified adverse events studied, matching those being monitored by the U.S. Food and Drug Administration and similar to those used by other top regulatory agencies, which include heart attack, stroke, and blood clotting. Incidence rates were classified by age groupings and gender in this observational study of more than 126 million people across four continents and 13 total databases, though the outcomes of those specific groupings would even vary by database.
"We found significant heterogeneity in background rates between age and sex," said co-lead author Xintong Li, DPhil student and Clarendon scholar at NDORMS. "If we compare these rates regardless of age or sex group, we may either find a false signal or neglect a real safety signal while monitoring vaccine surveillance.
"The observed and expected rates comparison should also be conducted within the same health database whenever possible," Li added. "While we understand that is not possible for all surveillance systems or vaccine safety studies, choosing a similar population and stratifying or standardizing by age and sex is highly recommended."
Heart attack, for example, was observed as a very rare (<1/10,000) outcome for a 24-year-old female, but it was a common (<1/10 to ≥1/100) one for an 88-year-old male. The research team believes that the populations who are more likely to suffer these AESIs (like the older man in this example) should be analyzed separately from populations in much lower risk groups.
"If a vaccinated population is older than an unvaccinated population, and we do not adjust for it, we may see a false increased risk of events following vaccination," said co-lead author Anna Ostropolets MD, a PhD student in the Columbia University Department of Biomedical Informatics.
The variability between different databases could reflect numerous factors, ranging from the process of data capture to population differences such as socioeconomic status and comorbidities.
"The observed heterogeneity between databases was more than I expected," Prieto-Alhambra said. "As a consequence, vaccine safety surveillance should be conducted using the same database for both post-vaccine and background rates."
This multinational network cohort study used deidentified electronic health records and health claims data, all of which were mapped to the OMOP common data model, from eight countries. All rates of adverse events, as well as the protocol and study codes, are available in the publication.
This analysis provides historical context for how often outcomes happen in the general population, and can facilitate comparisons with what is observed among those vaccinated. The findings, which suggest caution and adjusted analysis will be needed in vaccine safety analyses to avoid misleading conclusions, can support international efforts aimed at monitoring the safety of COVID vaccines.