The Lancet Regional Health – Europe
Dear Editor,
Nordstrӧm et al. have studied the relative effectiveness of the fourth dose of a Covid vaccine against all-cause death, versus three doses, in elderly residents of Sweden. One of their two cohorts comprised 24,524 residents of nursing homes. The authors estimated vaccine effectiveness of about 40 percent in the frail elderly (a rate ratio of about 0.6).
As I will show here, the true effect was somewhere between a rate ratio of 1.2 and 2.4, namely, negative effectiveness. The fourth dose was futile at best, and possibly harmful to this vulnerable population.
The study design was simple. Three-dose recipients were matched to four-dose recipients on several variables, and the matched cohort was followed for death from any cause. The authors skipped the first week after vaccination and estimated the effect in two intervals. The best result (relative effectiveness of 39 percent) was derived from a follow-up period of 7-60 days, in which three-quarters of the deaths have occurred.
The authors were aware of the key threat to the validity of their results: residual confounding by unmeasured health characteristics. They write:
“Furthermore, although third-dose recipients had similar baseline characteristics as fourth-dose recipients, some third-dose recipients likely did not receive the fourth dose because of deteriorating health that was not captured by the baseline characteristics. If so, this would increase their risk of death and result in a higher estimated VE.”
That’s the “healthy vaccinee” bias, documented repeatedly in various datasets from different countries. Vaccinated are healthier, on average, than unvaccinated, and those who received the N+1 dose were healthier than those who received the N dose. That was true in UK data for third-dose recipients (versus two-dose recipients) and fourth-dose recipients (versus three-dose recipients).
Fortunately, the bias can be removed, at least roughly. Researchers from Hungary and the US (and myself) independently proposed a similar correction method for Covid death, using data on non-Covid deaths. We compute a bias factor – the ratio of non-Covid deaths in the sicker group versus the healthier group – which reflects different baseline characteristics. Then, we multiply the biased risk ratio of Covid death by the bias factor.
The logic is simple: we adjust the risk of Covid death upward in the healthier group, to create two groups that have comparable baseline mortality risk. The remaining mortality difference, in whatever direction, should estimate the vaccine effect. The correction takes us beyond incomplete adjustment by matching or multivariable regression because it accounts for unmeasured relevant variables.
There is no data on Covid death and non-Covid death in the study of Nordstrӧm et al., but the same correction can be applied to all-cause mortality, the endpoint of the study, as explained next.
That four-dose recipients were healthier is evident in the cumulative mortality graphs, which separate at the very beginning of the follow-up (Figure below). That’s a clear indication of different baseline mortality risk because we don’t expect any benefit of the fourth dose within one week of an injection. Hence, the mortality ratio by the end of the first week should estimate the bias factor, which may be used to correct rate ratios, derived from later, left-truncated, follow-up.
Read More – Healthy Vaccinee Bias: Letter to the Editor of The Lancet Regional Health – Europe
