A New Tool for Case Studies in Epidemiology-the Synthetic Control Method.
A New Tool for Case Studies in Epidemiology-the Synthetic Control Method.
复制标题
DOI:
10.1097/ede.0000000000000837
复制
发表时间:
2018-07
期刊:
影响因子:
--
通讯作者:
Basu S
中科院分区:
文献类型:
--
作者:
Rehkopf DH;Basu S
Epidemiologists, perhaps more than most disciplines given the field’s development of case-control methods, are acutely aware of the importance of appropriately selecting controls, and this is a critical decision to be made with the synthetic control method. The user selects the pool of eligible control regions. Kagawa et al1 appropriately select only eligible states, and because the treatment is repeal of a policy, they are limited to only the 8 other states that currently have the policy. This approach is most consistent with the selection of the control population in a case-control study with respect to the outcome of interest, selecting randomly from among those states at risk for the outcome. 7 Recent synthetic control method applications used as few as 168 but as many as 1309 regions in the donor pool. In addition, based on the matching shown in Table 2 of Kagawa et al, 1 half of the 8 states are not very good matches, with virtually all of the control states across outcomes made up of Illinois, Iowa, Michigan, and North Carolina. The primary advantage in the synthetic control is taking a data-driven approach to getting a close pretreatment match between treatment and control regions, but this advantage is more challenging to leverage when the sample of donor pool states is small. In scenarios where only a small number of regions match, robustness checks with the synthetic control method have been performed by excluding the best matches and showing that results were consistent with the second best selection of control regions. 10 The importance of the donor pool is magnified with the synthetic control method because inference about whether the results are due to random error also depends on the choice of the donor pool. This is perhaps the most novel and challenging aspect of the synthetic control method; there is not a validated, parametric approach to establishing confidence intervals on the matched posttreatment difference between the treatment and synthetic control as there is with difference in differences. Kagawa et al1 take the generally recommended approach of a placebo test where each of the control states is used to establish the range of the posttreatment level of the outcome that could be expected in the absence of treatment, since the control states did not receive the intervention. While there is a rough analogy here to simulated confidence intervals from approaches such as the bootstrap, the additional challenge for synthetic control method is that the standard assumptions for estimating an effect parameter are also required assumptions for valid inference on whether the effect parameter estimated is within the range of natural variation observed in the placebo controls. That is, the following assumptions must be met for valid inference about the precision of the estimates:(1) stable unit treatment value assumption;(2) assumption of random assignment to the treatment; and (3) assumption that the potential outcomes for regions are fixed but a priori unknown. 11 Imagine, for example, that New York and Massachusetts are regions that differ substantially from Indiana and Tennessee (which is consistent with the fact that they don’t serve as best matched control regions). These regions are then used to establish the natural variation that would be expected for Indiana and Tennessee if no intervention had occurred. The conclusion that there is no impact of the repeal of comprehensive background checks is dependent on the assumption that Indiana and Tennessee are randomly selected for treatment from the sample of control states. This is a particular challenge when study conclusions are that there was no impact of a policy change. We are thus …