A novel experimental vignette methodology: SMART vignettes

作者：Jane Kim, Hyun‐Joon Yang · 发表于：Methodological Innovations · 年份：2024 · DOI：10.1177/20597991241240081 · 被引用次数：7 · 研究领域：Social Power and Status Dynamics、Health disparities and outcomes、Social and Intergroup Psychology

We motivate and present the methodology of vignette studies. The primary contribution of this paper is our proposal of a novel vignette study design: “SMART vignettes.” Our design has two notable features: the first is its use of sequential randomization, which conceptually originates from the sequential multiple assignment randomization trial (SMART) design developed by Murphy (2004). The second feature is adaptive allocation. These new features in vignette studies offer unique advantages not offered by traditional vignettes: (1) valid causal inferences on the conditional distributions of the primary outcome of interest, given other factors, (2) balanced allocations across groups, and (3) a greater degree of interactivity for the survey respondent. We illustrate the utility of our method using a case example of a vignette study used to probe physicians’ attitudes toward an AI-embedded clinical system. In this example, a SMART vignette was used to randomize hypothetical scenarios to gain a better understanding of the causal impact of physician attitudes, given emerging evidence that a range of factors including previous decisions, play a role in influencing clinical decisions. We simulated hypothetical vignette studies under both SMART and conventional (i.e. single randomization at baseline) designs. We varied the number of factors for each study and fixed each factor to have two levels. Relative loss was used to compare the degree of imbalance between groups. Both designs ha...