October 2019
Resource Type
NIH Pragmatic Trials Collaboratory and Living Textbook
The NIH Pragmatic Trials Collaboratory aims to improve the way clinical trials are conducted by creating a new infrastructure for collaborative research with healthcare systems, ultimately ensuring that healthcare providers and patients can make decisions based on the best available clinical evidence. The Collaboratory supports the design and rapid execution of pragmatic clinical trial Demonstration Projects to address questions of major public health importance and engage healthcare delivery systems in research partnerships. The Collaboratory also provides training resources on how to design, conduct, and disseminate embedded pragmatic clinical trials (ePCTs).
Sample size calculation for stepped-wedge cluster-randomized trials with more than two levels of clustering
April 24, 2019
This paper provides power and sample size methods for stepped-wedge trials with more than two levels (subjects within clusters), and illustrates these methods in the settings of the CHANGE trial–which randomizes nursing homes (level 4) consisting of nursing home wards (level 3) in which nurses (level 2) are observed with respect to their hand hygiene compliance during hand hygiene opportunities (level 1) in the care of patients.
Abstract
Background/Aims: Power and sample size calculation formulas for stepped-wedge trials with two levels (subjects within clusters) are available. However, stepped-wedge trials with more than two levels are possible. An example is the CHANGE trial which randomizes nursing homes (level 4) consisting of nursing home wards (level 3) in which nurses (level 2) are observed with respect to their hand hygiene compliance during hand hygiene opportunities (level 1) in the care of patients. We provide power and sample size methods for such trials and illustrate these in the setting of the CHANGE trial.
Methods: We extend the original sample size methodology derived for stepped-wedge trials based on a random intercepts model, to accommodate more than two levels of clustering. We derive expressions that can be used to determine power and sample size for p levels of clustering in terms of the variances at each level or, alternatively, in terms of intracluster correlation coefficients. We consider different scenarios, depending on whether the same units in a particular level are repeatedly measured as a cohort sample or whether different units are measured cross-sectionally.
Results: A simple variance inflation factor is obtained that can be used to calculate power and sample size for continuous and by approximation for binary and rate outcomes. It is the product of (1) variance inflation due to the multilevel structure and (2) variance inflation due to the stepped-wedge manner of assigning interventions over time. Standard and non-standard designs (i.e. so-called “hybrid designs” and designs with more, less, or no data collection when the clusters are all in the control or are all in the intervention condition) are covered.
Conclusions: The formulas derived enable power and sample size calculations for multilevel stepped-wedge trials. For the two-, three-, and four-level case of the standard stepped wedge, we provide programs to facilitate these calculations.
LTC Focus
LTCFocus.org provides data on nursing home care in the US. Their goal is to allow researchers to trace relationships between state policies, local market forces, and the quality of long-term care, enabling policymakers to craft state and local guidelines that promote high-quality, cost-effective, equitable care for older Americans.
Public Attitudes toward Consent When Research Is Integrated into Care—Any “Ought” from All the “Is”?

Update on IMPACT Funded Pilot Studies
June 2022 – In Grand Rounds 28, Drs. Jennifer Gabbard and Ariel Green share research updates and experiences on IMPACT Cycle 2A Pilot Studies.
Jennifer Gabbard, MD on her pilot: Using Telemedicine to Improve Engagement in Advance Care Planning in Patients with Cognitive Impairment or Unrecognized Dementia
Ariel Green, MD, MPH, PhD on her pilot: ALIGN: Aligning Medications with What Matters Most
Webinar Recording
Speakers
Jennifer Gabbard, MD
Assistant Professor
Geriatrics and Palliative Medicine
Wake Forest School of Medicine
Ariel Green, MD, MPH, PhD
Associate Professor
Geriatrics Medicine and Gerontology
Johns Hopkins University School of Medicine
Learning Objectives
- Understand the approach used to conduct an embedded pragmatic trial of advance care planning (ACP) intervention (TeleVoice) in outpatient primary care.
- Understand the rationale and design of the ALIGN pilot study.
- To appreciate the successes and challenges encountered in implementing an embedded pragmatic trial for people living with cognitive impairment (PLCI) and dementia (PLWD) in primary care.
- To describe updates on our pilot progress to date and plans for a larger embedded pragmatic clinical trial.
Podcast
Podcast Transcript: Download the transcript here.

