Design and Analysis of Sequential, Multiple Assignment, Randomized Trials

A workshop to introduce adaptive interventions and sequential, multiple assignment, randomized trials (SMARTs) guided by examples. We unpack the black box of multi-component, sequential interventions and present appropriate aims and analyses for SMART design. This workshop will help you write a grant to get a SMART funded and/or learn analytic methods to apply to SMART data.

Instructor:
Kelley Kidwell, PhD (University of Michigan)

Workshop Dates and Times:
Thursday, June 13th, 10:00am – 3:30pm ET
Friday, June 14th, 10:00am – 3:30pm ET

Workshop Format:
Two-Day Synchronous Online Workshop

If only we could take one pill and be cured of what ails us. Unfortunately, most diseases and disorders require ongoing, tailored treatment that adapts to an individual’s needs and responses. Yet, evidence for effective treatment is often produced at one point in time. That is, the gold standard of evidence, a randomized, controlled trial (RCT), most often investigates if an intervention is effective in a sample of individuals at one point in their disease or disorder progression. Although the classic RCT is valuable, we may be missing treatment synergies or antagonisms by not investigating more of the intervention process in the same individuals. These effective treatment guidelines that specify whether, how, when or for whom to alter treatment at critical decision points across the scope of care are called adaptive interventions or dynamic treatment regimens. Clinicians may use judgement and evidence from point-in-time RCTs to piece together these guidelines, but they may suffer from bias due to sample selection or confounding. One way to rigorously develop adaptive interventions is with sequential, multiple assignment, randomized trials (SMARTs).

A SMART is a type of multi-stage randomized trial design such that participants are randomized at least twice in sequence. Subsequent randomization and/or treatment assignment is based on response to previous treatment. Within a SMART design, several adaptive interventions. A SMART is motivated by the development of these adaptive interventions. Analytic methods estimate the effects of the adaptive interventions at the end of the trial.

SMARTs have been applied in a variety of health research areas including cancer, toxicology, mental health, HIV, weight loss, chronic pain, and tobacco cessation, education and in implementation science. The NIH, PCORI, and other funding agencies have funded many SMART designs in these areas. Most SMARTs employ individual randomization, however, SMARTs may also use cluster randomization. Cluster randomization is applied especially when considering adaptive interventions in implementation science or disease prevention. Methods exist for a wide variety of SMART designs considering many different outcome types.

This workshop will provide an introduction into adaptive interventions and describe how SMART designs can be used to develop high-quality adaptive interventions. The workshop will first introduce adaptive interventions providing definitions, breaking down their components, explain why and where they are relevant, and present examples across a variety of settings. Next, the workshop introduces SMART design. The design is defined and best illustrated through various case studies. Each of the (real) case studies includes specific characteristics that differentiate one from another and are used throughout the course. SMART designs are compared and contrasted to other similar. SMART design principles are discussed along with the typical primary, secondary and exploratory aims, especially considering the needs of grant proposal or trial protocol. The rest of the workshop focuses on a high level overview of analytic methods of a SMART design including analysis for primary, secondary and exploratory aims, along with power and sample size calculations. Each method is illustrated through the case studies and coding in R is provided.

What you’ll learn

  • Adaptive interventions: understand the definition and components of adaptive interventions

  • SMART design: Define SMART design principles, primary aims, and advantages; Compare & contrast SMART to other designs; Illustrate designs through examples of funded designs

  • Analytic Methods: Apply regression methods to estimate embedded adaptive interventions using R software.

  • Grant writing skills: tips and tricks when proposing a SMART design in grant proposal

Syllabus

Introduction to Adaptive Interventions

  1. What are adaptive interventions?

  2. What are the components of an adaptive intervention?

  3. Why are adaptive interventions needed?

  4. What are design goals of adaptive interventions?

Introduction to SMARTs

  1. What are SMARTs?

  2. SMARTs vs. other trial designs

  3. Alternative Approaches to a SMART & Case Studies

SMART Design Principles & Aims

  1. SMART design principles

  2. Typical primary, secondary, and exploratory aims in a SMART

SMART Data Analysis at point in time for continuous and binary outcomes

  • Analysis for Main effects

  • Analysis for AI estimation and comparison: weighted and replicated regression

  • Example from Literature

SMART Longitudinal Data Analysis for continuous and binary outcomes

  • Analysis for AI estimation and comparison: weighted and replicated regression

  • Example from Literature Cluster

SMART Designs & Analysis Sample Size Calculations

  • Main effects & AI comparison and estimation

Further Tailoring Adaptive Interventions

  • Introduction to Q-learning

Grant Writing Tips & Resources

Registration Options

SMART Design and Analysis

  • Professional
  • $599
  • Baseline Price for Faculty,
    Staff, and Other Professionals
  • Click Register Below
  • Trainee
  • $599 $399
  • 33% Discount for
    Students and Postdocs
  • Use code "TRAINEE" at Checkout

Combo 1: SMART Design and Analysis + snSMART & Other Rare Disease Trials

  • Professional
  • $1198 $959
  • Baseline Price for Faculty,
    Staff, and Other Professionals
  • 20% Combination Discount
  • Click Register Below
  • Trainee
  • $959 $639
  • 33% Discount for
    Students and Postdocs
  • 20% Combination Discount
  • Use code "TRAINEE" at Checkout

 FAQs

  • This workshop was custom built for researchers in the social, behavioral, medical, educational, implementation, and/or statistical sciences who are interested in SMART clinical trials. It is designed to be accessible to such learners with varying degrees of statistical and coding backgrounds and skills (from none to expert). This workshop is introductory and appropriate for faculty, post-docs, staff, and graduate students.

  • All levels

  • No prior experience is necessary, but some experience with clinical studies is encouraged.

  • We will illustrate the methods using R software. SAS code is available upon request. Applets will be provided for sample size calculations.

    If you aren't interested in coding, this workshop is still for you as we focus more on matching analyses to aims and present example results from applying methods to funded, published trials.

  • Slides, code, simulated dataset, reading list