Table 1 Characteristics of included studies with MMAT quality assessment results

From: A systematic review of early evidence on generative AI for drafting responses to patient messages

Study, year

(article type other than full paper)

Study design

MMAT category of study designs

MMAT methodological quality criteria

1

2

3

4

5

Athavale et al.54, 2023

Cross-sectional evaluation study

Quantitative descriptive

Y

N

Y

Y

Y

Nov et al.43, 2023

Cross-sectional survey study

Quantitative descriptive

Y

Y

Y

Y

Y

Afshar et al.38, 2024

(Brief communications)

Pre-post quasi-experimental study

Quantitative non-randomized

CT

Y

Y

Y

Y

Baxter et al.44, 2024

(Perspective)

Retrospective qualitative evaluation study

Qualitative

Y

Y

Y

Y

Y

Chen et al.55, 2024

(Comment)

Two-stage observational study

Quantitative non-randomized

N

Y

Y

N

Y

English et al.39, 2024

(Research letter)

Prospective quality improvement study

Quantitative descriptive

Y

CT

Y

N

Y

Garcia et al.31, 2024

Prospective quality improvement study

Mixed methods

Y

Y

Y

Y

Y

Kim et al.45, 2024

(Research letter)

Cross-sectional survey study

Quantitative non-randomized

N

Y

Y

Y

Y

Liu et al.46, 2024

Model development and evaluation

Quantitative non-randomized

N

Y

Y

N

Y

Reynolds et al.47, 2024

Cross-sectional evaluation study

Quantitative non-randomized

N

Y

Y

N

Y

Robinson et al.48, 2024

Cross-sectional survey study

Quantitative non-randomized

N

Y

Y

N

Y

Scott et al.49, 2024

Cross-sectional evaluation study

Quantitative non-randomized

N

Y

Y

Y

Y

Small et al.40, 2024

Cross-sectional quality improvement study

Quantitative non-randomized

N

Y

Y

N

Y

Soroudi et al.50, 2024

Cross-sectional survey study

Quantitative non-randomized

N

Y

Y

Y

Y

Tai-Seale et al.32, 2024

Modified waiting list randomized quality improvement study

Quantitative randomized controlled trials

Y

Y

Y

N

Y

Tailor et al.56, 2024a

Cross-sectional evaluation study

Quantitative descriptive

Y

N

Y

Y

Y

Tailor et al.57, 2024b

Cross-sectional evaluation study

Quantitative non-randomized

CT

Y

Y

N

Y

Yan et al.41, 2024

Prospective quality improvement study

Quantitative non-randomized

N

Y

Y

N

Y

Cavalier et al.58, 2025

Survey-based factorial experiment study

Quantitative non-randomized

N

Y

Y

Y

Y

Hao et al.51, 2025

Retrospective observational study

Quantitative descriptive

Y

CT

Y

Y

Y

Hong et al.42, 2025

Framework development and evaluation

Quantitative non-randomized

N

Y

Y

N

Y

Kaur et al.52, 2025

Cross-sectional survey study

Quantitative non-randomized

CT

Y

Y

Y

Y

Tse et al.53, 2025

(Research letter)

Cross-sectional evaluation study

Quantitative descriptive

Y

N

Y

Y

Y

  1. Y Yes, N No, CT Can’t tell.