Delphi MethodResearch MethodsBest PracticesAcademic Writing

How to Write a Delphi Study Protocol Before You Start

•4 min read

A Delphi study protocol is not a formality — it's the document that makes your study replicable, your methods chapter defensible, and your consensus claims credible. Everything reviewers and examiners will scrutinize most closely — your expert definition, your consensus threshold, your stopping rule — should exist in writing before Round 1 opens. Writing it afterward is the single most reliable way to invite a major revision.

What a Protocol Is (and Isn't)

A Delphi study protocol is a pre-registered record of how the study will be run: who qualifies as a panelist, what rounds will cover, how feedback will be structured, and what counts as consensus. It's not a detailed methods chapter — that comes later, drawing from the protocol. The protocol is the plan; the methods chapter is the record of what happened.

In clinical research, protocols are formally registered before data collection begins. For academic thesis research, a written protocol filed with your supervisor before recruitment starts serves the same function: it prevents anyone from claiming you designed the study to fit the results.

Research Question and Study Purpose

The protocol opens with a clear statement of what the study is designed to do. Not "to explore expert opinion on X" — that's too vague to anchor any design decision. A usable protocol statement specifies what the study output will be: a priority-ranked list, a set of validated standards, a consensus-based definition, a forecast, or a set of clinical recommendations. This statement determines everything that follows.

Expert Definition and Inclusion Criteria

Write your expert definition before recruiting. It should specify:

  • The domain expertise required (field, specialty, role type)
  • The minimum level of experience (years of practice, seniority, publication record, committee membership)
  • Any exclusion criteria (conflicts of interest, insufficient familiarity with the specific question)
  • Whether patient or stakeholder representatives will be included alongside domain experts
  • A vague definition like "experts in the field" is not a definition — it's a gap that reviewers will flag immediately.

    Panel Size and Recruitment Strategy

    Specify your target panel size and your rationale. State whether you'll use purposive, snowball, or criterion-based sampling, and why the chosen approach fits your expert population. Include your attrition buffer — how many more panelists you'll recruit than your minimum target.

    Questionnaire Development

    Describe how Round 1 items will be generated — from literature review, prior qualitative research, expert interviews, or a combination. State whether Round 1 will be open-ended (generating items) or structured (rating predefined items). Describe how items will be piloted before distribution.

    Round Procedure

    For each round, specify:

  • How the questionnaire will be distributed (platform, email)
  • The response window (how many days each round stays open)
  • How reminders will be sent and how many
  • What information will be fed back between rounds (aggregate distribution, minority reasoning, or both)
  • How feedback summaries will be prepared and by whom
  • Consensus Threshold and Stopping Rule

    This is the most critical section of the protocol. State:

  • Your consensus metric (percentage agreement, IQR, or other)
  • Your threshold value (e.g., 70% agreement, IQR ≤1.5)
  • Your stability criterion (e.g., <15% of panelists shifting by more than one point between rounds)
  • Your stopping rule (consensus reached, stability achieved, or maximum rounds completed)
  • All three must be defined here. Defining any of them after seeing data is considered post-hoc and will not survive peer review or a viva examination.

    Ethics and Data Protection

    State whether ethics approval is required for your study, which body would grant it, and how you will handle: informed consent, anonymity of panelist responses, data storage and retention, and GDPR compliance if any panelist is based in the EU. If your institution's ethics board determines approval is not required for expert surveys, note that determination explicitly.

    Timeline

    Include a realistic round-by-round timeline covering: recruitment period, each round's open period, analysis and feedback preparation periods, and the target date for final consensus determination. A timeline that doesn't account for recruitment time and between-round analysis is the most common cause of thesis timeline failure.

    Where to File It

    For thesis research: file it with your supervisor before recruiting. For journal research: consider pre-registering on OSF (Open Science Framework) or equivalent. For clinical research: register on a clinical trials registry before data collection. The act of filing it before recruitment is what distinguishes a prospective protocol from a retrospective description.

    Continue Learning in Delphi Academy

    Dive deeper into these topics with our comprehensive guides:

    Ready to Implement Your Delphi Study?

    Our platform streamlines every step of the Delphi process—from expert recruitment to automated statistical analysis and report generation.

    Related Articles

    Delphi MethodResearch Methods

    Delphi Consensus Protocol: When Is Consensus Reached?

    A Delphi consensus protocol fixes, before Round 1, exactly when a statement counts as agreed, when the study stops, and what happens to the items that never get there. Here is what goes into it and how to write it so that reviewers accept the consensus claim.

    6 min read•
    How to Write a Delphi Study Protocol Before You Start | Durvey