Delphi MethodSoftwareHealthcareComparison

Delphi Study in REDCap: What Works and What You Build Yourself

•5 min read

If you work at a university hospital or medical faculty, your institution very likely runs REDCap, and someone has probably suggested you "just do the Delphi in REDCap". That's a reasonable starting point: many published consensus studies, especially core outcome sets and clinical guideline panels, were run in it. But REDCap is a general data capture system, not a Delphi tool, and the difference shows up between rounds. This guide covers what running a Delphi study in REDCap actually involves, which parts you build yourself, and when a dedicated Delphi platform saves you more time than it costs.

Can You Run a Delphi Study in REDCap?

Yes. REDCap (Research Electronic Data Capture) is developed at Vanderbilt University and is free for non-profit institutions that join the REDCap Consortium, which has thousands of member institutions in more than 150 countries. Each institution hosts its own instance, so data stays on institutional servers and your local REDCap team handles accounts, API tokens and add-ons.

For a Delphi study, REDCap does the same things well that make it popular in clinical research:

  • Survey instruments — Likert scales (including the 1–9 scale common in core outcome set studies), free-text comment fields and branching logic
  • Participant management — participant lists, personalised survey links, automated invitations and reminders
  • Audit trail and data governance — everything stays inside your institution's approved system, which matters for ethics committees and data protection officers
  • Export to statistics packages — SPSS, R, Stata, SAS and CSV
  • Researchers often pick REDCap for exactly these reasons: security, compliance and solid support for repeated survey waves.

    What REDCap Doesn't Do for a Delphi Study

    The Delphi method rests on controlled feedback: after each round, panelists see the anonymised group response and can reconsider their rating. REDCap has no built-in concept of Delphi rounds, consensus or feedback, so this is where the manual work sits.

  • Feedback between rounds — you export round 1, calculate medians, IQRs and percentage agreement in Excel, R or SPSS, then rebuild those numbers into the round 2 instrument, typically as descriptive text or piped fields per statement. Some institutions offer community-developed add-ons for displaying Delphi responses, but availability depends on your local REDCap team.
  • Consensus calculation — there's no place to define a rule like "75 % rate 7–9 and IQR ≤ 1". You apply it yourself, statement by statement, after every round.
  • Carrying items forward — statements that reached consensus have to be removed and the rest re-entered for the next round, usually by duplicating and editing the instrument.
  • Stability between rounds — tracking whether individual ratings changed means merging exports and matching records by hand.
  • Reporting — the CREDES guideline expects results per round, changes between rounds and a transparent account of how consensus evolved. In REDCap you assemble those tables and charts from raw exports.
  • None of this is impossible. For a small panel, 30 statements and two rounds, it's a few long evenings per round. For 80 statements, three rounds and several stakeholder groups, the analysis between rounds becomes the bottleneck of the whole study, and every manual step is a place where an error can slip into published consensus results.

    What a Dedicated Delphi Tool Adds

    A Delphi platform is built around exactly the parts REDCap leaves to you. In Durvey, for example:

  • Consensus rules per scale — you define the threshold once (for example 75 % within the agreeing range and IQR ≤ 1) and every statement is reported against it, round by round
  • Automatic feedback — panelists see the anonymised group result per statement, either immediately (real-time Delphi) or when the next round opens (multi-round Delphi)
  • Agreement metrics computed for you — IQR, percentage agreement and stability between rounds, plus comparisons between stakeholder groups such as clinicians and patients
  • Exports for publication — consensus statistics, group comparisons and comments per round as Excel, and a report as PDF, Word or PowerPoint
  • Data protection — servers in Germany, GDPR-compliant, with anonymous participation possible
  • The trade-off is straightforward: REDCap is free for your institution and already approved, while a Delphi tool is an additional licence. The real question is whether the hours saved between rounds, and the lower risk of calculation errors, are worth more than that licence.

    REDCap or a Delphi Tool: How to Decide

    REDCap is usually enough if:

  • your study has two rounds and a manageable number of statements
  • you're comfortable calculating consensus statistics in R, SPSS or Excel and have time between rounds
  • your ethics approval or data governance requires all data to be collected in the institutional REDCap
  • the Delphi is one part of a larger REDCap project, for example linked to patient-level data
  • A dedicated Delphi tool usually pays off if:

  • you plan three or more rounds, a large item pool or several stakeholder panels
  • you want a real-time Delphi, where experts see group results immediately and the study finishes in weeks rather than months
  • you're working on a thesis or grant with a fixed deadline and can't afford long gaps between rounds
  • you need round-by-round reporting for CREDES or a journal submission without rebuilding every table by hand
  • Using Both: Delphi Tool for the Rounds, REDCap as the Data Home

    For many clinical teams it isn't either-or. A practical setup runs the Delphi process in a dedicated tool and keeps REDCap as the institutional record:

  • Recruitment and screening in REDCap — eligibility questionnaires, consent and panel demographics stay in your existing project
  • Rounds, feedback and consensus in the Delphi tool — panelists answer in the Delphi survey, and consensus is calculated automatically
  • Results back into REDCap — export the final ratings and consensus statistics as Excel, save them as CSV and load them into your REDCap project with the Data Import Tool, using the import template REDCap generates for your instruments
  • Before you commit, check two things with your REDCap team and data protection officer: whether collecting expert ratings outside REDCap fits your ethics approval (expert panels usually involve no patient data, which makes this easier), and which variables should end up stored in REDCap.

    Bottom Line

    REDCap is an excellent data capture system and a legitimate way to run a simple Delphi study, especially if your institution requires it. What it doesn't do is the Delphi-specific work: feedback, consensus rules, round management and round-by-round reporting. The more rounds, statements and stakeholder groups your study has, the more that work costs you, and the more a dedicated Delphi platform earns its place alongside REDCap rather than instead of it.

    Frequently asked questions

    Can you run a Delphi study in REDCap?
    Yes. Many published Delphi studies, especially in clinical research, were run in REDCap. It handles survey instruments, participant invitations and reminders well, but feedback between rounds, consensus calculation and round management have to be done manually or with add-ons your institution may offer.
    Is REDCap free?
    REDCap is free for non-profit institutions that join the REDCap Consortium and host it themselves. For-profit organisations cannot hold a licence, so researchers usually access it through their university or hospital.
    Does REDCap calculate Delphi consensus automatically?
    Not natively. You export each round and calculate medians, IQRs and percentage agreement in Excel, R or SPSS, then apply your consensus rule statement by statement.
    Can I use Durvey and REDCap together?
    Yes. A common setup keeps recruitment and consent in REDCap, runs the Delphi rounds in Durvey, and imports the exported results into REDCap with its Data Import Tool. This currently works via file export rather than a direct connection.

    Continue Learning in Delphi Academy

    Dive deeper into these topics with our comprehensive guides:

    Ready to Implement Your Delphi Study?

    Our platform streamlines every step of the Delphi process—from expert recruitment to automated statistical analysis and report generation.

    Related Articles