• Enter what you want to find and click OK Search

Pilot studies (feasibility studies)

You must cite this article if you use its information in other circumstances. An example of citing this article is:
Ronny Gunnarsson. Pilot studies (feasibility studies) [in Science Network TV]. Available at: https://science-network.tv/pilot-studies/. Accessed March 19, 2024.
Suggested pre-reading What this web page adds
  1. Study design
  2. Inferential statistics
  3. Effect size
This web-page will give you an understanding of what pilot studies (feasibility studies) are. It will also clarify the difference between a planned pilot study and an underpowered study.
Chief investigators in a pilot study? Photo by Alex Pereslavtsev

This page aim to clarify the difference between a pilot study and other studies. This discussion is most often relevant in relation to studies taking on an empirical-atomistic approach aiming to evaluate the effect of a drug or any other intervention. However, it can be used also for observational studies. The rest of this page will focus the discussion to the situation of pilot studies preparing the way for a larger study to establish effect of an intervention.

It is a common misconception that small underpowered studies trying to prove effect of an intervention compared to placebo or another intervention are pilot studies . This is not true. If they aim to prove effect and are underpowered it means that they either failed to recruit participants up to their pre-calculated target or it was simply a badly designed study, not a pilot study. A pilot study aim to answer questions such as:

  1. Will a large or small proportion of individuals asked to participate accept participation? Will randomisation make potential participants to hesitate?
  2. Will the measurement of effect be practical and feasible? Which survey is suitable in this situation? Should a new survey tool be constructed?
  3. Is the intervention reasonably easy to apply given the resources we could expect to have in a larger study?
  4. Will a large or small proportion of patients drop out of the study for various reasons?
  5. What level of random variability and rough changes or effects can be seen after intervention? (to be used as a basis for sample size estimation before the larger adequately powered study)
  6. How common are unforeseen problems (that may warrant exclusion of a patient or worse termination of the study)?

A pilot study aim to provide answers to some or all of these questions but is not powered to answer the big question is there an effect of the intervention. Hence, the reporting of a true pilot study should completely refrain from trying to reject a null hypothesis concerning possible effect of the studies intervention. Effect size may be calculated only to serve as a guide for a sample size calculation before the final study.

Pilot study“The real thing”
Sample size calculation before data collectionRarely (see below)Should always be done
Number of included participantsUsually very smallUsually fairly large
RandomizationOften if it is an interventional studyShould be done if the focus is to evaluate effect of something
Aim to establish effectNever ! (but may make a preliminary estimation of effect size to inform a sample size calculation for the final study.)Establishing / comparing effect is the main aim (may include superiority, equivalence and non-inferiority trials)
Aim to establish practical feasibilityClarifying the practical feasibility is the main aim of a pilot studyPractical feasibility should be sorted out before the real study is done.
Inferential statistics usedIs only done to inform a sample size calculation for the coming final study.Should always be used to answer the research questions.

Sample size in pilot studies

Various recommendations point to a number between 10-50 or higher. However, a proper sample size calculation can only be done for research question VI above . There is no sensible way to make a proper sample size calculation for research question I-V.

Effectiveness and efficacy

Efficacy is a measure of effect of the intervention under ideal circumstances while effectiveness is a measure of the effect if implemented in reality. Pilot studies does not aim to estimate efficacy or effectiveness.

References

1.
A simple formula for the calculation of sample size in pilot studies - ScienceDirect [Internet]. [cited 2019 Feb 1]. Available from: https://www.sciencedirect.com/science/article/pii/S0895435615003030
1.
Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, et al. A tutorial on pilot studies: the what, why and how. BMC Medical Research Methodology [Internet]. 2010 Jan 6;10:1. Available from: https://doi.org/10.1186/1471-2288-10-1

Comments are closed.