A pilot experiment, pilot study, pilot test or pilot project is a small-scale preliminary study conducted to evaluate feasibility, duration, cost, adverse events, and improve upon the study design prior to performance of a full-scale research project.[1][2]
Implementation
editPilot experiments are frequently carried out before large-scale quantitative research, in an attempt to avoid time and money being used on an inadequately designed project. A pilot study is usually carried out on members of the relevant population.[1] A pilot study is used to formulate the design of the full-scale experiment which then can be adjusted.[1][2] The pilot study is potentially a critical insight to clinical trial design, recruitment and sample size of participants, treatment testing, and statistical analysis to improve the power of testing the hypothesis of the study.[2] Analysis from the pilot experiment can be added to the full-scale (and more expensive) experiment to improve the chances of a clear outcome.[1][2]
Applications
editIn sociology, pilot studies can be referred to as small-scale studies that will help identify design issues before the main research is done. Although pilot experiments have a well-established tradition, their usefulness as a strategy for change has been questioned, at least in the domain of environmental management.[3] Extrapolation from a pilot study to large scale strategy may not be assumed as possible, partly due to the exceptional resources and favorable conditions that accompany a pilot study.[1]
In clinical research, studies conducted in preparation for a future randomized controlled trial are known as "pilot" and "feasibility" studies, where pilot studies are a subset of feasibility studies.[1][4] A feasibility study asks whether the study should proceed, and if so, how. A pilot study asks the same questions, but also has a specific design feature: in a pilot study, a future study is conducted on a smaller scale,[1][5] which, if having produced positive results, may lead to a Phase I clinical trial.[6] The use of pilot and feasibility studies to estimate treatment effect is controversial, with ongoing methodologic discussion about appropriateness.[7]
A checklist was published in 2016 to provide guidance on how to report pilot trials.[8]
In engineering, a pilot trial may be conducted to understand the design problems, learn the correct technique’s or to capture unknown requirements prior to building a prototype. It may use prototype parts or simply samples to see which are successful and which are not, prior to more significant development effort. A pilot can typically be differentiated from a prototype by being significantly different in build, if not in function i.e. it is not intended to be developed into the end product, but to learn how to design and build the end product successfully.
See also
editReferences
edit- ^ a b c d e f g Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, et al. (January 2010). "A tutorial on pilot studies: the what, why and how". BMC Medical Research Methodology. 10 (1): 1. doi:10.1186/1471-2288-10-1. PMC 2824145. PMID 20053272.
- ^ a b c d Lewis M, Bromley K, Sutton CJ, McCray G, Myers HL, Lancaster GA (February 2021). "Determining sample size for progression criteria for pragmatic pilot RCTs: the hypothesis test strikes back!". Pilot and Feasibility Studies. 7 (1): 40. doi:10.1186/s40814-021-00770-x. PMC 7856754. PMID 33536076.
- ^ Billé R, Duchemin B (February 2010). "Action without change? On the use and usefulness of pilot experiments in environmental management". SAPIEN. Surveys and Perspectives Integrating Environment and Society. 4 (1).
- ^ Leon AC, Davis LL, Kraemer HC (May 2011). "The role and interpretation of pilot studies in clinical research". Journal of Psychiatric Research. 45 (5): 626–629. doi:10.1016/j.jpsychires.2010.10.008. PMC 3081994. PMID 21035130.
- ^ Eldridge SM, Lancaster GA, Campbell MJ, Thabane L, Hopewell S, Coleman CL, Bond CM (2016). "Defining Feasibility and Pilot Studies in Preparation for Randomised Controlled Trials: Development of a Conceptual Framework". PLOS ONE. 11 (3): e0150205. Bibcode:2016PLoSO..1150205E. doi:10.1371/journal.pone.0150205. PMC 4792418. PMID 26978655.
- ^ "The drug development process: Step 3: Clinical research". US Food and Drug Administration. 4 January 2018. Retrieved 29 March 2021.
- ^ Sim J (December 2019). "Should treatment effects be estimated in pilot and feasibility studies?". Pilot and Feasibility Studies. 5 (1): 107. doi:10.1186/s40814-019-0493-7. PMC 6712606. PMID 31485336.
- ^ Eldridge SM, Chan CL, Campbell MJ, Bond CM, Hopewell S, Thabane L, Lancaster GA, et al. (PAFS Consensus Group) (October 2016). "CONSORT 2010 statement: extension to randomised pilot and feasibility trials". BMJ. 355: i5239. doi:10.1136/bmj.i5239. PMC 5076380. PMID 27777223.