Reading Early-Stage Research: Animal Studies, Small Trials and Preprints

Why early results need care

New health ideas usually start in a laboratory. Most never reach the clinic: the FDA reports that thousands of compounds may be candidates at the start, and after early testing only a small number look promising. [1] This page explains how to read the four kinds of early evidence you will see most often. It is education, not personal medical advice. Evidence labels are explained in how we label evidence.

Cell and animal studies

These are called preclinical studies, in vitro (cells) and in vivo (animals). [2] They help decide whether something is worth testing in people and what may be harmful. The FDA says preclinical research is not a substitute for studies of how a drug interacts with the human body. [3]

A systematic review looked at treatments where human trials had already given clear answers. Corticosteroids helped in animal models of head injury but not in trials, and tirilazad improved animal stroke outcomes but was associated with worse outcomes in patients. [4] So the right wording for a mouse result is "in mice", never "in people". Our label is preclinical (cells/animals only).

Small trials

Small early trials are useful for safety and ideas, but they are easy to overread. The FDA notes that Phase 2 studies, usually a few hundred patients, are not large enough to show whether a drug will be beneficial. [3] Across 93 meta-analyses, effects averaged 48% larger in trials with fewer than 50 patients than in trials of 1,000 or more. [5] Among 49 highly cited clinical studies, 16% were later contradicted and another 16% had found stronger effects than later studies; contradicted or stronger results were more often seen in smaller trials. [6]

Questions to ask: How many people took part? Was there a comparison group, such as a placebo or standard treatment? Were people assigned at random and kept unaware of which they received? [7] Was the study repeated by others?

Preprints

A preprint is a research report shared before independent journal review. [8] In one study of bioRxiv and medRxiv preprints that later appeared in journals, the conclusions in 7.2% of non-COVID-19 abstracts and 17.2% of COVID-19 abstracts changed in a discrete way by publication, though most changes did not alter the paper's overall conclusions. [8] Treat a preprint as a draft: read it for ideas, but do not base health decisions on it.

Stand-in measures

A study may report a blood level or scan result rather than how people feel or live. In oncology, more than half of 65 reported links between such stand-ins and survival were of low strength. [9] Prefer studies that measure outcomes you would notice.

A quick checklist

• Who was studied: cells, animals or people like you?
• How many, for how long, compared with what?
• Was the outcome a feeling or event, or only a lab marker?
• Has it been published after review, and repeated?
• Who paid for it, and who is selling something?
• Does a regulator or a systematic review say anything on it?

A quick note on sources: a regulator's page or a systematic review carries more weight than a single study. See research and safety sources and evaluating safety claims.

Safety first

An exciting early result is not a reason to start, stop or change a medicine or supplement. Talk with a clinician first, and see what counts as emerging wellness science.