Blog

Evidence-First Supplement Prioritization

Unfair Team • February 5, 2026

The supplement market runs on enthusiasm. Someone posts a transformation story, a podcast host recommends a new compound, and suddenly everyone is buying it. The problem is not that these supplements never work. The problem is that you have limited time, money, and experimental bandwidth, and spending it on a compound with three rat studies and a Reddit thread means you are not spending it on something with twenty human trials and an effect size you can detect in your own data.

Evidence-first prioritization is a decision rule: start with the best-supported compounds. Only move down the evidence ladder after you have exhausted (or ruled out) the options at the top.

The evidence tiers

Not all evidence is equal. Knowing where a supplement sits on this ladder tells you how much confidence to place in it before you run your own trial.

TierWhat the evidence looks likeWhat it means for youExamples
Tier 1: StrongMultiple large RCTs, meta-analyses, or professional society position stands showing consistent benefits at defined dosesHigh probability of a real effect. Start here.Creatine for strength and high-intensity performance 1, caffeine for endurance and alertness 2, psyllium for LDL reduction 3, protein supplementation for resistance training outcomes when intake is low 4
Tier 2: ModerateSome RCTs with positive results, but studies are smaller, results are mixed, or effects depend heavily on population or dosingWorth trying if Tier 1 options for your goal are already in place or ruled out. Expect more variability.Ashwagandha for stress/anxiety 5, L-theanine + caffeine for attention 6, melatonin for sleep onset timing 7, tart cherry for exercise recovery 8
Tier 3: WeakMostly animal data, in vitro studies, anecdotal reports, or small trials with inconsistent resultsLow confidence. Only test if you have strong measurement discipline and accept that a null result is the most likely outcome.Most proprietary "nootropic blends," novel herbal extracts with no published human dose-response data, compounds marketed based on mechanistic plausibility alone

How to use the tiers

The rule is simple: do not move to Tier 2 until you have tested or ruled out the Tier 1 options for your goal. Do not move to Tier 3 until Tier 2 has been explored.

This is not because Tier 2 and 3 supplements never work. Some of them do, for some people. But your time and attention are finite. Starting with the highest-probability options maximizes the chance that your first experiment produces a signal you can act on.

Worked example: Prioritizing for sleep improvement

Suppose your goal is reducing sleep onset latency (falling asleep faster).

Step 1: Identify candidates by tier.

TierCandidateEvidence summaryStudied dose range
Tier 2MelatoninModest but consistent reduction in sleep onset latency in meta-analysis. Best used as a timing signal, not a sedative. 7 90.5-5mg, timed before desired sleep window
Tier 2MagnesiumSome evidence in older adults with low intake and insomnia. Overall evidence is not uniformly strong. 10 11200-400mg (glycinate form for tolerability)
Tier 3GlycineSmall trials suggest improved subjective sleep quality. Limited data.3g before bed
Tier 3ValerianMixed results in meta-analyses. Effect sizes are small and inconsistent.Variable

Notice there is no Tier 1 option for sleep onset. That is fine. It means you start with the best Tier 2 option for your situation.

Step 2: Choose one candidate based on your context.

If your circadian rhythm is shifted (you are a "night owl" who wants to sleep earlier), melatonin is the better first choice because it addresses timing. If your sleep environment and schedule are stable but you suspect low magnesium intake, magnesium is a reasonable first test.

Step 3: Run a structured trial.

Pick one. Test it for the appropriate duration (7-14 nights for melatonin, 3-6 weeks for magnesium). Log sleep onset latency nightly. Compare to your baseline average. Decide keep, adjust, or remove based on the pre-set threshold you defined before starting. 12

Step 4: If the first candidate fails, move to the next.

A null result is not wasted time. It eliminates an option and narrows your search. Return to baseline for a week, then test the next candidate on the list.

How to read evidence without a science degree

You do not need to read full papers to prioritize effectively. Here is what to look for:

Systematic reviews and meta-analyses pool results from multiple studies. If a meta-analysis of 10+ trials shows a consistent positive effect, that is more reliable than any single trial, no matter how impressive the single trial looks.

Position stands from professional organizations (like the International Society of Sports Nutrition or the American College of Gastroenterology) synthesize evidence and make practical recommendations. These are written for practitioners and are usually the most actionable source.

The NIH Office of Dietary Supplements (ODS) fact sheets provide balanced, regularly updated summaries of evidence for individual supplements. They note where evidence is strong, where it is mixed, and where safety concerns exist.

What to watch out for:

Common prioritization mistakes

Skipping Tier 1 because it is "boring." Creatine, protein, and caffeine are not exciting. They are also the most robustly supported performance supplements available. 1 2 4 Novelty is not a prioritization criterion.

Treating all positive studies as equal. A 12-person pilot study and a 500-person meta-analysis are not equivalent evidence. Weight your decisions accordingly.

Ignoring null results. When a well-designed trial shows no effect, that is informative. It means the compound probably does not do what you hoped, at least at that dose for that population. Do not dismiss nulls because they are disappointing.

Confusing "evidence of absence" with "absence of evidence." A Tier 3 supplement may work. It just has not been tested well enough to know. That uncertainty is the reason to deprioritize it, not to dismiss it forever.

Evidence-first prioritization in Unfair

Unfair's recommendation engine ranks supplement candidates by evidence strength for your stated goal. Tier 1 options are presented first, with links to the supporting evidence. Tier 2 options are available but labeled as having more variable evidence. Tier 3 options are deprioritized unless you specifically request them. Your personal trial results are layered on top, so over time your rankings reflect both population-level evidence and your individual response data.

Continue with Top 10 Supplement Myths Debunked, Common Supplement Stack Mistakes to Avoid, and Evaluating AI Supplement Recommendations.

References


  1. Kreider RB, Kalman DS, Antonio J, et al. International Society of Sports Nutrition position stand: safety and efficacy of creatine supplementation in exercise, sport, and medicine. J Int Soc Sports Nutr. 2017;14:18. https://pubmed.ncbi.nlm.nih.gov/28615996/

  2. Guest NS, VanDusseldorp TA, Nelson MT, et al. International society of sports nutrition position stand: caffeine and exercise performance. J Int Soc Sports Nutr. 2021;18:1. https://pubmed.ncbi.nlm.nih.gov/33388079/

  3. Jovanovski E, Khayyat R, Zurbau A, et al. Effect of psyllium (Plantago ovata) fiber on LDL cholesterol and other lipids: a systematic review and meta-analysis. Am J Clin Nutr. 2018. https://pubmed.ncbi.nlm.nih.gov/30239559/

  4. Morton RW, Murphy KT, McKellar SR, et al. A systematic review, meta-analysis and meta-regression of the effect of protein supplementation on resistance training-induced gains in muscle mass and strength in healthy adults. Br J Sports Med. 2018;52:376-384. https://pubmed.ncbi.nlm.nih.gov/28698222/

  5. NIH Office of Dietary Supplements. Ashwagandha: Fact Sheet. https://ods.od.nih.gov/factsheets/Ashwagandha-HealthProfessional/

  6. Camfield DA, Stough C, Farrimond J, Scholey AB. Acute effects of tea constituents L-theanine, caffeine, and epigallocatechin gallate on cognitive function and mood: a systematic review and meta-analysis. Nutr Rev. 2014. https://pubmed.ncbi.nlm.nih.gov/24946991/

  7. Ferracioli-Oda E, Qawasmi A, Bloch MH. Meta-Analysis: Melatonin for the Treatment of Primary Sleep Disorders. PLoS One. 2013;8(5):e63773. https://pubmed.ncbi.nlm.nih.gov/23691095/

  8. Hill JA, Howatson G, van Someren K, et al. Tart Cherry Supplementation and Recovery From Exercise-Induced Muscle Damage: A Systematic Review and Meta-analysis. 2021. https://pubmed.ncbi.nlm.nih.gov/33440334/

  9. National Center for Complementary and Integrative Health (NCCIH). Melatonin: What You Need To Know. https://www.nccih.nih.gov/health/melatonin-what-you-need-to-know

  10. NIH Office of Dietary Supplements. Magnesium: Health Professional Fact Sheet. https://ods.od.nih.gov/factsheets/Magnesium-HealthProfessional/

  11. Abbasi B, Kimiagar M, Sadeghniiat K, et al. The effect of magnesium supplementation on primary insomnia in elderly: a double-blind placebo-controlled clinical trial. J Res Med Sci. 2012;17(12):1161-1169. https://pubmed.ncbi.nlm.nih.gov/23853635/

  12. Vohra S, Shamseer L, Sampson M, et al. CONSORT extension for reporting N-of-1 trials (CENT) 2015 Statement. BMJ. 2015;350:h1738. https://www.bmj.com/content/350/bmj.h1738

Related

Top 10 Supplement Myths Debunked

Supplement myths persist because they contain a grain of plausibility wrapped in a large amount of overstatement

Common Supplement Stack Mistakes to Avoid

Most [supplement stacks](/glossary/supplement-stack) do not fail because someone picked the wrong product

How to Evaluate AI Supplement Recommendations

An AI recommendation is not a prescription