• Home
  • Health & Wellness
  • Disclaimer
    • Terms of Use
    • Privacy Policy
    • DMCA Notice
Podcast
  • Home
  • Health & Wellness
  • Disclaimer
    • Terms of Use
    • Privacy Policy
    • DMCA Notice
24/7 Health News
No Result
View All Result
Home Article

Psychedelic drugs: how to tell good research from bad

September 26, 2022
in Article
0

Research with psychedelic drugs has made a dramatic comeback amid a heady mix of softening societal attitudes, the lure of commercial opportunity, misgivings about the “war on drugs”, and the desire to develop new ways to treat mental health conditions.

So you might have read in the media that there’s a new study which shows that ketamine can banish depression, or psilocybin is effective at treating post-traumatic stress disorder, or microdosing LSD makes you more creative.

In this fervour, which research is worth your time and, more importantly, your trust? Of course, what’s worth your time depends on what you want.

I’m a doctor, a drug researcher and a clinical trialist. As such, I’m interested in whether psychedelic therapy can be a new form of medicine. That question needs clinical trial evidence. That’s what I’ll be concentrating on here, although some of the principles apply to medical research more broadly.

Table of Contents

  • Journals
  • Authors
  • Data
  • Large trials
  • Pre-registering

Journals

First, your source. Good scientific research is published in peer-reviewed scientific journals. Peer reviewed means that independent experts have read and anonymously criticised the paper. This is an important form of scrutiny. If the journal you’re looking at does not support peer reviewing, move on.

Some journals claim to be high-quality enterprises, publishing peer-reviewed articles but are actually pop-up money-making schemes that publish anything.

Spotting these is a bit like spotting a spam email or social media post. Poor grammar, spelling and formatting mistakes, substandard websites and too-good-to-be-true statements are all telltale signs of a journal that wouldn’t let the truth get in the way of a good publishing fee.

In contrast, good quality journals are generally long established, are indexed in scientific databases such as PubMed, and usually have good “impact factors” (a measure of how often the journals’ papers are cited). While this isn’t a perfect metric, it is useful as a guide, and it will be stated on the journal’s homepage. A higher number is more reassuring.

With a good quality journal, you’re halfway there.

Authors

Before you read anything about the paper, look to see who the authors are, where they work and what their disclosures and funding sources are (this is usually stated at the end of an article). Authors who are top of their field often have great reputations.

But they also have more to lose by results that don’t fit their theories. They are more likely to be paid consultants for companies seeking to commercialise new treatments, too.

Similarly, just because a study comes from a pioneering, high-quality institution doesn’t mean you should blindly trust it. In fact, those very teams that were the pioneers are precisely the ones who might also be heavily biased. Put another way, why would we have got into such a stigmatised field if we didn’t hold a strongly positive preconception?

That said, institutions and research teams with good reputations earn them because their peers respect their methods and believe their results. So, overall, go for the most well-respected authors, but have in the back of your mind the other factors at play.

Data

Now take a look at the paper itself. For clinical research, the multi-centre, randomised, placebo-controlled trial is king. Almost all psychedelic research is not this (yet).

Initial trials take place in one institution. That’s fine, but it doesn’t say anything about whether the treatment works beyond that institution. For that, you need a multi-centre trial. The more centres, the better.

If it works in lots of centres, there’s more reason to believe it’ll work in the real world. This is called “generalisation”, and it’s an unanswered question for psychedelics.

Randomised and placebo-controlled refer to the participants being randomly allocated to two or more groups, one of which is treated with a placebo (dummy pill). Unless you have a placebo control group to compare with, you don’t know if the effect you observe in the treatment group might not have happened anyway.

Similarly, if there is no randomisation, then any effect you observe might be due to something else common to one of the groups.

Early psychedelics trials were often not randomised or controlled. That’s fine, but you can’t conclude much from these “pilot studies”. They just show that the research can be done.

Large trials

The more participants a trial has, the more “statistical power” it has to detect a true effect (or a true absence of an effect). This often needs hundreds, even thousands, of participants.

These trials cost a lot, which is why many large-scale clinical trials are funded by companies – it’s the only way to raise the money to get the trial done. But don’t dismiss commercial trials.

Yes, profit and healthcare aren’t easy bedfellows. But commercial trials are far more heavily regulated than non-commercial trials. Almost all the medicines we have today were licensed based on commercial trials.

Pre-registering

All clinical trials should have a “pre-registered primary outcome”. The primary outcome can be anything: a blood test result, a neuroimaging finding, or a measure of depression. It is that outcome that the trial is designed around.

Pre-registering happens on websites like clinicaltrials.gov before the trial starts. If the researchers haven’t pre-registered their hypothesis, their primary outcome measure and their methods of analysis, then they could have cherrypicked the results you’re reading.

Put another way, if you torture your data hard enough, it will tell you whatever you want. This is one of the great research sins.

If I flip a coin ten times, then keep doing that again and again, at some point I’ll get ten heads, just by chance. It’s the same principle here. The more measures I put in a trial, and the more ways I choose to analyse the data, the more likely I’ll get a “significant” result.

A final thought before you go. No one clinical trial or piece of research can tell you anything for certain. The more a result is replicated, the more believable it becomes.

The Conversation

James Rucker receives funding from the National Institute for Health Research, Compass Pathfinder, Beckley PsyTech and the Multidisciplinary Association for Psychedelic Studies.

ShareTweetSharePin
Previous Post

Transgender men and nonbinary people are asked to stop testosterone therapy during pregnancy – but the evidence for this guidance is still murky

Next Post

Four health conditions linked to gum disease

Next Post
Four health conditions linked to gum disease

Four health conditions linked to gum disease

Most Read

What causes stuttering? A speech pathology researcher explains the science and the misconceptions around this speech disorder

What causes stuttering? A speech pathology researcher explains the science and the misconceptions around this speech disorder

December 15, 2022
morning back pain

Morning Again Ache Trigger Is Not the Mattress

October 11, 2021
lower back pain relief exercises

5 decrease again ache aid workouts

October 11, 2021
3 years after legalization, we have shockingly little information about how it changed cannabis use and health harms

3 years after legalization, we have shockingly little information about how it changed cannabis use and health harms

October 15, 2021
Nasal vaccines promise to stop the COVID-19 virus before it gets to the lungs – an immunologist explains how they work

Nasal vaccines promise to stop the COVID-19 virus before it gets to the lungs – an immunologist explains how they work

December 14, 2022
bleeding in gum

When The Bleeding in gum Is Severe ?

October 11, 2021
Good Night Sleep

6 Causes of Good Evening Sleep

October 11, 2021

COVID vaccines: how one can pace up rollout in poorer international locations

October 5, 2021
Ten small changes you can make today to prevent weight gain

Ten small changes you can make today to prevent weight gain

October 12, 2021
Support and collaboration with health-care providers can help people make health decisions

Support and collaboration with health-care providers can help people make health decisions

December 16, 2021
Greece to make COVID vaccines mandatory for over-60s, but do vaccine mandates work?

Greece to make COVID vaccines mandatory for over-60s, but do vaccine mandates work?

December 1, 2021

Multiple sclerosis: the link with earlier infection just got stronger – new study

October 12, 2021
News of war can impact your mental health — here’s how to cope

Binge-eating disorder is more common than many realise, yet it’s rarely discussed – here’s what you need to know

December 2, 2022
Nurses’ attitudes toward COVID-19 vaccination for their children are highly influenced by partisanship, a new study finds

Nurses’ attitudes toward COVID-19 vaccination for their children are highly influenced by partisanship, a new study finds

December 2, 2022
Kick up your heels – ballroom dancing offers benefits to the aging brain and could help stave off dementia

Kick up your heels – ballroom dancing offers benefits to the aging brain and could help stave off dementia

January 3, 2023
How hot is too hot for the human body? Our lab found heat + humidity gets dangerous faster than many people realize

How hot is too hot for the human body? Our lab found heat + humidity gets dangerous faster than many people realize

July 6, 2022
The promise of repairing bones and tendons with human-made materials

The promise of repairing bones and tendons with human-made materials

January 4, 2022
As viral infections skyrocket, masks are still a tried-and-true way to help keep yourself and others safe

As viral infections skyrocket, masks are still a tried-and-true way to help keep yourself and others safe

December 14, 2022
How regulatory agencies, not the courts, are imposing COVID-19 vaccine mandates

How regulatory agencies, not the courts, are imposing COVID-19 vaccine mandates

October 24, 2021
Heart disease risk from saturated fats may depend on what foods they come from – new research

Heart disease risk from saturated fats may depend on what foods they come from – new research

November 29, 2021
Late night eating may cause greater weight gain – new research points to why

Late night eating may cause greater weight gain – new research points to why

October 12, 2022

10 Things I Learned During My Body Transformation

October 12, 2021

7 Health Benefits of Sweet Potatoes

October 12, 2021
Nobel prize: how chilli peppers helped researchers uncover how humans feel pain

Nobel prize: how chilli peppers helped researchers uncover how humans feel pain

October 12, 2021
How air filters can make COVID wards safer for patients and staff

How air filters can make COVID wards safer for patients and staff

December 1, 2021
GPs don’t give useful weight-loss advice – new study

GPs don’t give useful weight-loss advice – new study

December 16, 2022
Four ways to avoid gaining weight over the festive period – but also why you shouldn’t fret about it too much

Four ways to avoid gaining weight over the festive period – but also why you shouldn’t fret about it too much

December 22, 2022
Five ways to avoid pain and injury when starting a new exercise regime

Five ways to avoid pain and injury when starting a new exercise regime

December 30, 2022
Why suicide prevention support is crucial for people with fetal alcohol spectrum disorder

Why suicide prevention support is crucial for people with fetal alcohol spectrum disorder

September 28, 2022
Too hot to handle: Climate considerations for youth sport during the hottest years on record

Too hot to handle: Climate considerations for youth sport during the hottest years on record

July 19, 2022
  • Home
  • Health & Wellness
  • Disclaimer

© 2020 DAILY HEALTH NEWS

  • Home
  • Health & Wellness
  • Disclaimer
    • Terms of Use
    • Privacy Policy
    • DMCA Notice

© 2020 DAILY HEALTH NEWS