Hold control (command on a Mac) and press the + key as many times as necessary to increase the font size.
Hold control (command on a Mac) and press the - key to reduce the font size. - hide

Deciphering Scientific Studies: Join the "Journal Club"!

This article originally appeared in the Graves’ Disease & Thyroid Foundation’s Winter-Spring 2018 Newsletter.

You’ve probably flipped through articles in a popular fitness magazine – or seen links to studies in your social media feed – promising a blockbuster treatment for a particular disease or touting the latest supplement that’s supposed to be good for you.

But do you know how to critically interpret this information?

During an October 2017 patient seminar co-hosted by the GDATF and Massachusetts Eye and Ear, Dr. Suzanne Freitag, Director of the Ophthalmic Plastic Surgery Service at Mass. Eye and Ear presented “Clinical Trials for Thyroid Eye Disease: Deciphering the Data.”

Dr. Freitag joked that while other people join book clubs for fun, doctors have “Journal Clubs” to review and dissect the latest medical research. If you want to become a truly savvy consumer of medical information, consider the following when interpreting research findings.

Size of the Study. It’s important to note the size and population of the study, as studies with only a small group of participants might not be accurate or able to be replicated in a larger group.

Reproducability is considered necessary before a particular medication or protocol becomes standard practice. For example, a study out of Europe has suggested that selenium can have a beneficial impact on the course of mild thyroid eye disease. However, the study was conducted in areas where there may be lower selenium levels than in North America. Hence further studies in the United States will be helpful to determine if there is a benefit in our patients as well.

Study Design. Dr. Freitag noted that managed care companies are now selling databases, although they cannot sell private patient information. The advantage of this is that researchers can potentially benefit by data mining to draw conclusions based on information from many thousands of patients. However, the downside is that the underlying data uses medical billing codes as opposed to confirming a diagnosis and other details via patient medical record notes or direct patient interaction. We need to understand the source of the data in the studies we read so that we can anticipate potential biases.

In randomized, controlled trials, considered the “gold standard” of study design, participants are randomly assigned to separate groups. One group receives the treatment being tested while others receive a “placebo” (inactive) substance or another drug. In a double-blind study, neither participants nor researchers know which person has been assigned to which group.

In evaluating results, consider differences between the study groups. For example, in studies evaluating thyroid eye disease treatments, smokers tend to have more severe disease and often do not respond as well to treatment as nonsmokers. Patients whose thyroid function tests are normal and stable tend to have less risk of thyroid eye disease than those with levels that are hyperthyroid or hypothyroid. Patients who have thyroid eye disease that is in the active phase will likely respond better to potential treatment options than those who are in the chronic or inactive phase. If these characteristics are not well “matched” between groups, then this bias could impact the validity of the study results and conclusions.

Safety. Dr. Freitag noted the importance of checking adverse events in any study, as safety is critical.

Financial Bias. Always check to see who is providing funding for the study and what the potential conflicts of interest are for the authors. There can be unconscious bias or, hopefully rarely, intentional bias in cases where people serve to gain from certain study outcomes.  These potential sources of conflict are required to be disclosed by the authors of the paper when it is published in a peer reviewed, reputable medical journal.

Finally, always consider the credibility of the source. Articles that appear in peer-reviewed journals have been subjected to a quality review by a panel of experts prior to publication.  If the information comes from a lay (non-medical) publication either on paper or the internet, consider whether the source material was interpreted correctly. Some popular publications will have medical articles reviewed by a doctor, but this is not always the case. In fact, the GDATF was excited to receive an email with information about a thyroid eye disease article appearing in a popular fitness magazine. That is, until we pulled up the article online and found that it stated that radioactive iodine (RAI) was the treatment for bulging eyes due to thyroid eye disease! In fact, RAI is not a treatment for TED – and can actually increase the risk that the eye disease will worsen! The magazine corrected the article after we contacted them, but it’s a good reminder to read all medical articles – no matter where they appear – with a critical eye.

And who knows – maybe you’ll get inspired to start your own “Journal Club”!

Newsletter article © Copyright Graves’ Disease & Thyroid Foundation. All rights reserved.

Download as a PDF.

Recent News

Recent Forum Posts

  • 20 years post RAI, suddenly hyper on same dose Syn

    April 8, 2021, 12:26 p.m.

    Hello and welcome - as you noted, patients do often need tweaks in dosage as they age. Another thought is...

  • Graves Disease and Radioactive Iodine Treatment

    April 7, 2021, 1:36 p.m.

    That's Great Samantha. Good Luck with school!

  • New TED diagnosis

    April 7, 2021, 1:22 p.m.

    Are they treating your thyroid? TED doesn't just happen by itself. It's usually related to issues such as...

  • 20 years post RAI, suddenly hyper on same dose Syn

    April 7, 2021, 1:18 p.m.

    Graves diagnosis 1997, age 37, tx RAI. After adjustment period, Synthroid level stable with brief periods of...

  • New TED diagnosis

    April 1, 2021, 10:48 a.m.

    Just a note that this is very individual. The GDATF hosted a recent webinar on long-term use of antithyroid...

  • New TED diagnosis

    March 31, 2021, 1:43 p.m.

    You still have a thyroid which could at any time randomly chug out more hormone, or less, overriding the...

  • Graves and glucose

    March 31, 2021, 2:20 a.m.

    Hi Kimberly, When I was first diagnosed with hyperthyroidism my fasting glucose was a bit on the high side...

  • New TED diagnosis

    March 30, 2021, 8:28 p.m.

    Thank you so much for your response. I have had a recent CT scan of the orbits which found increased orbital...

  • Graves and glucose

    March 23, 2021, 3:20 p.m.

    Hello and welcome - Graves' disease (and all that comes with it) is definitely overwhelming. The key for now...

  • TED not getting better

    March 21, 2021, 9:36 a.m.

    Thank you all for the advice and kind words. A doctor did mention Tepezza to me, however they didn't think I...

  • TED not getting better

    March 21, 2021, 3:48 a.m.

    Tepezza, which is given as a series of infusions, does work. I have a friend whose TED course has been very...

  • Graves and glucose

    March 20, 2021, 9:40 a.m.

    Hi everyone, I’m new here. To give you some quick background - I was diagnosed with Graves following 2...

  • New TED diagnosis

    March 20, 2021, 4:03 a.m.

    You will need to be followed by an oculoplastic surgeon familiar with Graves. At each visit, pressures should...

  • New TED diagnosis

    March 19, 2021, 7:34 p.m.

    Hello and welcome - hopefully, you will get some responses here, but you might also check out our Facebook...

  • New TED diagnosis

    March 17, 2021, 1:45 p.m.

    Recently diagnosed with early stages of TED. Doctor advised Selenium, low sodium diet, sleeping head...

Questions? Problems? Please contact us at [email protected] or 877-643-3123.

GDATF on Facebook

Support the GDATF and become a member today!

© 2021 Graves' Disease & Thyroid Foundation