Seen the “98% of studies were ignored!” one doing the rounds on social media. The editorial in the BMJ put it in much better terms:

“One emerging criticism of the Cass review is that it set the methodological bar too high for research to be included in its analysis and discarded too many studies on the basis of quality. In fact, the reality is different: studies in gender medicine fall woefully short in terms of methodological rigour; the methodological bar for gender medicine studies was set too low, generating research findings that are therefore hard to interpret.”

  • Cogency@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    7 months ago

    Synthesis is a paragraph summary inclusion ONLY, it means they didn’t use data from the study, it is dismissal. I’m done arguing that with you.

    • streetlights@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      2
      ·
      7 months ago

      They have absolutely used the data from those 60 studies. You can read where they say explicitly that in the report if you cared to.

      You are utterly mistaken and firm on your conviction, these are not the qualities of skepticism.

      “Don’t seek refuge in the false security of concensus”

      • Cogency@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        edit-2
        7 months ago

        That’s not what synthesis means. I’ve written synthesis reports before and the data you include from those reports once you have dismissed them as inaccurate, it is an entirely selective process of whatever you want to include from them. We even have a phrase for it in law, Summarily dismissed.

        • streetlights@lemmy.worldOP
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          7 months ago

          And of the 103 reviewed they included data from 60. It is a lie to say they “dismissed all but two.”

          Legalese is irrelevant. A systematic review of scientific literature is a different beast to “writing a few synthesis reports”.

          • Cogency@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            ·
            edit-2
            7 months ago

            So you don’t know what you are talking about. Gotcha.

            Synthesis reports in a scientific study when presenting data, are the parts of the report where you explain why you are dismissing data, so in this case ~98% of the data or studies. So what you just said is ~98% of the data was included in the synthesis report. that’s not inclusion of the data. That’s selective inclusion to support a conclusion. A normal scientific study can’t dismiss 98% of available data. That reveals bias.

              • Cogency@lemmy.world
                link
                fedilink
                English
                arrow-up
                2
                ·
                edit-2
                7 months ago

                Read it. Their only inclusion in the report is to half explain why the were discluded, exactly what I said. Most of the dismissals are unscientific, not supported by a statistical analysis of why it was discluded. Data doesn’t become unreliable just because it is incomplete.

                That report is absolutely rife with white washing and selection bias, I’d expect a scientific review of trans literature and studies to be a book at this point not 32 pages dismissing 98% of the data. It’s frankly insulting to anyone that’s read or written any number of scientific studies.