• WolfLink@sh.itjust.works
    link
    fedilink
    arrow-up
    40
    ·
    16 days ago

    Of the ways you listed the only one that will actually take advantage of a multi core CPU is multiprocessing

    • lime!@feddit.nu
      link
      fedilink
      English
      arrow-up
      10
      ·
      16 days ago

      yup, that’s true. most meaningful tasks are io-bound so “parallel” basically qualifies as “whatever allows multiple threads of execution to keep going”. if you’re doing numbercrunching in pythen without a proper library like pandas, that can parallelize your calculations, you’re doing it wrong.

      • WolfLink@sh.itjust.works
        link
        fedilink
        arrow-up
        8
        ·
        edit-2
        16 days ago

        I’ve used multiprocessing to squeeze more performance out of numpy and scipy. But yeah, resorting to multiprocessing is a sign that you should be dropping into something like Rust or a C variant.

        • itslilith
          link
          fedilink
          arrow-up
          1
          ·
          15 days ago

          Most numpy array functions already utilize multiple cores, because they’re optimized and written in C