• thesmokingman@programming.dev
    link
    fedilink
    English
    arrow-up
    7
    ·
    6 months ago

    If I ignore what’s in the search bar, I remember that the prefix “mebi” means 2^20 and use a calculator. Your point doesn’t make sense because you’re asking us to get mad at a tool intended to convert scientific units for using the bog standard scientific notation. Byte math uses powers of 2 ergo we should use a calculator that isn’t explicitly set up for rounding.

    • sgh@lemmy.ml
      link
      fedilink
      English
      arrow-up
      3
      ·
      6 months ago

      Are you telling me that whenever you work with Digital Storage units you should never use scientific notation?

      • thesmokingman@programming.dev
        link
        fedilink
        English
        arrow-up
        6
        ·
        6 months ago

        You literally spent an entire comment explaining why you should not use scientific notation and now you’re asking why I might prefer precision in byte arithmetic?

        Good luck with that.

        • sgh@lemmy.ml
          link
          fedilink
          English
          arrow-up
          3
          ·
          edit-2
          6 months ago

          Nope, au contraire, I agree, I’m just pointing out that you said that digital storage conversion should happen in non-scientific notation, so you should now agree with OP in that Google is choosing the wrong output format for a, quote from the screenshot, “Digital Storage” conversion.

          And yes, I’m writing multiple comments trying to explain this through narrative, without having to point out what in your reasoning sounds stupid.

          I.E. Now don’t you tell me that Google is incapable of figuring out which output format it should use for such a calculation…

          Since I apparently need to explain this like you’re 5, please read my last comment like the following:

          “Are you now agreeing with me/OP that whenever you work with Digital Storage units you should never use scientific notation?”