Update The upgrade was done, DB migrations took around 5 minutes. We’ll keep an eye out for (new) issues but for now it seems to be OK.

Original message We will upgrade lemmy.world to 0.18.3 today at 20:00 UTC+2 (Check what this isn in your timezone). Expect the site to be down for a few minutes. ““Edit”” I was warned it could be more than a few minutes. The database update might even take 30 minutes or longer.

Release notes for 0.18.3 can be found here: https://github.com/LemmyNet/lemmy/blob/main/RELEASES.md

(This is unrelated to the downtimes we experienced lately, those are caused by attacks that we’re still looking into mitigating. Sorry for those)

  • Ulu-Mulu-no-die@lemmy.worldEnglish
    123·
    1 year ago

    Sorry for those

    It’s not your fault :) We know you admins are working really hard to keep the server as stable as possible.

  • zkfcfbzr@lemmy.worldEnglish
    67·
    1 year ago
    • Add controversial ranking
    • Change logic for determining comment default language
    • Add infinite scroll user option

    Neat. I hope the comment language logic change means the default won’t be “Undetermined” anymore.

  • GONADS125@lemmy.worldEnglish
    63·
    1 year ago

    I’m sure the attacks are just as annoying for you guys as they are to us, if not more. Appreciate the update.

    Edit: Loving the endless scroll for the front page! I’ve been eagerly awaiting that. Such a small change, but such a big impact.

      • quaddo@reddthat.comEnglish
        18·
        1 year ago

        Fwiw, it can be helpful to call out the date for such changes. Preferably in YYYY-MM-DD (ISO 8601).

        While it’s helpful to link to an off-site timezone converter tool (thanks for that, btw), “today” can be a different date, depending on where in the world you are. For example, Japan, Australia, and New Zealand.

            • quaddo@reddthat.comEnglish
              2·
              1 year ago

              As someone who has had to grind through heaps of logs over the years, from systems in various timezones, from products that disagreed on the ‘best’ datetime format, I’ve become a fan of adopting ISO 8601 as much as possible. For personal systems such as a laptop, that’s a different story. But if I’m spinning up an EC2 instance in us-west-2 or a VM in Central Europe, I avoid the whole “err, what TZ is this in, or should even be in?” decision-making process and just run with WHO CARES IT’S SET TO UTC NOW LET’S MOVE ON ALREADY 😀

              And not that anyone here is likely to care, but here’s a quick shout out to lnav - The Logfile Navigator for grinding on system logs (for systems where something like Prometheus or whatever hasn’t been proactively set up).

  • randint@feddit.nlEnglish
    31·
    1 year ago

    Minor suggestion: write your time zones like UTC+2 and not CEST. I’m pretty sure most people outside Europe don’t know what the time zone CEST is. Yes, you provided a link that helpfully converts the time to the users’ local time zone, but sometimes it’s nicer to be able to know something without having to click into a link.

      • randint@feddit.nlEnglish
        18·
        1 year ago

        Wow, you actually changed it! I was kind of shocked when I came back to my feed seeing UTC+2 in the title. Thanks! :D

    • Bappity@lemmy.worldEnglish
      4·
      1 year ago

      it would be nice if Lemmy had support for formatting Unix timestamps in whatever timezone whoever is looking at it is in, like discord

      • Poplar?@lemmy.worldEnglish
        0·
        1 year ago

        The problem with open-source for me is reading ideas like this and having to deal with the frustration of not knowing how to write it myself.

  • AlmightySnoo 🐢🇮🇱🇺🇦@lemmy.worldEnglish
    22·
    1 year ago

    This version brings major optimizations to the database queries, which significantly reduces CPU usage. There is also a change to the way federation activities are stored, which reduces database size by around 80%.

    Is it me or is the 80% figure just insane? Are there any benchmarks to see how fast this has become versus say Lemmy 0.18.2 on a very large instance?

    • miket@lemmy.worldEnglish
      22·
      1 year ago

      Is it me or is the 80% figure just insane?

      Not really, you’d be surprised how often systems are bloated all because of a single option, character, etc. Most developers don’t start optimizing until much later in the software’s lifecycle. Often enough, it is easily overlooked. That’s why code reviews are needed often with fresh pair of eyes.

      Just to set the expectations, reducing database size or CPU usage does not necessarily mean it is faster but it does mean there’s more free capacity on the servers to handle more users at the same performance.

      More importantly; they may help reduce costs on the smaller indie instances that doesn’t need to buy larger server instances.

      Hopefully, we’ll continue to see more of these optimizations.

      • AlmightySnoo 🐢🇮🇱🇺🇦@lemmy.worldEnglish
        1·
        1 year ago

        I believe if the backend doesn’t have to write as much data then you’ll have less I/O operations so it should IMO have an impact on the overall speed of Lemmy (unless all of those operations are done asynchronously). Same for the reduced CPU usage, it could allow for more stuff in parallel.

        • miket@lemmy.worldEnglish
          1·
          1 year ago

          Speed/pref and capacity are two separate things. I/O has nothing to do with the size of the database. You can write 100TB per second into the database and choose to only store 1TB of content. That does not mean the app is writing 1TB per second, it is still writing 100TBps.

          They said they changed how the activities data is stored, which reduced the size by 80%; here’s one of the changes they made: https://github.com/LemmyNet/lemmy/issues/3103

          As you can see, the issue here is that they were storing a lot of data in the activities table that is not needed, it was only meant for debug purposes. So, they split up the data into two and not store the other data as it isn’t needed; they’re still writing these data the same as before. One part is used to ensure they don’t re-process the same data but this is the same thing they were doing before this change.

          In addition, they’ve limited how long the data is retained for 3 months, which is a separate job they run to remove data.

          All of this has zero impact on the users using the app right now. The main benefit is for instance admins with limited storage. One might say the system slows down if there’s not enough space but that is still the same case here with this MR, it will still slow down.

          • 2014MU69@lemmy.world
            1·
            1 year ago

            Wait does that mean posts older than 3 months gets automatically deleted? Isn’t that kinda bad? Being able to find years old posts is an important part of Reddit and pretty much all social media.

            • miket@lemmy.worldEnglish
              2·
              1 year ago

              Nobody said anything about posts. Activities could mean extra metadata like “someone joined”, “someone changed”, posted, edited, etc.

              Most of the time, these isn’t required after a short while.

    • miket@lemmy.worldEnglish
      10·
      1 year ago

      Funnily enough, this is the feature that can speed up the performance by doing less calls:

      The federation code now includes a check for dead instances which is used when sending activities. This helps to reduce the amount of outgoing POST requests, and also reduce server load.