I just installed apt cacher ng for catching my apt upgrade packages and saw a huge time improvement even though I have a good internet connection. It act as a proxy and caches the response packages.

Do you run something similar? Or maybe even run a local repo mirror? Warning, they are really big so I don’t think it is recommended unless you really need almost everything.

  • @kill_dash_nine@lemm.eeEnglish
    4•9 months ago

    I use apt cacher ng. Most of my use case though is for caching of packages related to Docker image builds as I build up to 200+ images daily. In reality, I have aggressive image caching so I don’t actually build anywhere close to that many each day but the stats are impressive. 8.1 GB of data fetched from the internet but 108 GB served from the acng instance as it shows in the stats page of recent history.

  • @owatnext@lemmy.worldEnglish
    2•9 months ago

    At the beginning of the COVID pandemic, I was attempting to mirror all of my favorite distro repos, just in case of societal collapse.

  • @vegetaaaaaaa@lemmy.worldEnglish
    2•9 months ago

    I want to look into apt-cacher-ng for learning purposes, to stop 10s of VMs in my homelab from adding load to Debian official repos, and also to check if there is a way to have it only mirror a list of “approved” packages.

    saw a huge time improvement even though I have a good internet connection

    Note that for best performance you should use https://deb.debian.org/

    Semi-related I have set up a personal APT repository on gitlab pages: https://nodiscc.gitlab.io/toolbox/ (I think Ubuntu users would call that a “PPA”). It uses aptly and a homegrown Makefile/Gitlab CI-based build system (sources/build tools are linked from the page). I wouldn’t recommend this exact setup for critical production needs, but it works.

      • @Mio@feddit.nuOPEnglish
        1•9 months ago

        The dvds are fine for offline use. But I dont know how to keep them updated. Probably result in taking loads of spaces as I guess they are equal to a repo mirror

    • @Mio@feddit.nuOPEnglish
      2•9 months ago

      I use it with Kubuntu. Doing apt update is now much faster. I did some testing and found some good public mirror so I could max my connection(100 Mbit) with about 15ms latency to the server. But I think the problem was there are so many small files. Running nala to fetch the files in parallel helps of course. With apt local ng I don’t need nala at all. The low latency and files on gigabit connection to my server leads to fast access. Just need to find a good way to fill it with new updates.
      A second problem is to figure out if something can be done to speed up the apt upgrade, which I guess is not possible. Workaround with snapshots and send diff does not sound efficient either, even on older hardware.

      apt update - 4 seconds vs 16 seconds.

      apt upgrade --download-only - 10 seconds vs 84 seconds;

  • MrWigglesEnglish
    1•9 months ago

    This is what I use Foreman and Katello for. Package mirror with x versions synced automatically with all my machines subscribed. Or it would be, if I ever got around to actually setting the damn thing up. I have a debian package repo and a few things subscribed, but I’d like to add more.