Had this thought the other day and tbh it’s horrifying to think about the implications of one, or God forbid all, of them going down.
Stackoverflow too but that only applies to nerds haha

  • Possibly linux@lemmy.zipEnglish
    8·
    4 days ago

    I wish that the Internet Archive would focus on allowing the public to store data. Distribute the network over the world.

    • csm10495@sh.itjust.worksEnglish
      3·
      3 days ago

      In theory this could be true. In practice, data would be ripe for poisoning. It’s like the idea of turning every router into a last mile CDN with a 20TB hard drive.

      Then you have to think about security and not letting the data change from what was originally given. Idk. I’m sure something is possible, but without a real ‘omph’ nothing big happens.

        • csm10495@sh.itjust.worksEnglish
          1·
          2 days ago

          Hashed by whom? Who has the source of truth for the hashes? How would you prevent it from being poisoned? … or are you saying a non-distributed (centralized) hash store?

          If centralized: you have a similar problem to IA today. If not centralized: How would you prevent poisoning? If enough distributed nodes say different things, the truth can be lost.

          • Possibly linux@lemmy.zipEnglish
            1·
            2 days ago

            This is a topic that is pretty well tested. Basically the data is validated when received.

            For instance in IPFS data is tracked by its hash. You request something by a CID which is just a hash.

            There are other distributed networks and they all have there own ways of protecting against attacks. Usually an attack requires a huge amount of resources.

            • csm10495@sh.itjust.worksEnglish
              1·
              2 days ago

              Even in ipfs, I don’t understand discoverability. Sort of sounds like it still needs a centralized list of metadata to content I’d, etc.

      • Badoker@lemmy.nz
        6·
        4 days ago

        But all the data is on IA’s servers. In the event their servers go down for good, that’s it. There’s no way to self host parts of the Archive fediverse style.

        • antonim@lemmy.dbzer0.com
          2·
          4 days ago

          That’s true, but organising and managing such a distributed form of IA would probably be a nightmare of a job. I’ve seen many people suggest that to IA, but they seem to be very very reluctant about the idea.