mad_asshatter@lemmy.world to Technology@lemmy.worldEnglish · 5 months agoThe Internet Archive is under a DDoS attackbsky.appexternal-linkmessage-square193fedilinkarrow-up11.33Kfile-textcross-posted to: hackernews@lemmy.smeargle.fans
arrow-up11.33Kexternal-linkThe Internet Archive is under a DDoS attackbsky.appmad_asshatter@lemmy.world to Technology@lemmy.worldEnglish · 5 months agomessage-square193fedilinkfile-textcross-posted to: hackernews@lemmy.smeargle.fans
minus-squareGeneral_Effort@lemmy.worldlinkfedilinkEnglisharrow-up1·5 months agohttps://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/ Does this answer the question?
https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/
Does this answer the question?