Tea@programming.dev to Technology@lemmy.worldEnglish · edit-28 days agoAI crawlers cause Wikimedia(The umbrella organization of Wikipedia and a dozen or so other crowdsourced knowledge projects) Commons bandwidth demands to surge 50%.diff.wikimedia.orgexternal-linkmessage-square78fedilinkarrow-up1698cross-posted to: fuck_ai@lemmy.worldtechnology@beehaw.orgtechnology@lemmy.zip
arrow-up1698external-linkAI crawlers cause Wikimedia(The umbrella organization of Wikipedia and a dozen or so other crowdsourced knowledge projects) Commons bandwidth demands to surge 50%.diff.wikimedia.orgTea@programming.dev to Technology@lemmy.worldEnglish · edit-28 days agomessage-square78fedilinkcross-posted to: fuck_ai@lemmy.worldtechnology@beehaw.orgtechnology@lemmy.zip
minus-squareStrawberrylinkfedilinkEnglisharrow-up2·7 days agoSure but we’re in the comments section of an article about wikipedia being crawled, which is silly because they could just download a snapshot of wikipedia
minus-squareTXL@sopuli.xyzlinkfedilinkEnglisharrow-up1·5 days agoThat’s right. It’s not humans making careful decisions about what to download. It’s a program that follows links and saves files.
Sure but we’re in the comments section of an article about wikipedia being crawled, which is silly because they could just download a snapshot of wikipedia
That’s right. It’s not humans making careful decisions about what to download. It’s a program that follows links and saves files.