m3t00🌎🇺🇦@lemmy.world to Technology@lemmy.worldEnglish · edit-21 day agoWikipedia blacklists Archive.today, starts removing 695,000 archive linksarstechnica.comexternal-linkmessage-square58fedilinkarrow-up1426arrow-down111file-textcross-posted to: [email protected][email protected]
arrow-up1415arrow-down1external-linkWikipedia blacklists Archive.today, starts removing 695,000 archive linksarstechnica.comm3t00🌎🇺🇦@lemmy.world to Technology@lemmy.worldEnglish · edit-21 day agomessage-square58fedilinkfile-textcross-posted to: [email protected][email protected]
original, saw this somewhere else too. ddos stuff. this one blames ru for archive.today mess. sounds about right. didn’ intend it to look like an announcement here. it kind of did. post based on ars story, apparently. who knows
minus-squareanthropozaen@feddit.orglinkfedilinkEnglisharrow-up6·1 day agoIt identifies itself as a google (or other) crawler, which sites often allow and give the full content to, for better SEO.
It identifies itself as a google (or other) crawler, which sites often allow and give the full content to, for better SEO.