☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to technology@hexbear.netEnglish · 3 months agoReddit will block the Internet Archivewww.theverge.comexternal-linkmessage-square6linkfedilinkarrow-up132arrow-down10cross-posted to: reddit@lemmy.worldpiracy@lemmit.onlinereddit@lemmy.mltechnology@lemmygrad.mlredditwasfun@lemmy.worldnews@lemmy.worldtechnology@lemmy.worldtechnology@lemmy.zipreddit@lemmy.world
arrow-up132arrow-down1external-linkReddit will block the Internet Archivewww.theverge.com☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to technology@hexbear.netEnglish · 3 months agomessage-square6linkfedilinkcross-posted to: reddit@lemmy.worldpiracy@lemmit.onlinereddit@lemmy.mltechnology@lemmygrad.mlredditwasfun@lemmy.worldnews@lemmy.worldtechnology@lemmy.worldtechnology@lemmy.zipreddit@lemmy.world
minus-squareThermonuclearEgg@hexbear.netlinkfedilinkEnglisharrow-up2·edit-23 months agoMaybe I’m mistaken but I have heard the Internet Archive applies robots.txt retroactively
Maybe I’m mistaken but I have heard the Internet Archive applies robots.txt retroactively