Tea@programming.dev to Technology@lemmy.worldEnglish · 8 days agoWikipedia is giving AI developers its data to fend off bot scrapersenterprise.wikimedia.comexternal-linkmessage-square11fedilinkarrow-up195arrow-down13cross-posted to: technology@lemmy.zip
arrow-up192arrow-down1external-linkWikipedia is giving AI developers its data to fend off bot scrapersenterprise.wikimedia.comTea@programming.dev to Technology@lemmy.worldEnglish · 8 days agomessage-square11fedilinkcross-posted to: technology@lemmy.zip
minus-squareMonument@lemmy.sdf.orglinkfedilinkEnglisharrow-up13·8 days agoNo, because there isn’t a single IP range or user agent, and many developers are going to lengths to defeat anti-scraping measures, which include user agent spoofing as well as vpns and the like to mask the source of the traffic.
No, because there isn’t a single IP range or user agent, and many developers are going to lengths to defeat anti-scraping measures, which include user agent spoofing as well as vpns and the like to mask the source of the traffic.