Davriellelouna@lemmy.world to Technology@lemmy.worldEnglish · edit-229 days agoThe AI company Perplexity is complaining their bots can't bypass Cloudflare's firewallwww.searchenginejournal.comexternal-linkmessage-square249fedilinkarrow-up1871arrow-down18
arrow-up1863arrow-down1external-linkThe AI company Perplexity is complaining their bots can't bypass Cloudflare's firewallwww.searchenginejournal.comDavriellelouna@lemmy.world to Technology@lemmy.worldEnglish · edit-229 days agomessage-square249fedilink
minus-squarepressanykeynow@lemmy.worldlinkfedilinkEnglisharrow-up1·edit-228 days ago Cloudflare doesn’t distinguish these things It does. You just make useragent like “AI bot request initiated by user” and the website owners will decide for themselves to allow your traffic or not. If your bot pretends to not be a bot, it should be blocked. Edit. Btw Openai does this.
It does.
You just make useragent like “AI bot request initiated by user” and the website owners will decide for themselves to allow your traffic or not.
If your bot pretends to not be a bot, it should be blocked.
Edit. Btw Openai does this.