AI Crawler & Bot IP Ranges

One file, every AI crawler and bot

5,075 ranges from 14 providers in a single download. Permalinks — they always return the latest data, so you can curl them from a cron job.

# Block every ai crawlers & bots range with iptables
wget -O ai-crawlers.txt https://cloud-ip-ranges.com/download/category/ai-crawlers.txt
while read ip; do iptables -A INPUT -s $ip -j DROP; done < ai-crawlers.txt

How this list is used

Two things people do with this list. Verify: a request claiming to be GPTBot that comes from an address outside these ranges is not GPTBot, whatever its user agent says. Rate-limit or block: if a crawler is costing you bandwidth, these are the addresses to shape at the edge. Prefer a robots.txt rule when you simply want to opt out — blocking by IP can stop a crawler from ever reading your robots.txt, so it never learns you opted out.