AI Crawler & Bot IP Ranges
IP ranges published by AI training crawlers, search engine bots, and user-triggered fetchers — ClaudeBot, GPTBot, Googlebot, PerplexityBot and more.
6,137 ranges from 14 providers in one file, every AI crawler and bot: txt csv json
# block every ai crawlers & bots range with iptables
curl -sO https://cloud-ip-ranges.com/download/category/ai-crawlers.txt
while read ip; do iptables -A INPUT -s $ip -j DROP; done < ai-crawlers.txtTwo things people do with this list. Verify: a request claiming to be GPTBot that comes from an address outside these ranges is not GPTBot, whatever its user agent says. Rate-limit or block: if a crawler is costing you bandwidth, these are the addresses to shape at the edge. Prefer a robots.txt rule when you simply want to opt out — blocking by IP can stop a crawler from ever reading your robots.txt, so it never learns you opted out.
Providers
| Provider | Last change | CIDRs | Download formats |
|---|---|---|---|
 Amazonbot |
1,292 | txt csv json | |
| Amzn-SearchBot |
816 | txt csv json | |
| Amzn-User |
1,023 | txt csv json | |
| 33 | txt csv json | ||
| 28 | txt csv json | ||
| 5 | txt csv json | ||
| 213 | txt csv json | ||
| 26 | txt csv json | ||
| 486 | txt csv json | ||
| 2,143 | txt csv json | ||
| 21 | txt csv json | ||
| 39 | txt csv json | ||
| 8 | txt csv json | ||
| 4 | txt csv json |
Other categories
Datacenter & Hosting, CDN & Edge, SaaS & Business APIs, Uptime Monitoring, VPN & Networks, Security Scanners, all 81 providers