// PROVIDERS / COMMON CRAWL
Common Crawl
Live IP-range intelligence for Common Crawl, updated daily at 06:00 UTC from the official upstream feed.
CC
BOT / CRAWLER · ID: commoncrawl
Common Crawl
5
IPv4 CIDRs
1
IPv6 CIDRs
29
IPv4 Addresses
1
Services
—
Regions
// SAMPLE CIDRS
2600:1f28:365:80b0::/60
IPv6
ccbot
3.41.188.32/29
IPv4
ccbot
18.97.9.168/29
IPv4
ccbot
18.97.14.80/29
IPv4
ccbot
18.97.14.88/30
IPv4
ccbot
98.85.178.216/32
IPv4
ccbot
// QUICK SNIPPETS
IPV4 PLAIN TEXT
$ curl -sL .../main/commoncrawl/commoncrawl_ips_v4.txt
MERGED / OPTIMIZED
$ curl -sL .../main/commoncrawl/commoncrawl_ips_merged_v4.txt
NGINX ALLOW
$ curl -sL .../main/commoncrawl/nginx_commoncrawl_allow.conf -o /etc/nginx/conf.d/commoncrawl_allow.conf
IPTABLES DENY (BLOCK)
$ curl -sL .../main/commoncrawl/iptables_commoncrawl_deny.sh | sudo bash
// ALL OUTPUT FORMATS
Nginx.conf
nginx__allow.conf · nginx__deny.confiptables.sh
iptables__allow.sh · iptables__deny.shnftables.conf
nftables__allow.conf · nftables__deny.confUFW.sh
ufw__allow.sh · ufw__deny.shApache.conf
apache__allow.conf · apache__deny.confHAProxy.conf
haproxy__allow.confCaddy.conf
caddy__allow.confJSON.json
_ips.jsonCSV.csv
_ips.csvSQL.sql
_ips.sqlPlain text.txt
_ips.txt · _ips_v4.txt · _ips_v6.txt +3