Common Crawl · JSON

Machine-readable JSON of Common Crawl CIDRs with metadata. 5 CIDRs, refreshed daily.

// commoncrawl_ips.json

DOWNLOAD ↓ ·

[
  {
    "ip_address": "3.41.188.32/29",
    "ip_type": "IPv4",
    "service": "ccbot"
  },
  {
    "ip_address": "18.97.9.168/29",
    "ip_type": "IPv4",
    "service": "ccbot"
  },
  {
    "ip_address": "18.97.14.80/29",
    "ip_type": "IPv4",
    "service": "ccbot"
  },
  {
    "ip_address": "18.97.14.88/30",
    "ip_type": "IPv4",
    "service": "ccbot"
  },
  {
    "ip_address": "2600:1f28:365:8000::/56",
    "ip_type": "IPv6",
    "service": "ccbot"
… (2 more lines)