SEO Gets SEO Gets

SEO Gets Bot

SEOGetsBot is our bot that is used to power our Indexing Report feature. For customers on the paid plan using this feature, the bot might visit and download your sitemaps at most once every 24 hours.

Our bot does not crawl your website, it only downloads your sitemap files, so there’s minimal load on your server.

User-Agent: (Recommended)

  • Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; SEOGetsBot/1.0; +https://seogets.com/bot)

IP Addresses:

  • 34.173.165.86

Note: Our IPs have changed in the past, and will continue to change over time. We recommend whitelisting the User-Agent string instead, as it’ll remain constant.

Machine-readable information about our bot can be found at /bot.json in JSON format.

FAQ

I’m seeing an error 403 or 429 when your bot tries to access my sitemap, what should I do?

These usually means that your server or CDN is blocking our bot from accessing your sitemap. The most common reason is bot protection software, or a firewall like Cloudflare.

Cloudflare

If you’re using Cloudflare, you can create a firewall security rule to allow requests from our bot’s User-Agent.

Shopify

If you’re using Shopify, you need to whitelist our bot, following this guide and register SEO Gets as a crawler.

After following the steps on Shopify’s guide, send us the following items in the chat:

  • Your domain
  • Signature
  • Signature-Input
  • Signature-Agent

You might need to renew this whitelist every 90 days.

  • For other bot protection software, please refer to their documentation on how to whitelist specific IP addresses or User-Agents.

Is this a static IP address?

No. Our IPs have changed in the past, and will continue to change over time. We recommend whitelisting the User-Agent string instead, as it’ll remain constant.

What should I do if I have further questions?

Use the chat widget on the bottom right of the screen on https://app.seogets.com.