Randem Systems Support Board

In some instances you may want to use an online sitemap generator such as Xml Site Generator (https://xmlsitemapgenerator.org/) to generate a sitemap. If the generator cannot find your site or is blocked from accessing your site you should find the IP address of the site that is sending the spider to crawl your site to generate the sitemap then remove it from your .htaccess file and add the IP to your BotBanish table (botbanishclient_ip_dnb), so that it will not be blocked in the future.

I.E. The IP for xmlsitemapgenerator is 52.166.181.85. You can find this IP by pinging xmlsitegenerator.org