Randem Systems Support Board

BotBanish => BotBanish - General Questions, Report Bugs, Problems etc... => Topic started by: Randem on October 08, 2020, 07:11:09 PM

Title: Creating a Sitemap for Your Site That is Protected by BotBanish
Post by: Randem on October 08, 2020, 07:11:09 PM
In some instances you may want to use an online sitemap generator such as Xml Site Generator (https://xmlsitemapgenerator.org/) to generate a sitemap. If the generator cannot find your site or is blocked from accessing your site you should find the IP address of the site that is sending the spider to crawl your site to generate the sitemap then remove it from your .htaccess file and add the IP to your BotBanish table (botbanishclient_ip_dnb), so that it will not be blocked in the future.

I.E. The IP for xmlsitemapgenerator is 52.166.181.85. You can find this IP by pinging xmlsitegenerator.org