Technical difficulties with the website could include:
1. Disconnected webs
2. crucial files, sitemap and robots.txt, are missing:
3. Incorrect use of noindex/nofollow
4. Having multiple titles, descriptions, or H1 tags, or ones that are too long, is a common problem.
With the help of this no-cost tool, WebBeeSEOSpider 3.0, I was able to quickly and easily scan for all of these problems in under a minute.
Instructions:
First, get the file by downloading it.
If you want to examine your website’s stats, step 2 is to enter your domain name.
Just number three: press the “Play” button. Okay, that settles it.
Source: https://www.eebew.com/spider/user-guide/installing-webbee-spider/