How to Find Out if Your Website Can Be Crawled
This type of sitemap helps search engines know what’s on your website.
Does your website have a sitemap?
Follow these steps to find out:
- Open up any website browser
- Enter this link: https://www.websitedomain.com/robots.txt (Remember to change this to your own website domain!)
- Copy and paste the sitemap link into the same browser window.
- You should see a list of links on a page titled, “XML Sitemap”.
- If you don’t, something might be wrong!