Unclear if sitemap.xml and robots.txt are set up correctly.
Sitemap and robots.txt are the first files search engines fetch. A typo there can wipe your site from the index.
Try this first
- 1Open yourdomain.tld/robots.txt. No Disallow: / on the whole site (that blocks everything), do reference the sitemap at the bottom: Sitemap: https://yourdomain.tld/sitemap.xml.
- 2Open yourdomain.tld/sitemap.xml. Should be valid XML with the URLs you want indexed. Yoast and RankMath generate this automatically in WordPress.
- 3Only block what truly should not be crawled: /wp-admin, /cart, /checkout, search results. The rest stays crawlable.
- 4Submit sitemap.xml in Search Console. That shows which URLs get indexed and which errors Google sees.
- 5Webflow: sitemap.xml is auto-generated under Project Settings > SEO. robots.txt is configurable there too.
- 6Re-check quarterly. A new plugin or an accidental 'Discourage Search Engines' tick can ruin everything.
When to bring us in
Suspect the site dropped out of Google due to a robots or sitemap mistake? Run a technical SEO audit or have an SEO specialist review Search Console with you.
See also
- WordPress, plugins and theme have gone 6+ months without updatesOut-of-date WP is the number-one entry for malware. Don't just hit 'update all', back up first.
- Theme update broke the layout or threw a fatal errorThemes overwrite custom CSS on update unless you use a child theme.
- WordPress shows a blank screen after a plugin install or updateWSOD (white screen of death) is usually one crashing plugin. You isolate it.
None of the above fits?
Describe your situation below. We pass your input plus the steps you already saw to our AI and return tailored next-step advice. If it's too risky to DIY, we'll say so.
Or skip the DIY entirely
Our Managed IT clients do not look these things up. One point of contact, a fixed monthly price, resolved within working hours.