Website Cache blocked web crawler....that's a thing???
Here is the context.
- Crawled my live site
- Saw that none of the blogs were being crawled, only the blog home page.
- Next i crawled the staging site where we work with a one-for-one replica of the live site, and i could see the blogs in that crawl.
- Checked the live site in a Chrome incognito window and could not see the blog page, just white screen. I was not given any 404, 502, or other errors, just a blank screen .
- Cleared our live website cache and it loaded in incognito and could be crawled again.
What happened? I have not experienced this before. If I am missing something simple then please by all mean rake me over the coals so i learn my lesson. This issue is just very strange to me.
[link] [comments]
Digitalmarketing
0 Comments