Website Cache blocked web crawler....that's a thing???

Here is the context.

  1. Crawled my live site
  2. Saw that none of the blogs were being crawled, only the blog home page.
  3. Next i crawled the staging site where we work with a one-for-one replica of the live site, and i could see the blogs in that crawl.
  4. Checked the live site in a Chrome incognito window and could not see the blog page, just white screen. I was not given any 404, 502, or other errors, just a blank screen .
  5. Cleared our live website cache and it loaded in incognito and could be crawled again.

What happened? I have not experienced this before. If I am missing something simple then please by all mean rake me over the coals so i learn my lesson. This issue is just very strange to me.

submitted by /u/just-wana-help
[link] [comments]

Digitalmarketing

Digital marketing agency in darbhanga

Digital marketing agency in Darbhanga Digital marketing agency in Bangalore Local seo service in Darbhanga Best digital marketing agency in patna

0 Comments