How Pages Blocked by Robots.txt Are Ranked And Site UX Can Impact Your Google Rankings episode artwork

EPISODE · Jul 11, 2019 · 52 MIN

How Pages Blocked by Robots.txt Are Ranked And Site UX Can Impact Your Google Rankings

from Webcology · host WMR.FM Formerly Webmaster Radio

Google’s John Mueller recently explained how query relevancy is determined for pages blocked by robots.txt. It has been stated that Google will still index pages that are blocked by robots.txt. But how does Google know what types of queries to rank these pages for? Dejan posted a Twitter poll the other day and it received almost 600 responses from within the SEO community. The question was "Good UX impacts rankings." The responses available were "directly," "indirectly," or "neither." Google's John Mueller said it is best to be consistent with your URL structure and either choose to use slashes after the URL or not to use slashes after the URL. Try not to use both formats if possible. He posted this on Twitter when asked about slashes after URLs "The best solution is to be consistent and only use one version of a URL. Link to that version, redirect to it, use it in sitemaps, use it for rel-canonical, etc." Some searchers in India are noticing that when you enter a query into Google that has no matches and Google has no idea what you are looking for, Google will show you a section called "some popular queries."Advertising Inquiries: https://redcircle.com/brandsPrivacy & Opt-Out: https://redcircle.com/privacy

Episode metadata supplied by the publisher feed · Published Jul 11, 2019

Embed this episode

NOW PLAYING

How Pages Blocked by Robots.txt Are Ranked And Site UX Can Impact Your Google Rankings

0:00 52:38

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

No similar episodes found.

No similar podcasts found.

Frequently Asked Questions

How long is this episode of Webcology?

This episode is 52 minutes long.

When was this Webcology episode published?

This episode was published on July 11, 2019.

Can I download this Webcology episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.
URL copied to clipboard!