Is the crawl delay rule ignored by Googlebot? I am getting a warning message in Search Console. — asks Amit from Noida, India.
We’ll answer that question and give some general tips in this video.
Have a question? Ask it in our Webmaster Help Forum: https://support.google.com/webmasters/go/community
Want your question to be answered on a video like this? Follow us on Twitter and look for an announcement when we take new questions: http://twitter.com/googlewmc
Help forum: https://support.google.com/webmasters/go/community
Search Console: https://www.google.com/webmaster/tools
Subscribe to the Google Search Central Channel → https://goo.gle/SearchCentral
source
tell me please, if it would be better to remove crawl-delay from robots?
What is a robot text file ?
Thank you so much John 🙂
I set crawl delay not for googlebot but for other bots collectively are a problem.
Great thanks Big rock messageg
Hi guys ! how to can i get more subscribes and more videos ?
Hello Jonh!! Greetings!! How can I submit a .asp sitemap to crawler?
More more more plz
My name is spelled wrong John 😀
Thanks for the detailed explanation!