In this episode of Search Off the Record, Gary, Lizzi, and Martin from the Google Search team are joined by special guest David Price, a Product Counsel for Google. They discuss human initiated crawl requests vs. bot initiated crawl requests, the robots.txt file, and more!
Episode transcript → https://goo.gle/sotr028-transcript
Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team.
Subscribe to Google Search Central Channel → https://goo.gle/SearchCentral
#SOTRpodcast #GoogleSearch
source
Good discussion.
Always enjoy these.
Really great and very detailed discussion on Robots.txt. I think the current txt format is good and easily understandable so moving to json or any other format is not so good.
Hello Sir. Thankyou very2 much all company Google support me settle all my proplem. I like this info.
"The not past, present, and future of clon-ing robots.txt human initiated crawl requests vs. bot initiated crawl requests, the robots.txt file, and more!" this kind of interlinking meta desc sound more future proof
nice information
Thank for information 😊
Great infomation