Inside Search Quality: Using metrics and data science to improve Search | Search Off the Record



In this episode of SOTR, Lizzi and John sit down with Elizabeth Tucker to go behind the scenes of Search Quality product management. Listen along as they discuss using data science to measure quality and make improvements, how search behavior is changing over time, and how to think about E-E-A-T and the Search Quality Rater Guidelines.

Resources:
Episode transcript → https://goo.gle/sotr076-transcript
BERT paper → https://goo.gle/3XroKpe
E-E-A-T for site owners → https://goo.gle/4c5E0fQ
Search Quality Rater Guidelines → https://goo.gle/3z07OvN
Improving Search with Rigorous Testing → https://goo.gle/45x7OQ0
Day in a life of a Search Quality Product Manager → https://goo.gle/3z087GX
Meet Data Scientists at Google → https://goo.gle/3xzZ67c

Watch more Search Off the Record → https://goo.gle/sotr-yt
Subscribe to Google Search Channel → https://goo.gle/SearchCentral

Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team.

#SOTRpodcast

Speaker: John Mueller, Lizzi Sassman, Elizabeth Tucker
Products Mentioned: Search Console – General

source

11 thoughts on “Inside Search Quality: Using metrics and data science to improve Search | Search Off the Record”

  1. I absolutely loved this episode. I wish it could go on forever. Great insights, and impressive challenges that the people had overcome.
    Search was bad for a short period recently, but now I think it got back on track, so thanks everyone who is involved with GSearch and Gemini. Personally I've switched to Gemini, and looking forward to an Nvida Robot with Gemini to be my companion.

  2. Interesting to see this topic being discussed. From what I have been recently hearing is that people are not really finding on google what they need and they are actually switching to use chatGPT as a search engine. I was really surprised about that, but it makes sense. Google spits out websites with potential answers stacked in a certain order (not always satisfying, tons of useless content) while chatGPT gets straight to the point and spits out the answer. Some people even use GPT to search for product recommendations.

  3. Are you seeing more people using Google Search now that prompt based AI services like ChatGPT and Mistral have become more mainstream? Are you including questions from Gemini in these metrics now since it seems to use Google index?

    I don't use these services for Searching per say and tend to use them for writing, extracting information, and to get a higher level understanding of complex topics and problems. Also compared to Google (I skip Reddit) Search, Bing, and DuckDuckGo, it seems I can get more up to date information that ChatGPT or Bard would not have.

    For instance asking ChatGPT for their recommendations of CPU for gaming would reply with CPUs from two years ago. While a Search query on Google search would point to current bench mark testing and recommendations from popular gaming channels (Gamers Nexus and Hardware Unboxed) on Youtube(again I skip those Reddit posts because their quality is low and its hard to parse.). Also noticed Gemini is also quite inaccurate on current topics. For example: I asked it: Who do you think will win the Formula 1 race at Le Mans? It replied with information that was inaccurate misleading and outdated. First off There is no Formula 1 race at Le Mans! While this is a harmless response I"m worried for others asking important information that leads to something more detrimental.

  4. So it sounds like the amped up neural matching as it appeared last year although there doesn't seem to be any recognition on how bad search has gotten because of the changes over the last year.

    I can't tell if Google is just out of touch with how bad their product has become or they're just refusing to acknowledge it publicly.

    If you listen to Tucker here, you would think it's going amazingly well, but it just isn't and that's me as a searcher, not an SEO, speaking.

  5. Interesting, with all the information that was given with the links in the description, this tells us that you are giving us some heads up to get things straight on your website, as there is a broad core update coming in the next couple of weeks or so.

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top