Should you convert your website into Markdown to help Large Language Models (LLMs) understand your content better? Is “llms.txt” worth the effort for SEO? In this episode of Search Off the Record, Martin Splitt and John Mueller from the Google Search Relations team dive deep into the history of Markdown, its rise in the AI era, and whether it holds any real weight for search engine discovery. In this episode, you’ll learn: The Origins of Markdown: From John Gruber and Aaron Swartz to its status as the “language of GitHub.” Markdown vs. HTML: Why the “cleanliness” of Markdown is tempting for developers but potentially risky for site structure. LLMs & Markdown: Do AI crawlers actually prefer Markdown, or are they already experts at parsing HTML? The “Parallel Version” Trap: Why creating a separate text/Markdown version of your site for AI can lead to the same maintenance nightmares as dynamic rendering. Use Cases that Make Sense: When Markdown is actually superior (like developer documentation) and when it’s totally unnecessary (like your shoe catalog). Key Takeaways for SEOs & Developers: Crawlers are built for the “messy” web: Google and other engines have decades of experience parsing HTML. Don’t sacrifice discovery: Headers, footers, and sidebars in HTML provide critical context for site structure that a raw Markdown file might lack. Maintenance is king: Avoid the complexity of maintaining two versions of the same content.
Chapters 0:00 – Introduction: Should we all be using Markdown? 3:45 – The history and purpose of Markdown. 7:15 – Why developers love it: Separation of style and content. 11:20 – Do crawlers need Markdown to understand your site? 14:50 – The danger of “parallel versions” and dynamic rendering lessons. 17:30 – Discussing the “llms.txt” proposal and AI agents. 21:00 – Where Markdown actually makes sense (Developer Docs). 24:00 – Final verdict: Stick to HTML for the web.
Resources Mentioned: Google Search Central: https://developers.google.com/search
Are you using Markdown for your site’s frontend or just as a backend source? Let us know in the comments! Episode transcript → https://goo.gle/sotr111-transcript
Listen to more Search Off the Record → https://goo.gle/sotr-yt
Subscribe to Google Search Channel → https://goo.gle/SearchCentral
Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team.
#SOTRpodcast #SEO #GoogleSearch
Speakers: Martin Splitt, John Mueller
source
Yes I use markdown for my content but then build it out to flat files using 11ty, a static site generator that's rather good. When some people started saying that we should create .md files for LLMs to consume I was sceptical at best. Its knocking on a year since that and only now am I reading justifiable reasons to publish content as .md files and this centers around Google release of OFK….
Video uploads stopped by Google for webmasters ? Only podcasts now ?
It was fun and useful! Thanks 🙂
🙂
Your videos are always so helpful, thank you!
I would point out that clean markdown makes information look highly organized and authoritative for AI and human writing/reading—and because humans write in markdown too, users won't even realize it's AI. But when a human writes, they share actual links to credit sources—which is how creators make a living—whereas when AI writes, it just takes the traffic and leaves you with the formatting. cheers.
Google wants sites a certain way but now that we are living in a world with many agents / answer engines – we need to test and not just take what Google says.
What should we use
Listening to this reminds me of watching Jojo Rabbit.