Latest / Musonera Jean Claude's podcast
Crawling smarter, not harder
In this episode of SOTR, John Mueller, Lizzi Sassman, and Gary Illyes talk about misconceptions around crawl frequency and site quality, what's challenging about crawling the web nowadays, and how search engines could crawl more efficiently. Resources: Episode transcript → https://goo.gle/sotr079-transcript Gary's post on LinkedIn → https://goo.gle/3YAT55q Crawling episode with Dave Smart → https://goo.gle/3WShUsf If-Modified-Since → https://goo.gle/3ywXvja About the IETF → https://goo.gle/3SGVVlo Robots Exclusion Protocol → https://goo.gle/4dgmBSg Proposal for new kind of chunked transfer →…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.