Special files in robots.txt

In this episode of Ask Google Webmasters, John Mueller goes over special files in robots.txt such as *.css, php.ini, and .htaccess, and explains why one does not have to and should not disallow these files from being crawled. The question was submitted by @svperflvid. Thank you!

Send us your questions on Twitter with the hashtag AskGooglebot and your question might be answered!
Google Search Central on Twitter → https://goo.gle/3f4Z0a8

Watch more AskGooglebot episodes → https://goo.gle/2OjWcvS
Subscribe to the Google Search Central Channel → https://goo.gle/SearchCentral

#AskGooglebot

Видео Special files in robots.txt канала Google Search Central