Editing robots.txt
Editing the robots.txt
file is considered a very advanced and sensitive change. The default robots.txt
provided by Shopify is already optimal for SEO, and there are very few reasons to change it. Even a minor mistake in the robots.txt
file can make your whole store invisible to search engines. Never edit the robots.txt
file unless you absolutely know what you are doing. Our support can't be held responsible for any problem caused by an incorrect robots.txt
customization.
Search engines, such as Google, constantly crawl the internet in search of new data as a source for their search results. The robots.txt
file tells search engine bots, known as crawlers, which pages to request to view from your online store. All Shopify stores have a default robots.txt
file that's optimal for Search Engine Optimization (SEO).
You can however write your own robots.txt
file. By default, Shopify does not create the robots.txt
file. Due to its very sensitive nature, merchants who wish to edit the robots.txt
file need to explicitly create it. You can find more information about how to create and manage the robots.txt
file in Shopify official documentation.