When search engine bots crawl your website, they'll very first search for this file. It stands as the gatekeeper, so to talk, so when you don’t want your internet site to become indexed or accessed, it understands that with the get-go.There are many methods to use this file. It involves altering The outline, that's, manipulating the instruction b