A Robots.txt file is a simple text file placed in your website's root directory. It tells search engine crawlers (like Googlebot) which pages they can or cannot request from your site. This is crucial for managing your Crawl Budget and preventing the indexing of private or duplicate pages.
You should upload it to the root directory of your website. For example: https://yourdomain.com/robots.txt.
No. Robots.txt only gives instructions to search engine bots. It does not stop a regular user from visiting a URL if they have the link.
It's the number of pages search engines crawl on your site within a specific timeframe. Using robots.txt to block useless pages helps Google spend more time on your important content.