These are generally the basic metrics that will let you understand how well your website is performing and what places in particular that you have to concentrate on.The robots.txt tester Instrument is actually a utility used to check and verify the contents of a website's robots.txt file, which instructs online search engine crawlers on which pages