How to Test Robots txt with tester

How to Test Robots.txt with Robots.txt tester in Blogger For Block Anything

In the previous post, we have already explain you how to create a custom robot.txt file in blogger. However, making and maintaining a good robots.txt file is sometimes not only crucial but also difficult to master. If someone have a site/blogger that have number of pages and directories than blocking of individual URLs is a very difficult task specially for a non technical publisher. To make it easy and simple Google provides us an wonderful helping robots.txt testing tool that does the job for us. Today in our article, we will show you How to test your robots.txt file with robots.txt tester in Blogger.I hope this post will help you a lot.

Are You Know About Robots.txt Testing Tool?

The robots.txt testing tool provides us detailed information about our robots.txt file, is it blocking Google search crawlers from accessing any specific URLs on your site. To make it simple, you can check with this tool whether Google bot crawlers can crawl the URL of your site that you wish to block from Google search engine or not.

Here We Explain How to Test Robots.txt File with Robots.txt Testing Tool:

The first thing here, we have to do is to login to Google Webmaster tool, and then go to Robots.txt tester and from the list of your verified properties select the one which you would like to test.

Here you will see your current robots.text file, you can test different URLs to see if google crawlers are disallowed from crawling them or working normally. Type a URL in the text box which is present at the bottom of the page and press Test button.

Here the test button will change to either "ACCEPTED" or "BLOCKED", it depends on the setting whether the URL you enter has blocked the access of Google crawlers or allowed to search engines.

You can make changes to the robots.txt file as you needs and retest the file as much as needed until you are satisfied with its working. Once you are done all customization and you have finished writing new rules to the file, copy the whole code now and paste it on your robots.txt file hosted on your site/blogger.

Important Note: This tool never changes your robots.txt file, so you have to upload a fresh file at your own. This tool only tests the against the copy hosted in the tool.but after testing you should upload a permanent copy of robots.txt file.

We have already written a tutorial in our previous post about how to edit a Robots.txt file in blogger so please see it first if you don't know how to make changes in robots.txt file to get rid of  any mistake.


We hope this post will solve a lot of your queries regarding blocking of your site URLs.It  may have many answers about your queries regarding creating a perfect robots.txt file without any error and without any prior technical knowledge as this tool makes a lot of things very easier. Now it is simple to test, maintaining and be sure of your robots.txt file. If you are facing any problem in creating robot.txt file, or need help in maintaining feel free to leave a comment below or drop us a message at our contact us page.we will try our best to solve your all problems our user are more important for us than any other thing.Thanks a lot
I hope you will enjoy the post