Best Custom Robots.txt File For Blogger Blog

Robots.txt file helps to crawlers and indexing in Google search engine of your all site URL. If you need to custom page not found in blogger site you can customize Robots.txt in your blog setting. 

Custom Robots.txt To Blogger For SEO Friendly:

Robots.txt tag is the most important part of any blog. You can easily to create it. What’s the site URL submitting in Google search console? Google easily can know this idea from robots.txt file.

In fact, the robots.txt helps to give guidance about your site to index in Google webmaster tools. So robots.txt must be necessary of any blog. Now follow the bellow lesson step by step and create your own robots.txt tag for your blogger blog. 

How To Add Robots.txt In Blogger:

Now open your web site then go to blog ‘Settings’ and past the bellow robots.txt code in custom robot place.

• Here I will discuss about ‘Blogger’ blog.
• So, go to Blogger >Select your blog

   [A] Go to ‘Settings’

   [B] Search preferences>

Crawlers And Indexing Setting In Blogger:

            [C] Go to ‘Crawlers and indexing’ section

            [D] In ‘Custom robots.txt’ – click on “Edit”

Enable Custom Robots.txt Content In Blogger:

               [E] Enable custom robots.txt content? – checked ž Yes

               [F] Past the bellow robot code in here

               [G] Click “Save changes’ to finished web submission.

 

Blogger robots.txt File:

User-agent: Mediapartners-Google Disallow:

User-agent: *

Disallow: /search

Allow: /

User-agent: *

Disallow: /*.html

Allow: /*.html$

Sitemap: http://help2blogging.blogspot.com/feeds/posts/default?orderby=UPDATED

Customize: Replace http://help2blogging.blogspot.com with your blog URL

Thanks.

No Index or Block Custom URL/ Specific Post:

For post:

Disallow: /2016/10/post URL.html

If you don’t like a custom post in Google search engine please add the tag. But of course replace /2016/10/post URL.html with your URL to do not index stop crawling posts.

For page:

Disallow: /p/page URL.html

This tag add for custom blogger page URL stop crawlers and indexing in Google search engine. Replace page URL.html code for your page URL with after blog name. 

 

Show/ Block/ Stop crawling and indexing Blogger complete page:

Disallow: /p/*

If you don’t like to indexed by crawler of your blogger total page just add this code with Robots.txt file.

Thanks that's all.

---------------------------------------------

If you have any question and suggestions related blogger

Please don't hesitates just sent email or leave comment

Thanks to follow this tutorial

Best regards

help2blogging team